Collections

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B.

A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.

FineMath datasets and ablation models