Small models, BIG impact: SmolLM is here! 🚀🔬
text
Small models, BIG impact: SmolLM is here! 🚀🔬
new_line
new_line
We're launching a series of small but mighty language models:
text
We're launching a series of small but mighty language models:
new_line
🏎️ Super fast - runs on laptops, phones, you name it!
text
🏎️ Super fast - runs on laptops, phones, you name it!
new_line
📏 3 sizes: 130M, 350M, and 1.5B parameters
text
📏 3 sizes: 130M, 350M, and 1.5B parameters
new_line
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
text
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
new_line
🔓 Fully open-source: datasets, training code, models
text
🔓 Fully open-source: datasets, training code, models
new_line
new_line
𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
text
𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
new_line
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
text
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
new_line
- No cloud needed - run locally for privacy and energy efficiency
text
- No cloud needed - run locally for privacy and energy efficiency
new_line
- Everything is public, from data curation to training steps
text
- Everything is public, from data curation to training steps
new_line
new_line
𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
text
𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
new_line
- On-device autocomplete
text
- On-device autocomplete
new_line
- Local request parsing
text
- Local request parsing
new_line
- Custom fine-tuning for specific needs without the need for expensive GPUs
text
- Custom fine-tuning for specific needs without the need for expensive GPUs
new_line
new_line
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
text
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
new_line
👉 Check it out: 
text
👉 Check it out: 
https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
link
new_line
👉 Run the 360M model in your browser, 100 % private: 
text
👉 Run the 360M model in your browser, 100 % private: 
https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
space
resource
https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
new_line
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm
text
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm
new_line
new_line
Kudos to the stellar team who worked on this project: 
text
Kudos to the stellar team who worked on this project: 
@loubnabnl
mention
loubnabnl
text
@anton-l
mention
anton-l
text
@eliebak
mention
eliebak
text
@lvwerra
mention
lvwerra
text
Small models, BIG impact: SmolLM is here! 🚀🔬

We're launching a series of small but mighty language models:
🏎️ Super fast - runs on laptops, phones, you name it!
📏 3 sizes: 130M, 350M, and 1.5B parameters
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
🔓 Fully open-source: datasets, training code, models

𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
- No cloud needed - run locally for privacy and energy efficiency
- Everything is public, from data curation to training steps

𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
- On-device autocomplete
- Local request parsing
- Custom fine-tuning for specific needs without the need for expensive GPUs

𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
👉 Check it out: https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
👉 Run the 360M model in your browser, 100 % private: https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm

Kudos to the stellar team who worked on this project: @loubnabnl @anton-l @eliebak @lvwerra 
🔥
YaTharThShaRma999 sgarbi sivan22 mdouglas nroggendorff John6666 reach-vb plaguss gabrielmbmb osanseviero jeffboudier AyoubChLin holooo raveninrhythm Ramikan-BR clem yjernite louisbrulenaudet
🤝
surfhb reach-vb osanseviero FaultyEntry ucsahin raveninrhythm Ramikan-BR clem yjernite
🚀
Ramikan-BR clem yjernite
❤️
Ramikan-BR clem yjernite
👀
Ramikan-BR clem
🧠
Ramikan-BR clem