⭐ Today we’re releasing The Stack v2 & StarCoder2:  a series of 3B, 7B & 15B code generation models trained on 3.3 to 4.5 trillion tokens of code: 
text
⭐ Today we’re releasing The Stack v2 & StarCoder2:  a series of 3B, 7B & 15B code generation models trained on 3.3 to 4.5 trillion tokens of code: 
new_line
new_line
- StarCoder2-15B matches or outperforms CodeLlama 34B, and approaches DeepSeek-33B on multiple benchmarks.
text
- StarCoder2-15B matches or outperforms CodeLlama 34B, and approaches DeepSeek-33B on multiple benchmarks.
new_line
- StarCoder2-3B outperforms StarCoderBase-15B and similar sized models.
text
- StarCoder2-3B outperforms StarCoderBase-15B and similar sized models.
new_line
- The Stack v2 a 4x larger dataset than the Stack v1, resulting in 900B unique code tokens 🚀
text
- The Stack v2 a 4x larger dataset than the Stack v1, resulting in 900B unique code tokens 🚀
new_line
As always, we released everything from models and datasets to curation code. Enjoy!
text
As always, we released everything from models and datasets to curation code. Enjoy!
new_line
new_line
🔗  StarCoder2 collection: 
text
🔗  StarCoder2 collection: 
https://huggingface.co/collections/bigcode/starcoder2-65de6da6e87db3383572be1a
bigcode/starcoder2-65de6da6e87db3383572be1a
collection
resource
https://huggingface.co/collections/bigcode/starcoder2-65de6da6e87db3383572be1a
text
new_line
🔗  Paper: 
text
🔗  Paper: 
https://drive.google.com/file/d/17iGn3c-sYNiLyRSY-A85QOzgzGnGiVI3/view
https://drive.google.com/file/d/17iGn3c-sYNiLyRSY-A85QOzgzGnGiVI3/view
link
text
new_line
🔗  BlogPost: 
text
🔗  BlogPost: 
https://huggingface.co/blog/starcoder2
https://huggingface.co/blog/starcoder2
link
new_line
🔗  Code Leaderboard: 
text
🔗  Code Leaderboard: 
https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard
bigcode/bigcode-models-leaderboard
space
resource
https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard
⭐ Today we’re releasing The Stack v2 & StarCoder2:  a series of 3B, 7B & 15B code generation models trained on 3.3 to 4.5 trillion tokens of code: 

- StarCoder2-15B matches or outperforms CodeLlama 34B, and approaches DeepSeek-33B on multiple benchmarks.
- StarCoder2-3B outperforms StarCoderBase-15B and similar sized models.
- The Stack v2 a 4x larger dataset than the Stack v1, resulting in 900B unique code tokens 🚀
As always, we released everything from models and datasets to curation code. Enjoy!

🔗  StarCoder2 collection: https://huggingface.co/collections/bigcode/starcoder2-65de6da6e87db3383572be1a 
🔗  Paper: https://drive.google.com/file/d/17iGn3c-sYNiLyRSY-A85QOzgzGnGiVI3/view 
🔗  BlogPost: https://huggingface.co/blog/starcoder2
🔗  Code Leaderboard: https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard
🤗
lvwerra DmitryRyumin thomwolf olivierdehaene smangrul osanseviero mcpotato alielfilali01 SivilTaram victor yuxiang630 BrigitteTousi VictorSanh harmdevries RaymondLi 3outeille Azamat1k vladbogo bofenghuang ncoop57 philschmid Avremi clem admarcosai macadeliccc mayank-mishra hysts kramp nouamanetazi danielhanchen goncharenko MoritzLaurer tbeck not-lain amyeroberts andrewrreed yxxsgdmn seyf1elislam omaryshchenko mishig
❤️
lvwerra thomwolf olivierdehaene smangrul osanseviero mcpotato alielfilali01 SivilTaram victor yuxiang630 BrigitteTousi VictorSanh harmdevries RaymondLi 3outeille ncoop57 philschmid clem admarcosai macadeliccc EdoAbati euclaise ajibawa-2023 mayank-mishra dalraf nouamanetazi tbeck not-lain amyeroberts andrewrreed samusenps seyf1elislam arjunguha mishig Ramikan-BR
🤯
lvwerra thomwolf olivierdehaene smangrul osanseviero SivilTaram victor yuxiang630 BrigitteTousi RaymondLi 3outeille hlarcher OmBenz philschmid Abderrazak clem admarcosai mayank-mishra not-lain mishig
🚀
mishig