𝐍𝐞𝐰 𝐈𝐭𝐚𝐥𝐢𝐚𝐧 𝐒𝐦𝐚𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐌𝐨𝐝𝐞𝐥𝐬: 𝐆𝐞𝐦𝐦𝐚 𝐍𝐞𝐨𝐠𝐞𝐧𝐞𝐬𝐢𝐬 𝐜𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧 💎🌍🇮🇹
text
𝐍𝐞𝐰 𝐈𝐭𝐚𝐥𝐢𝐚𝐧 𝐒𝐦𝐚𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐌𝐨𝐝𝐞𝐥𝐬: 𝐆𝐞𝐦𝐦𝐚 𝐍𝐞𝐨𝐠𝐞𝐧𝐞𝐬𝐢𝐬 𝐜𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧 💎🌍🇮🇹
new_line
new_line
I am happy to release two new language models for the Italian Language!
text
I am happy to release two new language models for the Italian Language!
new_line
new_line
💪 Gemma 2 9B Neogenesis ITA
text
💪 Gemma 2 9B Neogenesis ITA
new_line
https://huggingface.co/anakin87/gemma-2-9b-neogenesis-ita
anakin87/gemma-2-9b-neogenesis-ita
model
resource
https://huggingface.co/anakin87/gemma-2-9b-neogenesis-ita
new_line
Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data.
text
Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data.
new_line
Using Spectrum, I trained 20% of model layers.
text
Using Spectrum, I trained 20% of model layers.
new_line
new_line
📊 Evaluated on the Open ITA LLM leaderboard (
text
📊 Evaluated on the Open ITA LLM leaderboard (
https://huggingface.co/spaces/mii-llm/open_ita_llm_leaderboard
mii-llm/open_ita_llm_leaderboard
space
resource
https://huggingface.co/spaces/mii-llm/open_ita_llm_leaderboard
), this model achieves strong performance.
text
), this model achieves strong performance.
new_line
To beat it on this benchmark, you'd need a 27B model 😎
text
To beat it on this benchmark, you'd need a 27B model 😎
new_line
new_line
new_line
🤏 Gemma 2 2B Neogenesis ITA
text
🤏 Gemma 2 2B Neogenesis ITA
new_line
https://huggingface.co/anakin87/gemma-2-2b-neogenesis-ita
anakin87/gemma-2-2b-neogenesis-ita
model
resource
https://huggingface.co/anakin87/gemma-2-2b-neogenesis-ita
new_line
This smaller variant is fine-tuned from the original Gemma 2 2B it by Google.
text
This smaller variant is fine-tuned from the original Gemma 2 2B it by Google.
new_line
Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum.
text
Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum.
new_line
new_line
📈 Compared to the original model, it shows improved Italian proficiency, good for its small size.
text
📈 Compared to the original model, it shows improved Italian proficiency, good for its small size.
new_line
new_line
new_line
Both models were developed during the recent #gemma competition on Kaggle.
text
Both models were developed during the recent #gemma competition on Kaggle.
new_line
📓 Training code: 
text
📓 Training code: 
https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond
https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond
link
new_line
new_line
new_line
🙏 Thanks 
text
🙏 Thanks 
@FinancialSupport
mention
FinancialSupport
 and mii-llm for the help during evaluation.
text
 and mii-llm for the help during evaluation.
𝐍𝐞𝐰 𝐈𝐭𝐚𝐥𝐢𝐚𝐧 𝐒𝐦𝐚𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐌𝐨𝐝𝐞𝐥𝐬: 𝐆𝐞𝐦𝐦𝐚 𝐍𝐞𝐨𝐠𝐞𝐧𝐞𝐬𝐢𝐬 𝐜𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧 💎🌍🇮🇹

I am happy to release two new language models for the Italian Language!

💪 Gemma 2 9B Neogenesis ITA
https://huggingface.co/anakin87/gemma-2-9b-neogenesis-ita
Building on the impressive work by VAGO Solutions, I applied Direct Preference Optimization with a mix of Italian and English data.
Using Spectrum, I trained 20% of model layers.

📊 Evaluated on the Open ITA LLM leaderboard (https://huggingface.co/spaces/mii-llm/open_ita_llm_leaderboard), this model achieves strong performance.
To beat it on this benchmark, you'd need a 27B model 😎


🤏 Gemma 2 2B Neogenesis ITA
https://huggingface.co/anakin87/gemma-2-2b-neogenesis-ita
This smaller variant is fine-tuned from the original Gemma 2 2B it by Google.
Through a combination of Supervised Fine-Tuning and Direct Preference Optimization, I trained 25% of the layers using Spectrum.

📈 Compared to the original model, it shows improved Italian proficiency, good for its small size.


Both models were developed during the recent #gemma competition on Kaggle.
📓 Training code: https://www.kaggle.com/code/anakin87/post-training-gemma-for-italian-and-beyond


🙏 Thanks @FinancialSupport and mii-llm for the help during evaluation.
👍
JingzeShi John6666 FinancialSupport puettmann
673ab3647afcea17eb4378fd
https://cdn-avatars.huggingface.co/v1/production/uploads/673ab3647afcea17eb4378fd/YQB6zSH1LPxBMUYayIURi.png
Loser Cheems
JingzeShi
user
6758a9850e3fff481964ca6d
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/EolfJfjW25hC4Bt_hCPq8.png
Jean Louis
JLouisBiz
user
626505d493e0b04d75710566
https://cdn-avatars.huggingface.co/v1/production/uploads/626505d493e0b04d75710566/9rfJc9ORXU9J5a42Ev3v6.png
Stefano Fiorucci
anakin87
user