We 
text
We 
https://mii-llm.ai
https://mii-llm.ai
link
 just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
text
 just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
new_line
new_line
Thanks to 
text
Thanks to 
@efederici
mention
efederici
 who released 
text
 who released 
https://huggingface.co/datasets/efederici/MMLU-Pro-ita
efederici/MMLU-Pro-ita
dataset
resource
https://huggingface.co/datasets/efederici/MMLU-Pro-ita
 a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
text
 a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
link
 the results on Italian open source LLMs. 
text
 the results on Italian open source LLMs. 
new_line
new_line
If you want to deepen read the blog article on hf 
text
If you want to deepen read the blog article on hf 
https://huggingface.co/blog/giux78/mmlu-pro-ita
https://huggingface.co/blog/giux78/mmlu-pro-ita
link
text
We https://mii-llm.ai just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA

Thanks to @efederici who released https://huggingface.co/datasets/efederici/MMLU-Pro-ita a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard the results on Italian open source LLMs. 

If you want to deepen read the blog article on hf https://huggingface.co/blog/giux78/mmlu-pro-ita 
🚀
giux78 Ramikan-BR osanseviero
❤️
Ramikan-BR anakin87
🔥
Ramikan-BR
👀
Ramikan-BR
😔
ZeroWw