The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔
text
The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔
new_line
new_line
A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!
text
A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!
new_line
new_line
In this blog post, we discuss:
text
In this blog post, we discuss:
new_line
🔢 The different ways numbers are tokenized in modern LLMs
text
🔢 The different ways numbers are tokenized in modern LLMs
new_line
🧪 Our detailed approach in comparing these various methods
text
🧪 Our detailed approach in comparing these various methods
new_line
🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
text
🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
new_line
👑 and a definitive, best tokenization method for math in LLMs!
text
👑 and a definitive, best tokenization method for math in LLMs!
new_line
new_line
Check out our work here: 
text
Check out our work here: 
https://huggingface.co/spaces/huggingface/number-tokenization-blog
huggingface/number-tokenization-blog
space
resource
https://huggingface.co/spaces/huggingface/number-tokenization-blog
The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔

A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!

In this blog post, we discuss:
🔢 The different ways numbers are tokenized in modern LLMs
🧪 Our detailed approach in comparing these various methods
🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
👑 and a definitive, best tokenization method for math in LLMs!

Check out our work here: https://huggingface.co/spaces/huggingface/number-tokenization-blog
🔥
thomwolf timmylai SamJoshua robbinhan victor linoyts
🧠
prithivMLmods John6666 Felladrin
❤️
thomwolf
6048ea0c0f59ab4b614f1836
https://cdn-avatars.huggingface.co/v1/production/uploads/6048ea0c0f59ab4b614f1836/8Eg8IyPtJgOHmywcJ7E8a.jpeg
RITABRATA MAITI
ritabratamaiti
user
630f3e4002ce39336c411048
https://cdn-avatars.huggingface.co/v1/production/uploads/630f3e4002ce39336c411048/Dbb855C55XdPd3rRH9auc.jpeg
alkinun
AtAndDev
user