Running billion parameter models, sometimes we forget what it all is! 🤔💡
text
Running billion parameter models, sometimes we forget what it all is! 🤔💡
new_line
new_line
Matrix multiplication 🧮✨
text
Matrix multiplication 🧮✨
new_line
new_line
While there are multiple plays on memory management and caching to speed it up! 🏎️💾⚡
text
While there are multiple plays on memory management and caching to speed it up! 🏎️💾⚡
new_line
new_line
The naive way of Matrix multiplication becomes even more fascinating the bigger these models get! 🤯📈
text
The naive way of Matrix multiplication becomes even more fascinating the bigger these models get! 🤯📈
new_line
new_line
QKV for the win! 🏆🔑📚
text
QKV for the win! 🏆🔑📚
new_line
new_line
GitHub: 
text
GitHub: 
https://github.com/wentasah/mmul-anim
https://github.com/wentasah/mmul-anim
link
new_line
Slides: 
text
Slides: 
https://cw.fel.cvut.cz/wiki/_media/courses/b4m36esw/esw09_2019.pdf
https://cw.fel.cvut.cz/wiki/_media/courses/b4m36esw/esw09_2019.pdf
link
 📑🎓
text
 📑🎓
Running billion parameter models, sometimes we forget what it all is! 🤔💡

Matrix multiplication 🧮✨

While there are multiple plays on memory management and caching to speed it up! 🏎️💾⚡

The naive way of Matrix multiplication becomes even more fascinating the bigger these models get! 🤯📈

QKV for the win! 🏆🔑📚

GitHub: https://github.com/wentasah/mmul-anim
Slides: https://cw.fel.cvut.cz/wiki/_media/courses/b4m36esw/esw09_2019.pdf 📑🎓
😎
GPT007
662f7599987978b5a2a75b04
/avatars/9005535061d658c53fbb7167b2a9b51f.svg
Tennyson
Mandark424
user