Implemented a custom multimodal GRPO trainer that scales for Small VLMs, supports cpu and gpu with vllm + flash attention. Using SmolVLM-256M-Instruct reference & reward model, wasn’t trained for long btw, still got some sparks of “thinking”:)
text
Implemented a custom multimodal GRPO trainer that scales for Small VLMs, supports cpu and gpu with vllm + flash attention. Using SmolVLM-256M-Instruct reference & reward model, wasn’t trained for long btw, still got some sparks of “thinking”:)
new_line
Code: 
text
Code: 
https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
link
Implemented a custom multimodal GRPO trainer that scales for Small VLMs, supports cpu and gpu with vllm + flash attention. Using SmolVLM-256M-Instruct reference & reward model, wasn’t trained for long btw, still got some sparks of “thinking”:)
Code: https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
🔥
hanzla John6666 AtAndDev Chief-Inspector louisbrulenaudet Mdubbya rajuptvs kuma21 xinnn63 Takugen dantezxcd
👀
rajuptvs dantezxcd
64b16a747da6a1dca85604dc
https://cdn-avatars.huggingface.co/v1/production/uploads/64b16a747da6a1dca85604dc/0qkOUWMPZF4PNPCI0WYHy.jpeg
hanzlajavaid
hanzla
user