Following up on 
text
Following up on 
@vikhyatk
mention
vikhyatk
's Moondream2 update and 
text
's Moondream2 update and 
@santiagomed
mention
santiagomed
's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using 
text
's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using 
https://github.com/huggingface/ratchet
https://github.com/huggingface/ratchet
link
 and run it even faster with WebGPU, 
text
 and run it even faster with WebGPU, 
@FL33TW00D-HF
mention
FL33TW00D-HF
.
text
.
new_line
new_line
https://huggingface.co/spaces/radames/Candle-Moondream-2
radames/Candle-Moondream-2
space
resource
https://huggingface.co/spaces/radames/Candle-Moondream-2
new_line
new_line
ps: I have a collection of all Candle WASM demos here 
text
ps: I have a collection of all Candle WASM demos here 
https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
radames/candle-wasm-examples-650898dee13ff96230ce3e1f
collection
resource
https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
Following up on @vikhyatk's Moondream2 update and @santiagomed's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using https://github.com/huggingface/ratchet and run it even faster with WebGPU, @FL33TW00D-HF.

https://huggingface.co/spaces/radames/Candle-Moondream-2

ps: I have a collection of all Candle WASM demos here https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
❤️
vikhyatk FL33TW00D-HF samusenps nikgr clem merve Felladrin osanseviero
🔥
vikhyatk FL33TW00D-HF clem merve kylen osanseviero