 📢 For those who interested in adopting streaming with bare minimum dependencies and setting up a GenAI powered demo in Web, this post might be relevant. Streaming support is inevitable for running local or remote models.  Delighted to share the first part of the tutorial.
text
 📢 For those who interested in adopting streaming with bare minimum dependencies and setting up a GenAI powered demo in Web, this post might be relevant. Streaming support is inevitable for running local or remote models.  Delighted to share the first part of the tutorial.
new_line
new_line
🎬  
text
🎬  
https://youtu.be/XgByPLLsiCI
https://youtu.be/XgByPLLsiCI
link
new_line
new_line
From which you will learn how to:
text
From which you will learn how to:
new_line
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
text
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
new_line
☑️ Use pure JS with custom proxy streaming provider (FastAPI)
text
☑️ Use pure JS with custom proxy streaming provider (FastAPI)
new_line
new_line
✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers. 
text
✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers. 
new_line
Using FastAPI as a proxy, we explain how to take control over transferred data.
text
Using FastAPI as a proxy, we explain how to take control over transferred data.
new_line
new_line
Resources:
text
Resources:
new_line
💻  JS: 
text
💻  JS: 
https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
link
new_line
💻 JS+FastAPI: 
text
💻 JS+FastAPI: 
https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
link
new_line
 📢 For those who interested in adopting streaming with bare minimum dependencies and setting up a GenAI powered demo in Web, this post might be relevant. Streaming support is inevitable for running local or remote models.  Delighted to share the first part of the tutorial.

🎬  https://youtu.be/XgByPLLsiCI

From which you will learn how to:
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
☑️ Use pure JS with custom proxy streaming provider (FastAPI)

✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers. 
Using FastAPI as a proxy, we explain how to take control over transferred data.

Resources:
💻  JS: https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
💻 JS+FastAPI: https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59

👍
John6666
67b8e0d79107c46e941a3fc8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/kjcJuaIcvP-1x4Hmf6LMt.png
Karen Akers
karenny
user