🎥 🤾 Vid2Persona: talk to person from video clip
text
🎥 🤾 Vid2Persona: talk to person from video clip
new_line
new_line
A fun project over the last week with 
text
A fun project over the last week with 
@sayakpaul
mention
sayakpaul
. It has a simple pipeline from extracting traits of video characters to chatting with them.
text
. It has a simple pipeline from extracting traits of video characters to chatting with them.
new_line
new_line
Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!
text
Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!
new_line
new_line
Try it Hugging Face Space and let us know what you think.
text
Try it Hugging Face Space and let us know what you think.
new_line
: 
text
: 
https://huggingface.co/spaces/chansung/vid2persona
chansung/vid2persona
space
resource
https://huggingface.co/spaces/chansung/vid2persona
new_line
new_line
The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
text
The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
new_line
: 
text
: 
https://github.com/deep-diver/Vid2Persona
https://github.com/deep-diver/Vid2Persona
link
🎥 🤾 Vid2Persona: talk to person from video clip

A fun project over the last week with @sayakpaul. It has a simple pipeline from extracting traits of video characters to chatting with them.

Under the hood, this project leverages the power of both commercial and open source models. We used Google's Gemini 1.0 Pro Vision model to understand the video content directly, then we used HuggingFaceH4/zephyr-7b-beta model to make conversation!

Try it Hugging Face Space and let us know what you think.
: https://huggingface.co/spaces/chansung/vid2persona

The space application is a dedicated implementation for ZeroGPU environment + Hugging Face Inference API with PRO account. If you wish to host it on your own environment, consider duplicate the space or run locally with the project repository
: https://github.com/deep-diver/Vid2Persona
🤗
chansung anonyme789 Chan-Y victor osanseviero xprilion
🤯
anonyme789 Srulikbd osanseviero xprilion