UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist
While specialized AI models excel at isolated video tasks like generation or understanding, real-world applications demand complex, iterative workflows that combine these capabilities. To bridge this gap, we introduce UniVA, an open-source, omni-capable multi-agent framework for next-generation video generalists that unifies video understanding, segmentation, editing, and generation into cohesive workflows. UniVA employs a Plan-and-Act dual-agent architecture that drives a highly automated and proactive workflow: a planner agent interprets user intentions and decomposes them into structured video-processing steps, while executor agents execute these through modular, MCP-based tool servers (for analysis, generation, editing, tracking, etc.). Through a hierarchical multi-level memory (global knowledge, task context, and user-specific preferences), UniVA sustains long-horizon reasoning, contextual continuity, and inter-agent communication, enabling interactive and self-reflective video creation with full traceability. This design enables iterative and any-conditioned video workflows (e.g., text/image/video-conditioned generation rightarrow multi-round editing rightarrow object segmentation rightarrow compositional synthesis) that were previously cumbersome to achieve with single-purpose models or monolithic video-language models. We also introduce UniVA-Bench, a benchmark suite of multi-step video tasks spanning understanding, editing, segmentation, and generation, to rigorously evaluate such agentic video systems. Both UniVA and UniVA-Bench are fully open-sourced, aiming to catalyze research on interactive, agentic, and general-purpose video intelligence for the next generation of multimodal AI systems. (https://univa.online/)
691708afb63bfc66e04987ca
Zhengyang Liang
claimed_verified
2025-11-14T14:22:03.942Z
642d26c4c5f19fe0da07284a
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/xJwh9iTDJcHLxaRT0t8OV.png
Zhengyang Liang
chr1ce
user
chr1ce
691708afb63bfc66e04987cb
Daoan Zhang
691708afb63bfc66e04987cc
Huichi Zhou
691708afb63bfc66e04987cd
Rui Huang
claimed_verified
2025-11-17T10:31:07.597Z
6731caae58ba0f0984c188ea
/avatars/445275cca29f97c5f8754d6c27075887.svg
Rui Huang
Rui1121
user
Rui1121
691708afb63bfc66e04987ce
Bobo Li
691708afb63bfc66e04987cf
Yuechen Zhang
claimed_verified
2026-03-04T09:25:27.810Z
6418554a0956be7233a1023e
https://cdn-avatars.huggingface.co/v1/production/uploads/6418554a0956be7233a1023e/9EKN0GoOpcDbvBDmAQEJf.png
zhang yuechen
julianjuaner
user
julianjuaner
691708afb63bfc66e04987d0
Shengqiong Wu
691708afb63bfc66e04987d1
Xiaohan Wang
691708afb63bfc66e04987d2
Jiebo Luo
691708afb63bfc66e04987d3
Lizi Liao
691708afb63bfc66e04987d4
Hao Fei
claimed_verified
2025-11-14T14:22:06.106Z
647773a1168cb428e00e9a8f
https://cdn-avatars.huggingface.co/v1/production/uploads/647773a1168cb428e00e9a8f/NiRR3ScY6Plzjibfwy1hC.jpeg
Hao Fei
scofield7419
user
scofield7419
UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist
While specialized AI models excel at isolated video tasks like generation or understanding, real-world applications demand complex, iterative workflows that combine these capabilities. To bridge this gap, we introduce UniVA, an open-source, omni-capable multi-agent framework for next-generation video generalists that unifies video understanding, segmentation, editing, and generation into cohesive workflows. UniVA employs a Plan-and-Act dual-agent architecture that drives a highly automated and proactive workflow: a planner agent interprets user intentions and decomposes them into structured video-processing steps, while executor agents execute these through modular, MCP-based tool servers (for analysis, generation, editing, tracking, etc.). Through a hierarchical multi-level memory (global knowledge, task context, and user-specific preferences), UniVA sustains long-horizon reasoning, contextual continuity, and inter-agent communication, enabling interactive and self-reflective video creation with full traceability. This design enables iterative and any-conditioned video workflows (e.g., text/image/video-conditioned generation rightarrow multi-round editing rightarrow object segmentation rightarrow compositional synthesis) that were previously cumbersome to achieve with single-purpose models or monolithic video-language models. We also introduce UniVA-Bench, a benchmark suite of multi-step video tasks spanning understanding, editing, segmentation, and generation, to rigorously evaluate such agentic video systems. Both UniVA and UniVA-Bench are fully open-sourced, aiming to catalyze research on interactive, agentic, and general-purpose video intelligence for the next generation of multimodal AI systems. (https://univa.online/)
UniVA is an open-source multi-agent framework that integrates video understanding, segmentation, editing, and generation into cohesive workflows using a Plan-and-Act architecture and hierarchical memory.
UniVA multi-agent framework Plan-and-Act planner agent executor agents MCP-based tool servers hierarchical multi-level memory long-horizon reasoning contextual continuity inter-agent communication UniVA-Bench multi-step video tasks