Many VLMs claim to process hours of video. But can they follow the story?🤔
text
Many VLMs claim to process hours of video. But can they follow the story?🤔
new_line
Today, we introduce TimeScope: The benchmark that separates true temporal understanding from marketing hype. Let's see how much VLMs really understand!⏳
text
Today, we introduce TimeScope: The benchmark that separates true temporal understanding from marketing hype. Let's see how much VLMs really understand!⏳
new_line
new_line
We test three skills that matter for real-world use: 
text
We test three skills that matter for real-world use: 
new_line
🔎 Localized Retrieval: Find a specific action. 
text
🔎 Localized Retrieval: Find a specific action. 
new_line
🧩 Information Synthesis: Piece together scattered clues. 
text
🧩 Information Synthesis: Piece together scattered clues. 
new_line
🏃 Fine-Grained Perception: Analyze detailed motion (e.g., count how many times a person swings an axe). 
text
🏃 Fine-Grained Perception: Analyze detailed motion (e.g., count how many times a person swings an axe). 
new_line
new_line
The results are in, and they're revealing. Only Gemini 2.5 pro handles 1-hour-long videos.
text
The results are in, and they're revealing. Only Gemini 2.5 pro handles 1-hour-long videos.
new_line
Performance drops sharply with duration, proving that long video understanding is still challenging. We've found the breaking points—now the community can start fixing them.📈
text
Performance drops sharply with duration, proving that long video understanding is still challenging. We've found the breaking points—now the community can start fixing them.📈
new_line
new_line
Want to learn more? TimeScope is 100% open-source. Benchmark your model and help us build the next generation of video AI.
text
Want to learn more? TimeScope is 100% open-source. Benchmark your model and help us build the next generation of video AI.
new_line
new_line
📖 Blog: 
text
📖 Blog: 
new_line
https://huggingface.co/blog/timescope-video-lmm-benchmark
https://huggingface.co/blog/timescope-video-lmm-benchmark
link
new_line
👩‍💻 Leaderboard & Demo: 
text
👩‍💻 Leaderboard & Demo: 
https://huggingface.co/spaces/Apollo-LMMs/TimeScope
Apollo-LMMs/TimeScope
space
resource
https://huggingface.co/spaces/Apollo-LMMs/TimeScope
new_line
📊 Dataset: 
text
📊 Dataset: 
https://huggingface.co/datasets/Apollo-LMMs/TimeScope
Apollo-LMMs/TimeScope
dataset
resource
https://huggingface.co/datasets/Apollo-LMMs/TimeScope
new_line
⚙️ Eval Code: 
text
⚙️ Eval Code: 
https://github.com/EvolvingLMMs-Lab/lmms-eval
https://github.com/EvolvingLMMs-Lab/lmms-eval
link
Many VLMs claim to process hours of video. But can they follow the story?🤔
Today, we introduce TimeScope: The benchmark that separates true temporal understanding from marketing hype. Let's see how much VLMs really understand!⏳

We test three skills that matter for real-world use: 
🔎 Localized Retrieval: Find a specific action. 
🧩 Information Synthesis: Piece together scattered clues. 
🏃 Fine-Grained Perception: Analyze detailed motion (e.g., count how many times a person swings an axe). 

The results are in, and they're revealing. Only Gemini 2.5 pro handles 1-hour-long videos.
Performance drops sharply with duration, proving that long video understanding is still challenging. We've found the breaking points—now the community can start fixing them.📈

Want to learn more? TimeScope is 100% open-source. Benchmark your model and help us build the next generation of video AI.

📖 Blog: 
https://huggingface.co/blog/timescope-video-lmm-benchmark
👩‍💻 Leaderboard & Demo: https://huggingface.co/spaces/Apollo-LMMs/TimeScope
📊 Dataset: https://huggingface.co/datasets/Apollo-LMMs/TimeScope
⚙️ Eval Code: https://github.com/EvolvingLMMs-Lab/lmms-eval
🔥
lewtun Pent KhalilGuetari John6666 qhduan Austin362667 maghwa
❤️
maghwa Austin362667