🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 
text
🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 
new_line
new_line
Check it out!
text
Check it out!
new_line
https://huggingface.co/datasets/tsunghanwu/visual_haystacks
tsunghanwu/visual_haystacks
dataset
resource
https://huggingface.co/datasets/tsunghanwu/visual_haystacks
new_line
https://visual-haystacks.github.io/
https://visual-haystacks.github.io/
link
new_line
https://arxiv.org/abs/2407.13766
https://arxiv.org/abs/2407.13766
link
new_line
https://github.com/visual-haystacks/vhs_benchmark
https://github.com/visual-haystacks/vhs_benchmark
link
🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 

Check it out!
https://huggingface.co/datasets/tsunghanwu/visual_haystacks
https://visual-haystacks.github.io/
https://arxiv.org/abs/2407.13766
https://github.com/visual-haystacks/vhs_benchmark
🔥
osanseviero