LongTail Driving Scenarios with Reasoning Traces: The KITScenes LongTail Dataset
In real-world domains such as self-driving, generalization to rare scenarios remains a fundamental challenge. To address this, we introduce a new dataset designed for end-to-end driving that focuses on long-tail driving events. We provide multi-view video data, trajectories, high-level instructions, and detailed reasoning traces, facilitating in-context learning and few-shot generalization. The resulting benchmark for multimodal models, such as VLMs and VLAs, goes beyond safety and comfort metrics by evaluating instruction following and semantic coherence between model outputs. The multilingual reasoning traces in English, Spanish, and Chinese are from domain experts with diverse cultural backgrounds. Thus, our dataset is a unique resource for studying how different forms of reasoning affect driving competence. Our dataset is available at: https://hf.co/datasets/kit-mrt/kitscenes-longtail
69c5969a2de2ee20094ed9e4
Royden Wagner
claimed_verified
2026-03-27T11:34:45.723Z
665b56460e92f92b0e78e36f
/avatars/4d9b5178a032b72e7a63ac77c45094c5.svg
Royden Wagner
roydenwa
user
roydenwa
69c5969a2de2ee20094ed9e5
Omer Sahin Tas
claimed_verified
2026-03-27T11:34:47.988Z
64e7a39f7acd8971f2ca1e28
https://cdn-avatars.huggingface.co/v1/production/uploads/64e7a39f7acd8971f2ca1e28/08E7EhG6pdmy7aHHZJThD.jpeg
Omer Sahin Tas
omersahintas
user
omersahintas
69c5969a2de2ee20094ed9e6
Jaime Villa
claimed_verified
2026-03-27T11:34:43.548Z
635eb4a6d1c91c2ee1eb0718
https://cdn-avatars.huggingface.co/v1/production/uploads/635eb4a6d1c91c2ee1eb0718/NJlebbRQ2AJZyjTi1UX4H.jpeg
Jaime Villa
jvpc0d3r
user
jvpc0d3r
69c5969a2de2ee20094ed9e7
Felix Hauser
claimed_verified
2026-03-27T11:34:41.168Z
66b395d0b33318f73abc308f
/avatars/08f31eebb832ac5d3e06a24a9d432d5e.svg
fh
fh12345
user
fh12345
69c5969a2de2ee20094ed9e8
Yinzhe Shen
69c5969a2de2ee20094ed9e9
Marlon Steiner
claimed_verified
2026-03-27T11:34:18.714Z
69c65436faed05be5d8b0ae6
/avatars/95c79f24fc234cb10ad149f816f57e30.svg
Marlon Steiner
marlon-steiner
user
marlon-steiner
69c5969a2de2ee20094ed9ea
Dominik Strutz
claimed_verified
2026-03-27T11:34:26.574Z
69402d778cdc5f83e2974f68
/avatars/025abd0d4dc256f90ff1cbf6f810bd8c.svg
Dominik
d-stru
user
d-stru
69c5969a2de2ee20094ed9eb
Carlos Fernandez
claimed_verified
2026-03-27T11:34:22.278Z
67efd1bdd652a85830fba699
/avatars/f23048d88a822df3d47fbe16c4045123.svg
Fernandez
c-fernandez
user
c-fernandez
69c5969a2de2ee20094ed9ec
Christian Kinzig
69c5969a2de2ee20094ed9ed
Guillermo S. Guitierrez-Cabello
69c5969a2de2ee20094ed9ee
Hendrik Königshof
69c5969a2de2ee20094ed9ef
Fabian Immel
claimed_verified
2026-03-27T11:34:31.818Z
67d308b6bf75e7929a799d40
/avatars/c3cfc3f5df71ee23dd0b41377c2eb457.svg
Fabian Immel
immel-f
user
immel-f
69c5969a2de2ee20094ed9f0
Richard Schwarzkopf
claimed_verified
2026-03-27T11:34:29.193Z
63722445e8891da06b2a2e6e
/avatars/8e1fddd6c012e58867332b972d6d783c.svg
Richard Fehler
R-Fehler
user
R-Fehler
69c5969a2de2ee20094ed9f1
Nils Alexander Rack
69c5969a2de2ee20094ed9f2
Kevin Rösch
claimed_verified
2026-03-27T11:34:33.814Z
635c21e5dc371b8f9105d985
/avatars/65b2117319ad3e55ba558cb247b15380.svg
Kevin Rösch
keroe
user
keroe
69c5969a2de2ee20094ed9f3
Kaiwen Wang
claimed_verified
2026-03-27T11:34:24.174Z
6797fb9f7162b6652e64b7e5
/avatars/5966e697354be18dc43240c9de9be05e.svg
Kaiwen Wang
kaiwen-wang
user
kaiwen-wang
69c5969a2de2ee20094ed9f4
Jan-Hendrik Pauls
claimed_verified
2026-03-27T11:34:36.010Z
68ecfef31aca3c633e13dcfa
/avatars/a0fdca5a33397e32427d97d823df1a13.svg
Jan-Hendrik Pauls
jhpauls
user
jhpauls
69c5969a2de2ee20094ed9f5
Martin Lauer
69c5969a2de2ee20094ed9f6
Igor Gilitschenski
claimed_verified
2026-03-27T11:34:38.505Z
64893f0b9ab28735f1a1ec0b
https://cdn-avatars.huggingface.co/v1/production/uploads/64893f0b9ab28735f1a1ec0b/2lPBjV16l2qLEWOKU2zwR.jpeg
Igor Gilitschenski
igilitschenski
user
igilitschenski
69c5969a2de2ee20094ed9f7
Holger Caesar
claimed_verified
2026-03-31T09:30:12.228Z
69ca7b13a347c653e8152436
/avatars/26a3a1e67a6c2c0013efdbf8e181884b.svg
Holger Caesar
nightrome
user
nightrome
69c5969a2de2ee20094ed9f8
Christoph Stiller
LongTail Driving Scenarios with Reasoning Traces: The KITScenes LongTail Dataset
In real-world domains such as self-driving, generalization to rare scenarios remains a fundamental challenge. To address this, we introduce a new dataset designed for end-to-end driving that focuses on long-tail driving events. We provide multi-view video data, trajectories, high-level instructions, and detailed reasoning traces, facilitating in-context learning and few-shot generalization. The resulting benchmark for multimodal models, such as VLMs and VLAs, goes beyond safety and comfort metrics by evaluating instruction following and semantic coherence between model outputs. The multilingual reasoning traces in English, Spanish, and Chinese are from domain experts with diverse cultural backgrounds. Thus, our dataset is a unique resource for studying how different forms of reasoning affect driving competence. Our dataset is available at: https://hf.co/datasets/kit-mrt/kitscenes-longtail
A new long-tail driving dataset with multi-view video, trajectories, and multilingual reasoning traces is introduced to improve few-shot generalization and evaluate multimodal models' instruction-following capabilities.
end-to-end driving long-tail driving events multimodal models VLMs VLAs in-context learning few-shot generalization instruction following semantic coherence multilingual reasoning traces