The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

• URL: http://arxiv.org/abs/2606.02956v1
• Date: Mon, 01 Jun 2026 23:23:14 GMT
• Title: The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset
• Abstract summary: KITScenes Multimodal is a European dataset built around high-fidelity sensors and maps.<n>Our HD maps are the most complete of any sensor dataset validated through autonomous driving trials on open-source software.<n>For the first time in a public dataset, all driving-relevant traffic elements, such as traffic lights, are mapped in 3D to a reprojection-accurate level.
• Score: 40.9969354835513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity. We present KITScenes Multimodal, a European dataset built around high-fidelity sensors and maps. Our fully synchronized sensor suite combines high-resolution global-shutter cameras, long-range lidar beyond 400m, 4D imaging radar, and redundant GNSS/INS localization. Our HD maps are, to our knowledge, the most complete of any sensor dataset, validated through autonomous driving trials on open-source software. For the first time in a public dataset, all driving-relevant traffic elements, such as traffic lights, are mapped in 3D to a reprojection-accurate level with full topological connectivity. Recorded in cities with irregular street layouts and mixed traffic modes, our dataset complements existing datasets by broadening the available geographic diversity. We also introduce four benchmarks, each advancing spatial learning for embodied AI: online HD map construction, long-range depth estimation, novel view synthesis, and end-to-end driving. Project page: https://kitscenes.com/

Related papers

• 123D: Unifying Multi-Modal Autonomous Driving Data at Scale [58.4010470217018]
  We present 123D, an open-source framework that unifies such multi-modal driving data through a single API.<n>We consolidate eight real-world driving datasets spanning 3,300 hours and 90,000 kilometers, together with a synthetic dataset with collection scripts, and provide tools for data analysis and visualization.
  arXiv  Detail & Related papers  (2026-05-08T17:59:53Z)
• Spatial Retrieval Augmented Autonomous Driving [81.39665750557526]
  Existing autonomous driving systems rely on onboard sensors for environmental perception.<n>We propose the spatial retrieval paradigm, introducing offline retrieved geographic images as an additional input.<n>We will open-source dataset curation code, data, and benchmarks for further study of this new autonomous driving paradigm.
  arXiv  Detail & Related papers  (2025-12-07T14:40:49Z)
• Highly Accurate and Diverse Traffic Data: The DeepScenario Open 3D Dataset [30.40504152724041]
  We introduce the DeepScenario Open 3D dataset (DSC3D) of 6 degrees of freedom bounding box trajectories acquired through a novel monocular camera drone tracking pipeline.<n>Our dataset includes more than 175,000 trajectories of 14 types of traffic participants and significantly exceeds existing datasets in terms of diversity and scale.<n>We demonstrate its utility across multiple applications including motion prediction, motion planning, scenario mining, and generative reactive traffic agents.
  arXiv  Detail & Related papers  (2025-04-24T08:43:48Z)
• OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Driving [6.426389871517664]
  High-quality datasets are crucial for the development of effective data-driven autonomous driving solutions.<n>We present OmniHD-Scenes, a large-scale multimodal dataset that provides comprehensive omnidirectional high-definition data.<n>The dataset comprises 1501 clips, each approximately 30-s long, totaling more than 450K synchronized frames and more than 5.85 million synchronized sensor data points.
  arXiv  Detail & Related papers  (2024-12-14T08:08:40Z)
• V2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perception [61.58737390490639]
  We present V2X-Radar, the first large-scale, real-world multi-modal dataset featuring 4D Radar.<n>The dataset consists of 20K LiDAR frames, 40K camera images, and 20K 4D Radar data, including 350K annotated boxes.<n>To support various research domains, we have established V2X-Radar-C for cooperative perception, V2X-Radar-I for roadside perception, and V2X-Radar-V for single-vehicle perception.
  arXiv  Detail & Related papers  (2024-11-17T04:59:00Z)
• RoboSense: Large-scale Dataset and Benchmark for Egocentric Robot Perception and Navigation in Crowded and Unstructured Environments [62.5830455357187]
  We setup an egocentric multi-sensor data collection platform based on 3 main types of sensors (Camera, LiDAR and Fisheye)<n>A large-scale multimodal dataset is constructed, named RoboSense, to facilitate egocentric robot perception.
  arXiv  Detail & Related papers  (2024-08-28T03:17:40Z)
• HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative [23.293162454592544]
  We constructed holographic intersections with various layouts to build a large-scale multi-sensor holographic vehicle-infrastructure cooperation dataset, called HoloVIC. Our dataset includes 3 different types of sensors (Camera, Lidar, Fisheye) and employs 4 sensor-s based on the different intersections.
  arXiv  Detail & Related papers  (2024-03-05T04:08:19Z)
• Zenseact Open Dataset: A large-scale and diverse multimodal dataset for autonomous driving [3.549770828382121]
  Zenseact Open dataset (ZOD) is a large-scale and diverse dataset collected over two years in various European countries. ZOD boasts the highest range and resolution sensors among comparable datasets. The dataset is composed of Frames, Sequences, and Drives, designed to encompass both data diversity and support for multimodal-temporal learning.
  arXiv  Detail & Related papers  (2023-05-03T09:59:18Z)
• SUPS: A Simulated Underground Parking Scenario Dataset for Autonomous Driving [41.221988979184665]
  SUPS is a simulated dataset for underground automatic parking. It supports multiple tasks with multiple sensors and multiple semantic labels aligned with successive images. We also evaluate the state-of-the-art SLAM algorithms and perception models on our dataset.
  arXiv  Detail & Related papers  (2023-02-25T02:59:12Z)
• Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting [64.7364925689825]
  Argoverse 2 (AV2) is a collection of three datasets for perception and forecasting research in the self-driving domain. The Lidar dataset contains 20,000 sequences of unlabeled lidar point clouds and map-aligned pose. The Motion Forecasting dataset contains 250,000 scenarios mined for interesting and challenging interactions between the autonomous vehicle and other actors in each local scene.
  arXiv  Detail & Related papers  (2023-01-02T00:36:22Z)
• IDD-3D: Indian Driving Dataset for 3D Unstructured Road Scenes [79.18349050238413]
  Preparation and training of deploy-able deep learning architectures require the models to be suited to different traffic scenarios. An unstructured and complex driving layout found in several developing countries such as India poses a challenge to these models. We build a new dataset, IDD-3D, which consists of multi-modal data from multiple cameras and LiDAR sensors with 12k annotated driving LiDAR frames.
  arXiv  Detail & Related papers  (2022-10-23T23:03:17Z)
• 4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving [43.09957836757648]
  We present a novel dataset covering seasonal and challenging perceptual conditions for autonomous driving.<n>Among others, it enables research on visual odometry, global place recognition, and map-based re-localization tracking.
  arXiv  Detail & Related papers  (2020-09-14T12:31:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.