Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars

• URL: http://arxiv.org/abs/2012.12437v2
• Date: Wed, 1 May 2024 02:07:29 GMT
• Title: Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars
• Abstract summary: Pit30M is a new image and LiDAR dataset with over 30 million frames, which is 10 to 100 times larger than those used in previous work. Pit30M is captured under diverse conditions (i.e., season, weather, time of the day, traffic), and provides accurate localization ground truth. We benchmark multiple existing methods for image and LiDAR retrieval and, in the process, introduce a simple, yet effective convolutional network-based LiDAR retrieval method.
• Score: 39.94419250485135
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We are interested in understanding whether retrieval-based localization approaches are good enough in the context of self-driving vehicles. Towards this goal, we introduce Pit30M, a new image and LiDAR dataset with over 30 million frames, which is 10 to 100 times larger than those used in previous work. Pit30M is captured under diverse conditions (i.e., season, weather, time of the day, traffic), and provides accurate localization ground truth. We also automatically annotate our dataset with historical weather and astronomical data, as well as with image and LiDAR semantic segmentation as a proxy measure for occlusion. We benchmark multiple existing methods for image and LiDAR retrieval and, in the process, introduce a simple, yet effective convolutional network-based LiDAR retrieval method that is competitive with the state of the art. Our work provides, for the first time, a benchmark for sub-metre retrieval-based localization at city scale. The dataset, its Python SDK, as well as more information about the sensors, calibration, and metadata, are available on the project website: https://pit30m.github.io/

Related papers

• LoMa: Local Feature Matching Revisited [56.73318466794448]
  Local feature matching has long been a fundamental component of 3D vision systems such as Structure-from-Motion (SfM)<n>In this paper, we revisit local feature matching from a data-driven perspective.<n>We combine large and diverse data mixtures, modern training recipes, scaled model capacity, and scaled compute, resulting in remarkable gains in performance.
  arXiv  Detail & Related papers  (2026-04-06T17:59:49Z)
• A Multi-Year Urban Streetlight Imagery Dataset for Visual Monitoring and Spatio-Temporal Drift Detection [3.1073458974207124]
  We present a large-scale, longitudinal visual dataset of urban streetlights captured by 22 fixed-angle cameras deployed across Bristol, U.K., from 2021 to 2025.<n>The dataset contains over 526,000 images, collected hourly under diverse lighting, weather, and seasonal conditions.<n>This real-world dataset enables detailed investigation of visual drift, anomaly detection, and MLOps strategies in smart city deployments.
  arXiv  Detail & Related papers  (2025-12-13T06:28:54Z)
• Spatial Retrieval Augmented Autonomous Driving [81.39665750557526]
  Existing autonomous driving systems rely on onboard sensors for environmental perception.<n>We propose the spatial retrieval paradigm, introducing offline retrieved geographic images as an additional input.<n>We will open-source dataset curation code, data, and benchmarks for further study of this new autonomous driving paradigm.
  arXiv  Detail & Related papers  (2025-12-07T14:40:49Z)
• From Street to Orbit: Training-Free Cross-View Retrieval via Location Semantics and LLM Guidance [10.533095161205358]
  Cross-view image retrieval is critical for applications such as autonomous navigation, urban planning, and localization in GPS-denied environments.<n>We present a simple yet effective cross-view image retrieval framework that leverages a pretrained vision encoder and a large language model (LLM)<n>Despite using no ground-truth supervision or finetuning, our proposed method outperforms prior learning-based approaches on the benchmark dataset under zero-shot settings.
  arXiv  Detail & Related papers  (2025-11-12T23:51:46Z)
• UnLoc: A Universal Localization Method for Autonomous Vehicles using LiDAR, Radar and/or Camera Input [51.150605800173366]
  UnLoc is a novel unified neural modeling approach for localization with multi-sensor input in all weather conditions. Our method is extensively evaluated on Oxford Radar RobotCar, ApolloSouthBay and Perth-WA datasets.
  arXiv  Detail & Related papers  (2023-07-03T04:10:55Z)
• SUPS: A Simulated Underground Parking Scenario Dataset for Autonomous Driving [41.221988979184665]
  SUPS is a simulated dataset for underground automatic parking. It supports multiple tasks with multiple sensors and multiple semantic labels aligned with successive images. We also evaluate the state-of-the-art SLAM algorithms and perception models on our dataset.
  arXiv  Detail & Related papers  (2023-02-25T02:59:12Z)
• 4Seasons: Benchmarking Visual SLAM and Long-Term Localization for Autonomous Driving in Challenging Conditions [54.59279160621111]
  We present a novel visual SLAM and long-term localization benchmark for autonomous driving in challenging conditions based on the large-scale 4Seasons dataset. The proposed benchmark provides drastic appearance variations caused by seasonal changes and diverse weather and illumination conditions. We introduce a new unified benchmark for jointly evaluating visual odometry, global place recognition, and map-based visual localization performance.
  arXiv  Detail & Related papers  (2022-12-31T13:52:36Z)
• ALTO: A Large-Scale Dataset for UAV Visual Place Recognition and Localization [22.992887167994766]
  The ALTO dataset is a vision-focused dataset for the development and benchmarking of Visual Place Recognition methods for Unmanned Aerial Vehicles. The dataset is composed of two long (approximately 150km and 260km) trajectories flown by a helicopter over Ohio and Pennsylvania.
  arXiv  Detail & Related papers  (2022-07-19T21:13:44Z)
• CroCo: Cross-Modal Contrastive learning for localization of Earth Observation data [62.96337162094726]
  It is of interest to localize a ground-based LiDAR point cloud on remote sensing imagery. We propose a contrastive learning-based method that trains on DEM and high-resolution optical imagery. In the best scenario, the Top-1 score of 0.71 and Top-5 score of 0.81 are obtained.
  arXiv  Detail & Related papers  (2022-04-14T15:55:00Z)
• SODA10M: Towards Large-Scale Object Detection Benchmark for Autonomous Driving [94.11868795445798]
  We release a Large-Scale Object Detection benchmark for Autonomous driving, named as SODA10M, containing 10 million unlabeled images and 20K images labeled with 6 representative object categories. To improve diversity, the images are collected every ten seconds per frame within 32 different cities under different weather conditions, periods and location scenes. We provide extensive experiments and deep analyses of existing supervised state-of-the-art detection models, popular self-supervised and semi-supervised approaches, and some insights about how to develop future models.
  arXiv  Detail & Related papers  (2021-06-21T13:55:57Z)
• One Million Scenes for Autonomous Driving: ONCE Dataset [91.94189514073354]
  We introduce the ONCE dataset for 3D object detection in the autonomous driving scenario. The data is selected from 144 driving hours, which is 20x longer than the largest 3D autonomous driving dataset available. We reproduce and evaluate a variety of self-supervised and semi-supervised methods on the ONCE dataset.
  arXiv  Detail & Related papers  (2021-06-21T12:28:08Z)
• Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Driving [11.576868193291997]
  We propose a new benchmark dataset, named textitTopo-boundary, for off-line topological road-boundary detection. The dataset contains 21,556 $1000times1000$-sized 4-channel aerial images. We implement and evaluate 3 segmentation-based baselines and 5 graph-based baselines using the dataset.
  arXiv  Detail & Related papers  (2021-03-31T14:42:00Z)
• Road Network Metric Learning for Estimated Time of Arrival [93.0759529610483]
  In this paper, we propose the Road Network Metric Learning framework for Estimated Time of Arrival (ETA) It consists of two components: (1) a main regression task to predict the travel time, and (2) an auxiliary metric learning task to improve the quality of link embedding vectors. We show that our method outperforms the state-of-the-art model and the promotion concentrates on the cold links with few data.
  arXiv  Detail & Related papers  (2020-06-24T04:45:14Z)
• LiDAR guided Small obstacle Segmentation [14.880698940693609]
  Small obstacles on the road are critical for autonomous driving. We present a method to reliably detect such obstacles through a multi-modal framework of sparse LiDAR and Monocular vision. We show significant performance gains when the context is fed as an additional input to monocular semantic segmentation frameworks.
  arXiv  Detail & Related papers  (2020-03-12T18:34:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.