CAMAv2: A Vision-Centric Approach for Static Map Element Annotation
- URL: http://arxiv.org/abs/2407.21331v1
- Date: Wed, 31 Jul 2024 04:41:49 GMT
- Title: CAMAv2: A Vision-Centric Approach for Static Map Element Annotation
- Abstract summary: We present CAMAv2, a vision-centric approach for Consistent and Accurate Map.
We apply our proposed framework to the popular nuScenes dataset to provide efficient and highly accurate annotations.
Compared with the original nuScenes static map element, our CAMAv2 annotations achieve lower reprojection errors.
- Score: 15.764785952277931
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The recent development of online static map element (a.k.a. HD map) construction algorithms has raised a vast demand for data with ground truth annotations. However, available public datasets currently cannot provide high-quality training data regarding consistency and accuracy. For instance, the manual labelled (low efficiency) nuScenes still contains misalignment and inconsistency between the HD maps and images (e.g., around 8.03 pixels reprojection error on average). To this end, we present CAMAv2: a vision-centric approach for Consistent and Accurate Map Annotation. Without LiDAR inputs, our proposed framework can still generate high-quality 3D annotations of static map elements. Specifically, the annotation can achieve high reprojection accuracy across all surrounding cameras and is spatial-temporal consistent across the whole sequence. We apply our proposed framework to the popular nuScenes dataset to provide efficient and highly accurate annotations. Compared with the original nuScenes static map element, our CAMAv2 annotations achieve lower reprojection errors (e.g., 4.96 vs. 8.03 pixels). Models trained with annotations from CAMAv2 also achieve lower reprojection errors (e.g., 5.62 vs. 8.43 pixels).
Related papers
- Interacted Planes Reveal 3D Line Mapping [73.60851338875962]
LiP-Map is a line-plane joint optimization framework for 3D line mapping.<n>On more than 100 scenes from ScanNetV2, ScanNet++, Hypersim, 7Scenes, and Tanks&Temple, LiP-Map improves both accuracy and completeness over state-of-the-art methods.
arXiv Detail & Related papers (2026-02-01T15:52:55Z) - MapRF: Weakly Supervised Online HD Map Construction via NeRF-Guided Self-Training [6.6099504578472414]
MapRF is a weakly supervised framework that learns to construct 3D maps using only 2D image labels.<n>To mitigate error accumulation during self-training, we propose a Map-to-Ray Matching strategy.
arXiv Detail & Related papers (2025-11-24T07:23:10Z) - Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mapping [9.016750201407897]
HD mapping approaches outsource the projection to standard mapping techniques, such as attention-based ones.<n>Our key idea is to start with a geometric mapping based on camera parameters and adapt it to the scene to extract relevant map information.<n> Experiments on new splits of the nuScenes and Argoverse2 datasets demonstrate improved performance over state-of-the-art approaches.
arXiv Detail & Related papers (2025-08-29T14:55:33Z) - Zero-shot Inexact CAD Model Alignment from a Single Image [53.37898107159792]
A practical approach to infer 3D scene structure from a single image is to retrieve a closely matching 3D model from a database and align it with the object in the image.<n>Existing methods rely on supervised training with images and pose annotations, which limits them to a narrow set of object categories.<n>We propose a weakly supervised 9-DoF alignment method for inexact 3D models that requires no pose annotations and generalizes to unseen categories.
arXiv Detail & Related papers (2025-07-04T04:46:59Z) - Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation [14.480713752871521]
MapUnveiler is a novel paradigm of clip-level vectorized HD map construction.
It unveils the occluded map elements within a clip input by relating dense image representations with efficient clip tokens.
MapUnveiler associates inter-clip information through clip token propagation, effectively utilizing long-term temporal map information.
arXiv Detail & Related papers (2024-11-17T08:38:18Z) - GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction [20.1127163541618]
We have designed a universal map generation framework, GenMapping.
The framework is established with a triadic synergy architecture, including principal and dual auxiliary branches.
A thorough array of experimental results shows that the proposed model surpasses current state-of-the-art methods in both semantic mapping and vectorized mapping, while also maintaining a rapid inference speed.
arXiv Detail & Related papers (2024-09-13T10:15:28Z) - 3D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation [33.92758288570465]
Building accurate maps is a key building block to enable reliable localization, planning, and navigation of autonomous vehicles.
We propose encoding the 4D scene into a novel implicit neural map representation.
Our method is capable of removing the dynamic part of the input point clouds while reconstructing accurate and complete 3D maps.
arXiv Detail & Related papers (2024-05-06T11:46:04Z) - Are Dense Labels Always Necessary for 3D Object Detection from Point
Cloud? [72.40353149833109]
Current state-of-the-art (SOTA) 3D object detection methods often require a large amount of 3D bounding box annotations for training.
We propose a novel sparsely-annotated framework, in which we just annotate one 3D object per scene.
We develop the SS3D++ method that alternatively improves 3D detector training and confident fully-annotated scene generation.
arXiv Detail & Related papers (2024-03-05T09:38:11Z) - PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environments [50.79058028754952]
PACE (Pose s in Cluttered Environments) is a large-scale benchmark for pose estimation methods in cluttered scenarios.
The benchmark consists of 55K frames with 258K annotations across 300 videos, covering 238 objects from 43 categories.
PACE-Sim contains 100K photo-realistic simulated frames with 2.4M annotations across 931 objects.
arXiv Detail & Related papers (2023-12-23T01:38:41Z) - A Vision-Centric Approach for Static Map Element Annotation [9.905900964784564]
We present CAMA: a vision-centric approach for Consistent Map and Accurate.
Without LiDAR inputs, our proposed framework can still generate high-quality 3D annotations of static map elements.
We apply our proposed framework to the popular nuScenes dataset to provide efficient and highly accurate annotations.
arXiv Detail & Related papers (2023-09-21T03:30:00Z) - Neural Semantic Surface Maps [52.61017226479506]
We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another.
Our approach can generate semantic surface-to-surface maps, eliminating manual annotations or any 3D training data requirement.
arXiv Detail & Related papers (2023-09-09T16:21:56Z) - Weakly Supervised 3D Object Detection with Multi-Stage Generalization [62.96670547848691]
We introduce BA$2$-Det, encompassing pseudo label generation and multi-stage generalization.
We develop three stages of generalization: progressing from complete to partial, static to dynamic, and close to distant.
BA$2$-Det can achieve a 20% relative improvement on the KITTI dataset.
arXiv Detail & Related papers (2023-06-08T17:58:57Z) - NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera
Localization [60.73541222862195]
NeuMap is an end-to-end neural mapping method for camera localization.
It encodes a whole scene into a grid of latent codes, with which a Transformer-based auto-decoder regresses 3D coordinates of query pixels.
arXiv Detail & Related papers (2022-11-21T04:46:22Z) - Rethinking Localization Map: Towards Accurate Object Perception with
Self-Enhancement Maps [78.2581910688094]
This work introduces a novel self-enhancement method to harvest accurate object localization maps and object boundaries with only category labels as supervision.
In particular, the proposed Self-Enhancement Maps achieve the state-of-the-art localization accuracy of 54.88% on ILSVRC.
arXiv Detail & Related papers (2020-06-09T12:35:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.