3D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representation

• URL: http://arxiv.org/abs/2011.01535v2
• Date: Wed, 4 Nov 2020 12:25:04 GMT
• Title: 3D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representation
• Abstract summary: 3D-LaneNet+ is a camera-based method for anchor free 3D lane detection. We follow recently proposed 3D-LaneNet, and extend it to enable the detection of previously unsupported lane topologies. We demonstrate the efficacy of 3D-LaneNet+ using both synthetic and real world data.
• Score: 6.296104145657063
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: 3D-LaneNet+ is a camera-based DNN method for anchor free 3D lane detection which is able to detect 3d lanes of any arbitrary topology such as splits, merges, as well as short and perpendicular lanes. We follow recently proposed 3D-LaneNet, and extend it to enable the detection of these previously unsupported lane topologies. Our output representation is an anchor free, semi-local tile representation that breaks down lanes into simple lane segments whose parameters can be learnt. In addition we learn, per lane instance, feature embedding that reasons for the global connectivity of locally detected segments to form full 3d lanes. This combination allows 3D-LaneNet+ to avoid using lane anchors, non-maximum suppression, and lane model fitting as in the original 3D-LaneNet. We demonstrate the efficacy of 3D-LaneNet+ using both synthetic and real world data. Results show significant improvement relative to the original 3D-LaneNet that can be attributed to better generalization to complex lane topologies, curvatures and surface geometries.

Related papers

• Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputs [62.865932175477035]
  Metric 3D object detection is a core capability for embodied agents, yet most reliable systems lean on depth sensors.<n>We propose Map-Det3D, an online multi-view 3D object detection model that brings detection directly into a 3D space reconstructed from RGB.
  arXiv  Detail & Related papers  (2026-08-12T15:33:42Z)
• ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection [2.4833995747694355]
  Road-Manifold Assumption: the road is a smooth 2D manifold in $mathbbR3$, lanes are embedded 1D submanifolds, and sampled lane points are dense observations.<n>Building on this, we propose ReManNet, which first produces initial lane predictions with an image backbone and detection heads.<n>We also propose the 3D Tunnel Lane IoU (3D-TLIoU) loss, a joint point-curve objective that computes slice-wise overlap of tubular neighborhoods along each lane.
  arXiv  Detail & Related papers  (2026-03-20T09:10:23Z)
• EmbodiedSplat: Online Feed-Forward Semantic 3DGS for Open-Vocabulary 3D Scene Understanding [66.80528512321106]
  EmbodiedSplat is an online feed-forward 3DGS for open-vocabulary scene understanding.<n>Our objectives are 1) Reconstructs the semantic-embedded 3DGS of the entire scene from over 300 streaming images in an online manner, and 2) Highly generalizable to novel scenes with feed-forward design.
  arXiv  Detail & Related papers  (2026-03-04T16:40:41Z)
• Cues3D: Unleashing the Power of Sole NeRF for Consistent and Unique Instances in Open-Vocabulary 3D Panoptic Segmentation [48.231573110948]
  Open-vocabulary 3D panoptic segmentation has recently emerged as a significant trend. We present Cues3D, a compact approach that relies solely on Neural Radiance Field (NeRF) instead of pre-associations. Our experiments are conducted on ScanNet v2, ScanNet200, ScanNet++, and Replica datasets for 3D instance, panoptic, and semantic segmentation tasks.
  arXiv  Detail & Related papers  (2025-05-01T08:12:03Z)
• Geometry-aware Temporal Aggregation Network for Monocular 3D Lane Detection [62.27919334393825]
  We propose a novel Geometry-aware Temporal Aggregation Network (GTA-Net) for monocular 3D lane detection. On one hand, we develop the Temporal Geometry Enhancement Module (TGEM), which exploits geometric consistency across successive frames. On the other hand, we present the Temporal Instance-aware Query Generation (TIQG), which strategically incorporates temporal cues into query generation.
  arXiv  Detail & Related papers  (2025-04-29T08:10:17Z)
• Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priors [40.92232275558338]
  3D lane detection and topology reasoning are essential tasks in autonomous driving scenarios. We propose Topo2D, a novel framework based on Transformer, leveraging 2D lane instances to initialize 3D queries and 3D positional embeddings. Topo2D achieves 44.5% OLS on multi-view topology reasoning benchmark OpenLane-V2 and 62.6% F-Socre on single-view 3D lane detection benchmark OpenLane.
  arXiv  Detail & Related papers  (2024-06-05T09:48:56Z)
• 3D Lane Detection from Front or Surround-View using Joint-Modeling & Matching [27.588395086563978]
  We propose a joint modeling approach that combines Bezier curves and methods. We also introduce a novel 3D Spatial, representing an exploration of 3D surround-view lane detection research. This innovative method establishes a new benchmark in front-view 3D lane detection on the Openlane dataset.
  arXiv  Detail & Related papers  (2024-01-16T01:12:24Z)
• Decoupling the Curve Modeling and Pavement Regression for Lane Detection [67.22629246312283]
  curve-based lane representation is a popular approach in many lane detection methods. We propose a new approach to the lane detection task by decomposing it into two parts: curve modeling and ground height regression.
  arXiv  Detail & Related papers  (2023-09-19T11:24:14Z)
• WS-3D-Lane: Weakly Supervised 3D Lane Detection With 2D Lane Labels [3.717577432863157]
  We propose a novel method for training 3D lanes with only 2D lane labels, called weakly supervised 3D lane detection WS-3D-Lane. Under weakly supervised setting, our WS-3D-Lane outperforms previous 3D-LaneNet: F-score rises to 92.3% on Apollo 3D synthetic dataset, and F1 rises to 74.5% on ONCE-3DLanes.
  arXiv  Detail & Related papers  (2022-09-23T11:07:08Z)
• ONCE-3DLanes: Building Monocular 3D Lane Detection [41.46466150783367]
  We present ONCE-3DLanes, a real-world autonomous driving dataset with lane layout annotation in 3D space. By exploiting the explicit relationship between point clouds and image pixels, a dataset annotation pipeline is designed to automatically generate high-quality 3D lane locations.
  arXiv  Detail & Related papers  (2022-04-30T16:35:25Z)
• PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark [109.03773439461615]
  PersFormer is an end-to-end monocular 3D lane detector with a novel Transformer-based spatial feature transformation module. We release one of the first large-scale real-world 3D lane datasets, called OpenLane, with high-quality annotation and scenario diversity.
  arXiv  Detail & Related papers  (2022-03-21T16:12:53Z)
• From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection [101.20784125067559]
  We propose a new architecture, namely Hallucinated Hollow-3D R-CNN, to address the problem of 3D object detection. In our approach, we first extract the multi-view features by sequentially projecting the point clouds into the perspective view and the bird-eye view. The 3D objects are detected via a box refinement module with a novel Hierarchical Voxel RoI Pooling operation.
  arXiv  Detail & Related papers  (2021-07-30T02:00:06Z)
• DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization [56.15308829924527]
  We propose a Siamese network that jointly learns 3D local feature detection and description directly from raw 3D points. For detecting 3D keypoints we predict the discriminativeness of the local descriptors in an unsupervised manner. Experiments on various benchmarks demonstrate that our method achieves competitive results for both global point cloud retrieval and local point cloud registration.
  arXiv  Detail & Related papers  (2020-07-17T20:21:22Z)
• End-to-End Pseudo-LiDAR for Image-Based 3D Object Detection [62.34374949726333]
  Pseudo-LiDAR (PL) has led to a drastic reduction in the accuracy gap between methods based on LiDAR sensors and those based on cheap stereo cameras. PL combines state-of-the-art deep neural networks for 3D depth estimation with those for 3D object detection by converting 2D depth map outputs to 3D point cloud inputs. We introduce a new framework based on differentiable Change of Representation (CoR) modules that allow the entire PL pipeline to be trained end-to-end.
  arXiv  Detail & Related papers  (2020-04-07T02:18:38Z)
• Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detection [6.385728262904713]
  Gen-LaneNet is a unified framework solving image encoding, spatial transform of features and 3D lane prediction in a single network. Compared to 3D-LaneNet, the proposed Gen-LaneNet drastically reduces the amount of 3D lane labels required to achieve a robust solution in real-world application.
  arXiv  Detail & Related papers  (2020-03-24T04:52:06Z)
• DSGN: Deep Stereo Geometry Network for 3D Object Detection [79.16397166985706]
  There is a large performance gap between image-based and LiDAR-based 3D object detectors. Our method, called Deep Stereo Geometry Network (DSGN), significantly reduces this gap. For the first time, we provide a simple and effective one-stage stereo-based 3D detection pipeline.
  arXiv  Detail & Related papers  (2020-01-10T11:44:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.