Height-Guided Projection Reparameterization for Camera-LiDAR Occupancy

• URL: http://arxiv.org/abs/2605.05072v2
• Date: Mon, 11 May 2026 03:18:21 GMT
• Title: Height-Guided Projection Reparameterization for Camera-LiDAR Occupancy
• Abstract summary: HiPR is a camera-LiDAR occupancy framework with Height-Guided Projection Re parameterization.<n>HiPR consistently outperforms existing state-of-the-art methods while maintaining real-time inference.
• Score: 19.450674475241353
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D occupancy prediction aims to infer dense, voxel-wise scene semantics from sensor observations, where the 2D-to-3D view transformation serves as a crucial step in bridging image features and volumetric representations. Most previous methods rely on a fixed projection space, where 3D reference points are uniformly sampled along pillars. However, such sampling struggles to capture the sparsity and height variations of real-world scenes, leading to ambiguous correspondences and unreliable feature aggregation. To address these challenges, we propose HiPR, a camera-LiDAR occupancy framework with Height-Guided Projection Reparameterization. HiPR first encodes LiDAR into a BEV height map to capture the maximum height of the point cloud. HiPR then adjusts the sampling range of each pillar using the height prior, enabling adaptive reparameterization of the projection space. As a result, the projected points are redistributed into geometrically meaningful regions rather than fixed ranges. Meanwhile, we mask out the invalid parts of the height map to avoid misleading the feature aggregation. In addition, to alleviate the training instability caused by noisy LiDAR-derived heights, we introduce a training-time Progressive Height Conditioning strategy, which gradually transitions the conditioning signal from ground-truth heights to LiDAR heights. Extensive experiments demonstrate that HiPR consistently outperforms existing state-of-the-art methods while maintaining real-time inference. The code and pretrained models can be found at https://github.com/yanzq95/HiPR.

Related papers

• RIDE: Relocalization-Informed Depth Estimation with 3D Gaussian Splatting [20.29273985020268]
  We present RIDE, which estimates dense depth from a robot's RGB map.<n>Experiments show improved depth accuracy temporal consistency scale-only calibration, demonstrating how dense geometry can support both pose recovery and robot perception.
  arXiv  Detail & Related papers  (2026-09-10T04:36:58Z)
• HSDF-Lane: Height-Aligned Signed Distance Field with Semantic Lane Prior for 3D Lane Detection [42.418429168532406]
  We propose HSDF-Lane, which implicitly models the road surface as a Height-aligned Signed Distance Field (HSDF) over a densely sampled 3D feature volume.<n>HSDF-Lane achieves state-of-the-art performance in both 3D lane detection and height map estimation.
  arXiv  Detail & Related papers  (2026-06-30T06:02:59Z)
• RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer [71.59462491691819]
  We propose a novel end-to-end differential transformer network, termed RegFormer++, for large-scale point cloud alignment.<n>Because we fill original 3D coordinates into 2D projected positions, our designed transformer can benefit from both high efficiency in 2D processing and accuracy from 3D geometric information.<n>Experiments on KITTI, NuScenes, and Argoverse datasets demonstrate that our model achieves state-of-the-art performance in terms of both accuracy and efficiency.
  arXiv  Detail & Related papers  (2026-03-15T09:03:10Z)
• FreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformers [91.59069344768858]
  We introduce Frequency-aware Positional Depth Embedding (FreqPDE) to equip 2D image features with spatial information for 3D detection transformer decoder.<n>FreqPDE combines the 2D image features and 3D position embeddings to generate 3D depth-aware features for query decoding.
  arXiv  Detail & Related papers  (2025-10-17T07:36:54Z)
• SC-Lane: Slope-aware and Consistent Road Height Estimation Framework for 3D Lane Detection [6.35342543540348]
  We introduce SC-Lane, a novel slope-aware and temporally consistent heightmap estimation framework for 3D lane detection.<n>SC-Lane adaptively determines the fusion of slope-specific height features, improving robustness to diverse road geometries.<n>Extensive experiments on the OpenLane benchmark demonstrate that SC-Lane significantly improves both height estimation and 3D lane detection.
  arXiv  Detail & Related papers  (2025-08-14T07:34:56Z)
• PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting [54.7468067660037]
  PF3plat sets a new state-of-the-art across all benchmarks, supported by comprehensive ablation studies validating our design choices.<n>Our framework capitalizes on fast speed, scalability, and high-quality 3D reconstruction and view synthesis capabilities of 3DGS.
  arXiv  Detail & Related papers  (2024-10-29T15:28:15Z)
• Deep Height Decoupling for Precise Vision-based 3D Occupancy Prediction [28.071645239063553]
  We present Deep Height Decoupling (DHD), a novel framework that incorporates explicit height prior to filter out the confusing features.<n>On the popular Occ3D-nuScenes benchmark, our method achieves state-of-the-art performance even with minimal input frames.
  arXiv  Detail & Related papers  (2024-09-12T12:12:19Z)
• HeightLane: BEV Heightmap guided 3D Lane Detection [6.940660861207046]
  Accurate 3D lane detection from monocular images presents significant challenges due to depth ambiguity and imperfect ground modeling.<n>Our study introduces HeightLane, an innovative method that predicts a height map from monocular images by creating anchors based on a multi-slope assumption.<n>HeightLane achieves state-of-the-art performance in terms of F-score, highlighting its potential in real-world applications.
  arXiv  Detail & Related papers  (2024-08-15T17:14:57Z)
• GEOcc: Geometrically Enhanced 3D Occupancy Network with Implicit-Explicit Depth Fusion and Contextual Self-Supervision [49.839374549646884]
  This paper presents GEOcc, a Geometric-Enhanced Occupancy network tailored for vision-only surround-view perception.<n>Our approach achieves State-Of-The-Art performance on the Occ3D-nuScenes dataset with the least image resolution needed and the most weightless image backbone.
  arXiv  Detail & Related papers  (2024-05-17T07:31:20Z)
• Progressive Coordinate Transforms for Monocular 3D Object Detection [52.00071336733109]
  We propose a novel and lightweight approach, dubbed em Progressive Coordinate Transforms (PCT) to facilitate learning coordinate representations. In this paper, we propose a novel and lightweight approach, dubbed em Progressive Coordinate Transforms (PCT) to facilitate learning coordinate representations.
  arXiv  Detail & Related papers  (2021-08-12T15:22:33Z)
• Soft Expectation and Deep Maximization for Image Feature Detection [68.8204255655161]
  We propose SEDM, an iterative semi-supervised learning process that flips the question and first looks for repeatable 3D points, then trains a detector to localize them in image space. Our results show that this new model trained using SEDM is able to better localize the underlying 3D points in a scene.
  arXiv  Detail & Related papers  (2021-04-21T00:35:32Z)
• Height estimation from single aerial images using a deep ordinal regression network [12.991266182762597]
  We deal with the ambiguous and unsolved problem of height estimation from a single aerial image. Driven by the success of deep learning, especially deep convolution neural networks (CNNs), some researches have proposed to estimate height information from a single aerial image. In this paper, we proposed to divide height values into spacing-increasing intervals and transform the regression problem into an ordinal regression problem.
  arXiv  Detail & Related papers  (2020-06-04T12:03:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.