Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation

• URL: http://arxiv.org/abs/2606.31609v1
• Date: Tue, 30 Jun 2026 12:57:15 GMT
• Title: Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation
• Abstract summary: We introduce a unified higher-order structural alignment framework for multi-view radar segmentation.<n>The proposed method refines radar feature representations using learnable hypergraphs to capture higher-order dependencies.<n>Experiments on the CARRADA and RADIal benchmarks demonstrate consistent improvements over strong radar-specific baselines.
• Score: 2.4705928100051135
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Radar sensors provide reliable perception under adverse weather and lighting conditions, but their sparse, noisy, and weakly semantic measurements make dense semantic segmentation challenging. Most existing radar segmentation methods rely on grid-based encodings and pairwise interactions, which struggle to capture the higher-order relational structure formed by multiple radar returns from the same physical object. We introduce a unified higher-order structural alignment framework for multi-view radar segmentation. The proposed method refines radar feature representations using learnable hypergraphs to capture higher-order dependencies among spatially related responses. To ensure consistency across heterogeneous radar projections, we further align view-specific features using Unbalanced Optimal Transport (UOT), enabling correspondence-free alignment under varying measurement densities and partial observations. An adaptive attention mechanism then fuses complementary radar views while emphasising structurally informative responses under sparsity and noise. The resulting architecture learns structurally consistent representations across Range Angle (RA), Range Doppler (RD), and Angle Doppler (AD) views and is trained using supervised segmentation together with cross-view consistency regularisation. Experiments on the CARRADA and RADIal benchmarks demonstrate consistent improvements over strong radar-specific baselines, achieving 63.8% mIoU on CARRADA and 83.4% mIoU on RADIal, improving the previous best methods by +1.7 and +2.3 mIoU, respectively. These results highlight the importance of higher-order relational modelling for robust radar perception.

Related papers

• RLPR: Radar-to-LiDAR Place Recognition via Two-Stage Asymmetric Cross-Modal Alignment for Autonomous Driving [14.25906590501402]
  Radar-to-LiDAR place recognition can localize radar scans within existing LiDAR maps.<n>We propose RLPR, a robust radar-to-LiDAR place recognition framework compatible with single-chip, scanning, and 4D radars.<n>Experiments on four datasets demonstrate that RLPR achieves recognition accuracy with strong zero-shot generalization capabilities.
  arXiv  Detail & Related papers  (2026-03-09T03:28:44Z)
• Synthetic FMCW Radar Range Azimuth Maps Augmentation with Generative Diffusion Model [9.764772760421792]
  We propose a conditional generative framework for synthesizing realistic Frequency-Modulated Continuous-Wave radar Range-Azimuth Maps.<n>Our approach leverages a generative diffusion model to generate radar data for multiple object categories, including pedestrians, cars, and cyclists.
  arXiv  Detail & Related papers  (2026-01-09T10:59:46Z)
• RadarGen: Automotive Radar Point Cloud Generation from Cameras [64.69976771710057]
  We present RadarGen, a diffusion model for synthesizing realistic automotive radar point clouds from multi-view camera imagery.<n>RadarGen adapts efficient image-latent diffusion to the radar domain by representing radar measurements in bird's-eye-view form.<n>We show that RadarGen captures characteristic radar measurement distributions and reduces the gap to perception models trained on real data.
  arXiv  Detail & Related papers  (2025-12-19T18:57:33Z)
• Scaling Foundation Models for Radar Scene Understanding [8.23171791313388]
  Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions.<n>Recent advances in foundation models have transformed visual and language understanding, yet their integration with radar sensing remains largely underexplored.<n>We introduce RadarFM: a radar foundation model that learns unified scene-level representations through structured spatial language supervision.
  arXiv  Detail & Related papers  (2025-11-26T06:41:00Z)
• TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion [54.46664104437454]
  We propose TacoDepth, an efficient and accurate Radar-Camera depth estimation model with one-stage fusion.<n>Specifically, the graph-based Radar structure extractor and the pyramid-based Radar fusion module are designed.<n>Compared with the previous state-of-the-art approach, TacoDepth improves depth accuracy and processing speed by 12.8% and 91.8%.
  arXiv  Detail & Related papers  (2025-04-16T05:25:04Z)
• Multistatic-Radar RCS-Signature Recognition of Aerial Vehicles: A Bayesian Fusion Approach [10.908489565519211]
  Radar Automated Target Recognition (RATR) for Unmanned Aerial Vehicles (UAVs) involves transmitting Electromagnetic Waves (EMWs) and performing target type recognition on the received radar echo. Previous studies highlighted the advantages of multistatic radar configurations over monostatic ones in RATR. We propose a fully Bayesian RATR framework employing Optimal Bayesian Fusion (OBF) to aggregate classification probability vectors from multiple radars.
  arXiv  Detail & Related papers  (2024-02-28T02:11:47Z)
• Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection [78.59426158981108]
  We introduce a bi-directional LiDAR-Radar fusion framework, termed Bi-LRFusion, to tackle the challenges and improve 3D detection for dynamic objects. We conduct extensive experiments on nuScenes and ORR datasets, and show that our Bi-LRFusion achieves state-of-the-art performance for detecting dynamic objects.
  arXiv  Detail & Related papers  (2023-06-02T10:57:41Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion [52.59664614744447]
  We present LiRaNet, a novel end-to-end trajectory prediction method which utilizes radar sensor information along with widely used lidar and high definition (HD) maps. automotive radar provides rich, complementary information, allowing for longer range vehicle detection as well as instantaneous velocity measurements.
  arXiv  Detail & Related papers  (2020-10-02T00:13:00Z)
• Depth Estimation from Monocular Images and Sparse Radar Data [93.70524512061318]
  In this paper, we explore the possibility of achieving a more accurate depth estimation by fusing monocular images and Radar points using a deep neural network. We find that the noise existing in Radar measurements is one of the main key reasons that prevents one from applying the existing fusion methods. The experiments are conducted on the nuScenes dataset, which is one of the first datasets which features Camera, Radar, and LiDAR recordings in diverse scenes and weather conditions.
  arXiv  Detail & Related papers  (2020-09-30T19:01:33Z)
• Off-the-shelf sensor vs. experimental radar -- How much resolution is necessary in automotive radar classification? [5.452955349285637]
  The resolution of conventional automotive radar sensors results in a sparse data representation. A new sensor generation is waiting in the wings for its application in this challenging field. Two sensors of different radar generations are evaluated against each other.
  arXiv  Detail & Related papers  (2020-06-09T19:51:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.