Deep Learning-based Target-To-User Association in Integrated Sensing and Communication Systems

• URL: http://arxiv.org/abs/2401.12801v2
• Date: Mon, 2 Sep 2024 12:37:27 GMT
• Title: Deep Learning-based Target-To-User Association in Integrated Sensing and Communication Systems
• Abstract summary: We consider a radar-assisted communication system where a base station is equipped with a multiple-input-multiple-output (MIMO) radar. The proposed target-to-user (T2U) association consists of two stages. Joint multi-target detection and beam inference is obtained by modifying the you only look once (YOLO) model.
• Score: 8.401664608719633
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In Integrated Sensing and Communication (ISAC) systems, matching the radar targets with communication user equipments (UEs) is functional to several communication tasks, such as proactive handover and beam prediction. In this paper, we consider a radar-assisted communication system where a base station (BS) is equipped with a multiple-input-multiple-output (MIMO) radar that has a double aim: (i) associate vehicular radar targets to vehicular equipments (VEs) in the communication beamspace and (ii) predict the beamforming vector for each VE from radar data. The proposed target-to-user (T2U) association consists of two stages. First, vehicular radar targets are detected from range-angle images, and, for each, a beamforming vector is estimated. Then, the inferred per-target beamforming vectors are matched with the ones utilized at the BS for communication to perform target-to-user (T2U) association. Joint multi-target detection and beam inference is obtained by modifying the you only look once (YOLO) model, which is trained over simulated range-angle radar images. Simulation results over different urban vehicular mobility scenarios show that the proposed T2U method provides a probability of correct association that increases with the size of the BS antenna array, highlighting the respective increase of the separability of the VEs in the beamspace. Moreover, we show that the modified YOLO architecture can effectively perform both beam prediction and radar target detection, with similar performance in mean average precision on the latter over different antenna array sizes.

Related papers

• Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation [2.4705928100051135]
  We introduce a unified higher-order structural alignment framework for multi-view radar segmentation.<n>The proposed method refines radar feature representations using learnable hypergraphs to capture higher-order dependencies.<n>Experiments on the CARRADA and RADIal benchmarks demonstrate consistent improvements over strong radar-specific baselines.
  arXiv  Detail & Related papers  (2026-06-30T12:57:15Z)
• Learning Spatial Structure from Pre-Beamforming Per-Antenna Range-Doppler Radar Data via Visibility-Aware Cross-Modal Supervision [2.348805691644085]
  Can meaningful spatial structure be learned directly from pre-beamforming per-antenna range-Doppler measurements?<n>Experiments are conducted on a 6-TX x 8-RX (48 virtual antennas)<n>We operate on pre-beamforming per-antenna RD tensors using a dual-chirp shared-weight encoder trained in an end-to-end, fully data-driven manner.
  arXiv  Detail & Related papers  (2026-04-02T11:39:00Z)
• RadarGen: Automotive Radar Point Cloud Generation from Cameras [64.69976771710057]
  We present RadarGen, a diffusion model for synthesizing realistic automotive radar point clouds from multi-view camera imagery.<n>RadarGen adapts efficient image-latent diffusion to the radar domain by representing radar measurements in bird's-eye-view form.<n>We show that RadarGen captures characteristic radar measurement distributions and reduces the gap to perception models trained on real data.
  arXiv  Detail & Related papers  (2025-12-19T18:57:33Z)
• Scaling Foundation Models for Radar Scene Understanding [8.23171791313388]
  Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions.<n>Recent advances in foundation models have transformed visual and language understanding, yet their integration with radar sensing remains largely underexplored.<n>We introduce RadarFM: a radar foundation model that learns unified scene-level representations through structured spatial language supervision.
  arXiv  Detail & Related papers  (2025-11-26T06:41:00Z)
• Redefining Radar Segmentation: Simultaneous Static-Moving Segmentation and Ego-Motion Estimation using Radar Point Clouds [42.08401139629074]
  This study proposes a neural network based solution that can simultaneously segment static and moving objects from radar point clouds.<n>The measured radial velocity of static objects is correlated with the motion of the radar.<n>It can also estimate the instantaneous 2D velocity of the moving platform or vehicle.
  arXiv  Detail & Related papers  (2025-11-25T07:13:34Z)
• A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles [74.8162337823142]
  MM-UAV is the first large-scale benchmark for Multi-Modal UAV Tracking.<n>The dataset spans over 30 challenging scenarios, with 1,321 synchronised multi-modal sequences, and more than 2.8 million annotated frames.<n>Accompanying the dataset, we provide a novel multi-modal multi-UAV tracking framework.
  arXiv  Detail & Related papers  (2025-11-23T08:42:17Z)
• Joint Multi-Target Detection-Tracking in Cognitive Massive MIMO Radar via POMCP [42.99053410696693]
  This correspondence presents a power-aware cognitive radar framework for joint detection and tracking of multiple targets.<n>Building on a previous single-target algorithm based on Partially Observable Monte Carlo Planning (POMCP), we extend it to the multi-target case by assigning each target an independent POMCP tree.<n>The proposed framework for the cognitive radar improves detection probability for low-SNR targets and achieves more accurate tracking compared to approaches using uniform or waveforms.
  arXiv  Detail & Related papers  (2025-07-23T13:43:29Z)
• Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework [57.994965436344195]
  Beamforming is a key technology in millimeter-wave (mmWave) communications that improves signal transmission by optimizing directionality and intensity. multimodal sensing-aided beam prediction has gained significant attention, using various sensing data to predict user locations or network conditions. Despite its promising potential, the adoption of multimodal sensing-aided beam prediction is hindered by high computational complexity, high costs, and limited datasets.
  arXiv  Detail & Related papers  (2025-04-07T15:38:25Z)
• Multistatic-Radar RCS-Signature Recognition of Aerial Vehicles: A Bayesian Fusion Approach [10.908489565519211]
  Radar Automated Target Recognition (RATR) for Unmanned Aerial Vehicles (UAVs) involves transmitting Electromagnetic Waves (EMWs) and performing target type recognition on the received radar echo. Previous studies highlighted the advantages of multistatic radar configurations over monostatic ones in RATR. We propose a fully Bayesian RATR framework employing Optimal Bayesian Fusion (OBF) to aggregate classification probability vectors from multiple radars.
  arXiv  Detail & Related papers  (2024-02-28T02:11:47Z)
• Leveraging Self-Supervised Instance Contrastive Learning for Radar Object Detection [7.728838099011661]
  This paper presents RiCL, an instance contrastive learning framework to pre-train radar object detectors. We aim to pre-train an object detector's backbone, head and neck to learn with fewer data.
  arXiv  Detail & Related papers  (2024-02-13T12:53:33Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• SOOD: Towards Semi-Supervised Oriented Object Detection [57.05141794402972]
  This paper proposes a novel Semi-supervised Oriented Object Detection model, termed SOOD, built upon the mainstream pseudo-labeling framework. Our experiments show that when trained with the two proposed losses, SOOD surpasses the state-of-the-art SSOD methods under various settings on the DOTA-v1.5 benchmark.
  arXiv  Detail & Related papers  (2023-04-10T11:10:42Z)
• Fast Beam Alignment via Pure Exploration in Multi-armed Bandits [91.11360914335384]
  We develop a bandit-based fast BA algorithm to reduce BA latency for millimeter-wave (mmWave) communications. Our algorithm is named Two-Phase Heteroscedastic Track-and-Stop (2PHT&S)
  arXiv  Detail & Related papers  (2022-10-23T05:57:39Z)
• Deep Instance Segmentation with High-Resolution Automotive Radar [2.167586397005864]
  We propose two efficient methods for instance segmentation with radar detection points. One is implemented in an end-to-end deep learning driven fashion using PointNet++ framework. The other is based on clustering of the radar detection points with semantic information.
  arXiv  Detail & Related papers  (2021-10-05T01:18:27Z)
• Waveform Selection for Radar Tracking in Target Channels With Memory via Universal Learning [14.796960833031724]
  Adapting the radar's waveform using partial information about the state of the scene has been shown to provide performance benefits in many practical scenarios. This work examines a radar system which builds a compressed model of the radar-environment interface in the form of a context-tree. The proposed approach is tested in a simulation study, and is shown to provide tracking performance improvements over two state-of-the-art waveform selection schemes.
  arXiv  Detail & Related papers  (2021-08-02T21:27:56Z)
• Terahertz-Band Joint Ultra-Massive MIMO Radar-Communications: Model-Based and Model-Free Hybrid Beamforming [45.257328085051974]
  Wireless communications and sensing at terahertz (THz) band are investigated as promising short-range technologies. Ultra-massive multiple-input multiple-output (UM-MIMO) antenna systems have been proposed for THz communications to compensate propagation losses. We develop THz hybrid beamformers based on both model-based and model-free techniques for a new group-of-subarrays (GoSA) UM-MIMO structure.
  arXiv  Detail & Related papers  (2021-02-27T21:28:34Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)
• Distributed Variable-Baseline Stereo SLAM from two UAVs [17.513645771137178]
  In this article, we employ two UAVs equipped with one monocular camera and one IMU each, to exploit their view overlap and relative distance measurements. In order to control the glsuav agents autonomously, we propose a decentralized collaborative estimation scheme. We demonstrate the effectiveness of the approach at high altitude flights of up to 160m, going significantly beyond the capabilities of state-of-the-art VIO methods.
  arXiv  Detail & Related papers  (2020-09-10T12:16:10Z)
• RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects [73.80316195652493]
  We tackle the problem of exploiting Radar for perception in the context of self-driving cars. We propose a new solution that exploits both LiDAR and Radar sensors for perception. Our approach, dubbed RadarNet, features a voxel-based early fusion and an attention-based late fusion.
  arXiv  Detail & Related papers  (2020-07-28T17:15:02Z)
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms [98.78553146823829]
  Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks. In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
  arXiv  Detail & Related papers  (2020-02-19T14:04:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.