A Camera-Cooperative ISAC Framework for Multimodal Non-Cooperative UAVs Sensing

• URL: http://arxiv.org/abs/2605.22090v1
• Date: Thu, 21 May 2026 07:31:51 GMT
• Title: A Camera-Cooperative ISAC Framework for Multimodal Non-Cooperative UAVs Sensing
• Abstract summary: Non-cooperative unmanned aerial vehicles (UAVs) present significant challenges for Integrated Sensing and Communication (ISAC) systems.<n>This paper proposes a novel Camera-Cooperative ISAC framework that employs multimodal sensing to enable efficient UAV beam steering and tracking.
• Score: 9.14610708884717
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The detection of non-cooperative unmanned aerial vehicles (UAVs) presents significant challenges for Integrated Sensing and Communication (ISAC) systems due to the inherent limitations of single-modal perception and the competition for shared communication and sensing resources. To address these challenges, this paper proposes a novel Camera-Cooperative ISAC (CC-ISAC) framework that employs multimodal sensing to enable efficient UAV beam steering and tracking. The proposed framework employs cameras for coarse-grained airspace monitoring and utilizes ISAC for fine-grained, high-precision sensing, forming a complementary perception loop that enhances both sensing accuracy and resource efficiency. Within this framework, two key modules are developed: (1) a Vision-to-Echo Data Alignment (V2EDA) model that aligns visual and echo-domain features through cross-attention mechanisms, and (2) a Multimodal Fusion-Based Estimation (MMFE) model that integrates historical multimodal data with current observations for robust state estimation. Extensive evaluations conducted on the DeepSense 6G dataset demonstrate that the proposed framework achieves an average reduction of 71% in beam steering overhead and 1.69-11.15% in tracking overhead while maintaining high angular estimation accuracy. The CC-ISAC framework effectively mitigates resource contention between sensing and communication, enabling reliable UAV surveillance while freeing substantial system resources for additional communication tasks, thereby representing a practical advancement in ISAC system design.

Related papers

• AmbSentry: Mitigating Sensing Eavesdropping in ISAC Systems by Harnessing Ambient IoT Devices [60.083979780396014]
  Integrated sensing and communication (ISAC) has emerged as a pivotal paradigm for 6G networks.<n>This paper proposes AmbSentry, an ISAC system that prevents the leakage of sensing information to sensing eavesdroppers.
  arXiv  Detail & Related papers  (2026-08-12T08:42:05Z)
• Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networks [51.323657802729535]
  Multi-uncrewed aerial vehicles (UAV) cooperative perception has emerged as a promising paradigm for diverse low-altitude economy applications.<n>This paper proposes a communication-efficient cooperative perception framework, termed Base-Station-Helped UAV (BHU)<n>We employ a Top-K selection mechanism to identify the most informative pixels from UAV-captured RGB images, enabling sparsified visual transmission with reduced data volume and latency.
  arXiv  Detail & Related papers  (2026-03-13T17:49:28Z)
• Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selection [23.186947629238233]
  Risk-intent Selective detection (RiSe) is an interaction-aware framework that shifts the paradigm from identifying visible regions to prioritizing risk-critical ones.<n>RiSe implements a semantic-selective fusion scheme that transmits high-fidelity features only from high-interaction regions.<n>Our method reduces communication volume to 0.71% of full feature sharing while maintaining state-of-the-art detection accuracy.
  arXiv  Detail & Related papers  (2026-01-06T13:25:23Z)
• AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios [64.51320327698231]
  We introduce AerialMind, the first large-scale RMOT benchmark in UAV scenarios.<n>We develop an innovative semi-automated collaborative agent-based labeling assistant framework.<n>We also propose HawkEyeTrack, a novel method that collaboratively enhances vision-language representation learning.
  arXiv  Detail & Related papers  (2025-11-26T04:44:27Z)
• A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles [74.8162337823142]
  MM-UAV is the first large-scale benchmark for Multi-Modal UAV Tracking.<n>The dataset spans over 30 challenging scenarios, with 1,321 synchronised multi-modal sequences, and more than 2.8 million annotated frames.<n>Accompanying the dataset, we provide a novel multi-modal multi-UAV tracking framework.
  arXiv  Detail & Related papers  (2025-11-23T08:42:17Z)
• When UAV Swarm Meets IRS: Collaborative Secure Communications in Low-altitude Wireless Networks [68.45202147860537]
  Low-altitude wireless networks (LAWNs) provide enhanced coverage, reliability, and throughput for diverse applications.<n>These networks face significant security vulnerabilities from both known and potential unknown eavesdroppers.<n>We propose a novel secure communication framework for LAWNs where the selected UAVs within a swarm function as a virtual antenna array.
  arXiv  Detail & Related papers  (2025-10-25T02:02:14Z)
• Joint Hybrid Beamforming and Artificial Noise Design for Secure Multi-UAV ISAC Networks [3.697288477203596]
  Integrated sensing and communication (ISAC) emerges as a key enabler for next-generation applications such as smart cities and autonomous systems.<n>Existing research predominantly treats UAVs as aerial base stations, overlooking their role as ISAC users.<n>This paper propose a secure and spectral efficient ISAC framework for multi-UAV networks.
  arXiv  Detail & Related papers  (2025-09-28T06:58:04Z)
• Age of Information Minimization in UAV-Enabled Integrated Sensing and Communication Systems [34.92822911897626]
  Unmanned aerial vehicles (UAVs) equipped with integrated sensing and communication (ISAC) capabilities are envisioned to play a pivotal role in future wireless networks.<n>We propose Age Information (AoI) system that simultaneously performs target sensing and multi-user communication.
  arXiv  Detail & Related papers  (2025-07-18T18:17:09Z)
• Griffin: Aerial-Ground Cooperative Detection and Tracking Dataset and Benchmark [15.405137983083875]
  Aerial-ground cooperation offers a promising solution by integrating UAVs' aerial views with ground vehicles' local observations.<n>This paper presents a comprehensive solution for aerial-ground cooperative 3D perception through three key contributions.
  arXiv  Detail & Related papers  (2025-03-10T07:00:07Z)
• Multi-Point Integrated Sensing and Communication: Fusion Model and Functionality Selection [99.67715229413986]
  This paper presents a multi-point ISAC (MPISAC) system that fuses the outputs from multiple ISAC devices for achieving higher sensing performance. We adopt a fusion model that predicts the fusion accuracy via hypothesis testing and optimal voting analysis.
  arXiv  Detail & Related papers  (2022-08-16T08:09:54Z)
• Bandwidth-Adaptive Feature Sharing for Cooperative LIDAR Object Detection [2.064612766965483]
  Situational awareness as a necessity in the connected and autonomous vehicles (CAV) domain. Cooperative mechanisms have provided a solution to improve situational awareness by utilizing high speed wireless vehicular networks. We propose a mechanism to add flexibility in adapting to communication channel capacity and a novel decentralized shared data alignment method.
  arXiv  Detail & Related papers  (2020-10-22T00:12:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.