Fully Spiking Neural Networks with Target Awareness for Energy-Efficient UAV Tracking

• URL: http://arxiv.org/abs/2603.27493v1
• Date: Sun, 29 Mar 2026 03:18:42 GMT
• Title: Fully Spiking Neural Networks with Target Awareness for Energy-Efficient UAV Tracking
• Abstract summary: Spiking Neural Networks (SNNs) have shown great potential for energy-efficient visual tracking on unmanned aerial vehicles (UAVs)<n>We propose STATrack, an efficient fully spiking neural network framework for UAV visual tracking using RGB inputs only.
• Score: 14.032296206825793
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spiking Neural Networks (SNNs), characterized by their event-driven computation and low power consumption, have shown great potential for energy-efficient visual tracking on unmanned aerial vehicles (UAVs). However, existing efficient SNN-based trackers heavily rely on costly event cameras, limiting their deployment on UAVs. To address this limitation, we propose STATrack, an efficient fully spiking neural network framework for UAV visual tracking using RGB inputs only. To the best of our knowledge, this work is the first to investigate spiking neural networks for UAV visual tracking tasks. To mitigate the weakening of target features by background tokens, we propose adaptively maximizing the mutual information between templates and features. Extensive experiments on four widely used UAV tracking benchmarks demonstrate that STATrack achieves competitive tracking performance while maintaining low energy consumption.

Related papers

• CGTrack: Cascade Gating Network with Hierarchical Feature Aggregation for UAV Tracking [20.14331144617911]
  We introduce a novel family of UAV trackers, termed CGTrack, which combines explicit and implicit techniques to expand network capacity.<n>Experiments on three challenging UAV tracking benchmarks demonstrate that CGTrack achieves state-of-the-art performance while running fast.
  arXiv  Detail & Related papers  (2025-05-09T10:27:01Z)
• More Clear, More Flexible, More Precise: A Comprehensive Oriented Object Detection benchmark for UAV [58.89234732689013]
  CODrone is a comprehensive oriented object detection dataset for UAVs that accurately reflects real-world conditions.<n>It also serves as a new benchmark designed to align with downstream task requirements.<n>We conduct a series of experiments based on 22 classical or SOTA methods to rigorously evaluate CODrone.
  arXiv  Detail & Related papers  (2025-04-28T17:56:02Z)
• Strong Baseline: Multi-UAV Tracking via YOLOv12 with BoT-SORT-ReID [0.03464344220266879]
  Multi-UAV tracking in thermal infrared video is challenging due to low contrast, environmental noise, and small target sizes.<n>We present a tracking framework built on YOLOv12 and BoT-SORT, enhanced with tailored training and inference strategies.<n>We provide implementation details, in-depth experimental analysis, and a discussion of potential improvements.
  arXiv  Detail & Related papers  (2025-03-21T15:40:18Z)
• SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networks [12.296877085867164]
  Spiking Neural Networks (SNNs) naturally complement event data through discrete spike signals, making them ideal for event-based tracking.<n>We propose the first Transformer-based spike-driven tracking pipeline.<n>Our Global Trajectory Prompt (GTP) method effectively captures global trajectory information and aggregates it with event streams into event images.<n>We then introduce SDTrack, a Transformer-based spike-driven tracker comprising a Spiking MetaFormer backbone and a tracking head that predicts normalized coordinates using spike signals.
  arXiv  Detail & Related papers  (2025-03-09T02:01:40Z)
• Learning Motion Blur Robust Vision Transformers for Real-Time UAV Tracking [14.382072224997074]
  Unmanned aerial vehicle (UAV) tracking is critical for applications like surveillance, search-and-rescue, and autonomous navigation.<n>The high-speed movement of UAVs and targets introduces unique challenges, including real-time processing demands and severe motion blur.<n>We propose an adaptive computation framework that dynamically exits Transformer blocks for real-time UAV tracking.
  arXiv  Detail & Related papers  (2024-07-07T14:10:04Z)
• Exploring Dynamic Transformer for Efficient Object Tracking [58.120191254379854]
  We propose DyTrack, a dynamic transformer framework for efficient tracking.<n>DyTrack automatically learns to configure proper reasoning routes for various inputs, gaining better utilization of the available computational budget.<n>Experiments on multiple benchmarks demonstrate that DyTrack achieves promising speed-precision trade-offs with only a single model.
  arXiv  Detail & Related papers  (2024-03-26T12:31:58Z)
• BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye View [54.48052449493636]
  3D Single Object Tracking (SOT) is a fundamental task in computer vision and plays a critical role in applications like autonomous driving.<n>We propose BEVTrack, a simple yet effective motion-based tracking method.<n>We show that BEVTrack achieves state-of-the-art results while operating at 200 FPS, enabling real-time applicability.
  arXiv  Detail & Related papers  (2023-09-05T12:42:26Z)
• 3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning [75.78929539923749]
  Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. It is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT) In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices.
  arXiv  Detail & Related papers  (2021-06-06T14:08:41Z)
• Temporally-Transferable Perturbations: Efficient, One-Shot Adversarial Attacks for Online Visual Object Trackers [81.90113217334424]
  We propose a framework to generate a single temporally transferable adversarial perturbation from the object template image only. This perturbation can then be added to every search image, which comes at virtually no cost, and still, successfully fool the tracker.
  arXiv  Detail & Related papers  (2020-12-30T15:05:53Z)
• Offloading Optimization in Edge Computing for Deep Learning Enabled Target Tracking by Internet-of-UAVs [22.143742665920573]
  Unmanned aerial vehicles (UAVs) have been extensively used in providing intelligence such as target tracking. A pre-trained convolutional neural network (CNN) is deployed at the UAV to identify a target from the captured video frames. This kind of visual target tracking demands a lot of computational resources due to the desired high inference accuracy and stringent delay requirement. This motivates us to consider offloading this type of deep learning (DL) tasks to a mobile edge computing (MEC) server.
  arXiv  Detail & Related papers  (2020-08-18T16:00:36Z)
• Efficient Adversarial Attacks for Visual Object Tracking [73.43180372379594]
  We present an end-to-end network FAN (Fast Attack Network) that uses a novel drift loss combined with the embedded feature loss to attack the Siamese network based trackers. Under a single GPU, FAN is efficient in the training speed and has a strong attack performance.
  arXiv  Detail & Related papers  (2020-08-01T08:47:58Z)
• Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks [62.836429958476735]
  We propose a Two-Stream Residual Convolutional Network (TS-RCN) for visual tracking. Our TS-RCN can be integrated with existing deep learning based visual trackers. To further improve the tracking performance, we adopt a "wider" residual network ResNeXt as its feature extraction backbone.
  arXiv  Detail & Related papers  (2020-05-13T19:05:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.