JitTrack: Onboard Multi-Object Tracking Against Viewpoint Jitter for Agile UAVs

• URL: http://arxiv.org/abs/2608.10485v1
• Date: Tue, 11 Aug 2026 05:00:31 GMT
• Title: JitTrack: Onboard Multi-Object Tracking Against Viewpoint Jitter for Agile UAVs
• Abstract summary: JitTrack is an active onboard multi-object tracking framework for drones.<n>It accommodates drone dynamics and camera ego-motion.<n>It introduces semantic refinement to improve the detection of emerging targets.<n>It also introduces motion-aware query rectification to compensate for target misalignment.
• Score: 0.5371337604556311
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-object tracking (MOT) onboard agile unmanned aerial vehicles (UAVs) remains challenging due to severe viewpoint jitter induced by camera ego-motion. Rapid attitude changes during flight often lead to significant target displacement across frames, causing inaccurate target association and degraded tracking performance. Existing UAV MOT methods are primarily evaluated on offline benchmarks and seldom address the practical requirements of real-world onboard deployment, including robustness to camera motion and active target following. To address these challenges, we propose JitTrack, an active onboard multi-object tracking framework that accommodates drone dynamics and camera ego-motion. Built upon a query-based transformer tracker, JitTrack introduces semantic refinement to improve the detection of emerging targets, motion-aware query rectification to compensate for target misalignment caused by viewpoint jitter, and a motion-inspired denoising training strategy that simulates camera motion patterns for robust supervision. Furthermore, we develop a perception-planning-control closed-loop tracking pipeline for real-world deployment, enabling collision-free and physically feasible target following on agile UAVs. Extensive experiments on public UAV MOT benchmarks demonstrate consistent improvements over the baseline method, while real-world flight experiments validate the effectiveness and practicality of JitTrack for robust onboard visual tracking under viewpoint jitter.

Related papers

• Counterfactual Motion Reliability Learning for Robust UAV Tracking [3.2658295979028753]
  Infrared unmanned aerial vehicle (UAV) tracking is challenging because the target is often small, low-contrast, and easily confused with thermal distractors or cluttered backgrounds.<n>Recent Transformer-based trackers have achieved promising performance by learning strong appearance representations.<n>CMRTrack is a counterfactual motion reliability learning framework for robust infrared UAV tracking.
  arXiv  Detail & Related papers  (2026-07-25T14:01:25Z)
• Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation [59.420015367586615]
  We introduce TrackCue, a tracking-guided framework for improving dynamic object representation in LiDAR scene flow estimation.<n>In particular, TrackCue repurposes point tracking to obtain dense image-space trajectories anchored to LiDAR points.<n>We show that TrackCue significantly improves the precision and F1 score of dynamic labels, leading to performance gains in self-supervised scene flow estimation.
  arXiv  Detail & Related papers  (2026-05-16T10:28:54Z)
• Eva-Tracker: ESDF-update-free, Visibility-aware Planning with Target Reacquisition for Robust Aerial Tracking [51.06229328990625]
  Eva-Tracker is a visibility-aware trajectory planning framework for aerial tracking.<n>It eliminates ESDF updates and incorporates a recovery-capable path generation method for target reacquisition.<n>Our approach delivers more robust tracking results with lower computational effort than existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-02-13T02:56:34Z)
• Tracking the Unstable: Appearance-Guided Motion Modeling for Robust Multi-Object Tracking in UAV-Captured Videos [58.156141601478794]
  Multi-object tracking (UAVT) aims to track multiple objects while maintaining consistent identities across frames of a given video.<n>Existing methods typically model motion cues and appearance separately, overlooking their interplay and resulting in suboptimal tracking performance.<n>We propose AMOT, which exploits appearance and motion cues through two key components: an Appearance-Motion Consistency (AMC) matrix and a Motion-aware Track Continuation (MTC) module.
  arXiv  Detail & Related papers  (2025-08-03T12:06:47Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• A Simple Detector with Frame Dynamics is a Strong Tracker [43.912410355089634]
  Infrared object tracking plays a crucial role in Anti-Unmanned Aerial Vehicle (Anti-UAV) applications.<n>Existing trackers often depend on cropped template regions and have limited motion modeling capabilities.<n>We propose a simple yet effective infrared tiny-object tracker that enhances tracking performance by integrating global detection and motion-aware learning.
  arXiv  Detail & Related papers  (2025-05-08T03:16:03Z)
• Open-World Drone Active Tracking with Goal-Centered Rewards [62.21394499788672]
  Drone Visual Active Tracking aims to autonomously follow a target object by controlling the motion system based on visual observations.<n>We propose DAT, the first open-world drone active air-to-ground tracking benchmark.<n>We also propose GC-VAT, which aims to improve the performance of drone tracking targets in complex scenarios.
  arXiv  Detail & Related papers  (2024-12-01T09:37:46Z)
• SFTrack: A Robust Scale and Motion Adaptive Algorithm for Tracking Small and Fast Moving Objects [2.9803250365852443]
  This paper addresses the problem of multi-object tracking in Unmanned Aerial Vehicle (UAV) footage. It plays a critical role in various UAV applications, including traffic monitoring systems and real-time suspect tracking by the police. We propose a new tracking strategy, which initiates the tracking of target objects from low-confidence detections.
  arXiv  Detail & Related papers  (2024-10-26T05:09:20Z)
• Learning Motion Blur Robust Vision Transformers for Real-Time UAV Tracking [14.382072224997074]
  Unmanned aerial vehicle (UAV) tracking is critical for applications like surveillance, search-and-rescue, and autonomous navigation.<n>The high-speed movement of UAVs and targets introduces unique challenges, including real-time processing demands and severe motion blur.<n>We propose an adaptive computation framework that dynamically exits Transformer blocks for real-time UAV tracking.
  arXiv  Detail & Related papers  (2024-07-07T14:10:04Z)
• Temporally-Transferable Perturbations: Efficient, One-Shot Adversarial Attacks for Online Visual Object Trackers [81.90113217334424]
  We propose a framework to generate a single temporally transferable adversarial perturbation from the object template image only. This perturbation can then be added to every search image, which comes at virtually no cost, and still, successfully fool the tracker.
  arXiv  Detail & Related papers  (2020-12-30T15:05:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.