MambaTrack: Exploiting Dual-Enhancement for Night UAV Tracking

• URL: http://arxiv.org/abs/2411.15761v1
• Date: Sun, 24 Nov 2024 09:12:37 GMT
• Title: MambaTrack: Exploiting Dual-Enhancement for Night UAV Tracking
• Authors: Chunhui Zhang, Li Liu, Hao Wen, Xi Zhou, Yanfeng Wang,
• Abstract summary: Night unmanned aerial vehicle (UAV) tracking is impeded by the challenges of poor illumination. We propose an efficient mamba-based tracker, leveraging dual enhancement techniques to boost night UAV tracking.
• Score: 41.76977058932557
• License:
• Abstract: Night unmanned aerial vehicle (UAV) tracking is impeded by the challenges of poor illumination, with previous daylight-optimized methods demonstrating suboptimal performance in low-light conditions, limiting the utility of UAV applications. To this end, we propose an efficient mamba-based tracker, leveraging dual enhancement techniques to boost night UAV tracking. The mamba-based low-light enhancer, equipped with an illumination estimator and a damage restorer, achieves global image enhancement while preserving the details and structure of low-light images. Additionally, we advance a cross-modal mamba network to achieve efficient interactive learning between vision and language modalities. Extensive experiments showcase that our method achieves advanced performance and exhibits significantly improved computation and memory efficiency. For instance, our method is 2.8$\times$ faster than CiteTracker and reduces 50.2$\%$ GPU memory. Codes will be made publicly available.

Related papers

• Enhancing Nighttime UAV Tracking with Light Distribution Suppression [6.950880335490385]
  This work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information. A challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation.
  arXiv  Detail & Related papers  (2024-09-25T05:19:35Z)
• An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models [65.37846460916042]
  We find out that the attention computation over visual tokens is of extreme inefficiency in the deep layers of popular LVLMs. We introduce FastV, a versatile plug-and-play method designed to optimize computational efficiency.
  arXiv  Detail & Related papers  (2024-03-11T14:35:32Z)
• Improving Underwater Visual Tracking With a Large Scale Dataset and Image Enhancement [70.2429155741593]
  This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT) It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles. We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality. The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
  arXiv  Detail & Related papers  (2023-08-30T07:41:26Z)
• Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimation [97.0195314255101]
  Inverse path tracing is expensive to compute, and ambiguities exist between reflection and emission. Our Factorized Inverse Path Tracing (FIPT) addresses these challenges by using a factored light transport formulation. Our algorithm enables accurate material and lighting optimization faster than previous work, and is more effective at resolving ambiguities.
  arXiv  Detail & Related papers  (2023-04-12T07:46:05Z)
• Tracker Meets Night: A Transformer Enhancer for UAV Tracking [20.74868878876137]
  spatial-channel Transformer-based low-light enhancer is proposed and plugged prior to tracking approaches. To achieve semantic-level low-light enhancement targeting the high-level task, novel spatial-channel attention module is proposed. In the enhancement process, SCT denoises and illuminates nighttime images simultaneously.
  arXiv  Detail & Related papers  (2023-03-20T09:18:52Z)
• AVisT: A Benchmark for Visual Object Tracking in Adverse Visibility [125.77396380698639]
  AVisT is a benchmark for visual tracking in diverse scenarios with adverse visibility. AVisT comprises 120 challenging sequences with 80k annotated frames, spanning 18 diverse scenarios. We benchmark 17 popular and recent trackers on AVisT with detailed analysis of their tracking performance across attributes.
  arXiv  Detail & Related papers  (2022-08-14T17:49:37Z)
• HighlightNet: Highlighting Low-Light Potential Features for Real-Time UAV Tracking [13.076998989872212]
  Low-light environments have posed a formidable challenge for robust unmanned aerial vehicle (UAV) tracking. This work proposes a novel enhancer, i.e., HighlightNet, to light up potential objects for both human operators and UAV trackers.
  arXiv  Detail & Related papers  (2022-08-14T10:09:35Z)
• DarkLighter: Light Up the Darkness for UAV Tracking [14.901582782711627]
  This work proposes a low-light image enhancer namely DarkLighter, which dedicates to alleviate the impact of poor illumination and noise. A lightweight map estimation network, i.e., ME-Net, is trained to efficiently estimate illumination maps and noise maps jointly. Experiments are conducted with several SOTA trackers on numerous UAV dark tracking scenes.
  arXiv  Detail & Related papers  (2021-07-30T01:37:24Z)
• All-Day Object Tracking for Unmanned Aerial Vehicle [19.10142725484355]
  This work proposes a novel correlation filter based tracker with illumination adaptive and anti dark capability, namely ADTrack. ADTrack exploits image illuminance information to enable adaptability of the model to the given light condition. This work also constructed one UAV nighttime tracking benchmark UAVDark135, comprising of more than 125k manually annotated frames.
  arXiv  Detail & Related papers  (2021-01-21T05:12:37Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.