DarkLighter: Light Up the Darkness for UAV Tracking

• URL: http://arxiv.org/abs/2107.14389v1
• Date: Fri, 30 Jul 2021 01:37:24 GMT
• Title: DarkLighter: Light Up the Darkness for UAV Tracking
• Authors: Junjie Ye, Changhong Fu, Guangze Zheng, Ziang Cao, Bowen Li
• Abstract summary: This work proposes a low-light image enhancer namely DarkLighter, which dedicates to alleviate the impact of poor illumination and noise. A lightweight map estimation network, i.e., ME-Net, is trained to efficiently estimate illumination maps and noise maps jointly. Experiments are conducted with several SOTA trackers on numerous UAV dark tracking scenes.
• Score: 14.901582782711627
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent years have witnessed the fast evolution and promising performance of the convolutional neural network (CNN)-based trackers, which aim at imitating biological visual systems. However, current CNN-based trackers can hardly generalize well to low-light scenes that are commonly lacked in the existing training set. In indistinguishable night scenarios frequently encountered in unmanned aerial vehicle (UAV) tracking-based applications, the robustness of the state-of-the-art (SOTA) trackers drops significantly. To facilitate aerial tracking in the dark through a general fashion, this work proposes a low-light image enhancer namely DarkLighter, which dedicates to alleviate the impact of poor illumination and noise iteratively. A lightweight map estimation network, i.e., ME-Net, is trained to efficiently estimate illumination maps and noise maps jointly. Experiments are conducted with several SOTA trackers on numerous UAV dark tracking scenes. Exhaustive evaluations demonstrate the reliability and universality of DarkLighter, with high efficiency. Moreover, DarkLighter has further been implemented on a typical UAV system. Real-world tests at night scenes have verified its practicability and dependability.

Related papers

• Enhancing Nighttime UAV Tracking with Light Distribution Suppression [6.950880335490385]
  This work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information. A challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation.
  arXiv  Detail & Related papers  (2024-09-25T05:19:35Z)
• DCPT: Darkness Clue-Prompted Tracking in Nighttime UAVs [53.64523622330297]
  Existing nighttime unmanned aerial vehicle (UAV) trackers follow an "Enhance-then-Track" architecture. This separate enhancement and tracking fails to build an end-to-end trainable vision system. We propose Darkness Clue-Prompted Tracking (DCPT) that achieves robust UAV tracking at night by efficiently learning to generate darkness clue prompts.
  arXiv  Detail & Related papers  (2023-09-19T09:59:08Z)
• Improving Underwater Visual Tracking With a Large Scale Dataset and Image Enhancement [70.2429155741593]
  This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT) It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles. We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality. The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
  arXiv  Detail & Related papers  (2023-08-30T07:41:26Z)
• Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking [84.38335117043907]
  We propose a purely passive method to track a person walking in an invisible room by only observing a relay wall. To excavate imperceptible changes in videos of the relay wall, we introduce difference frames as an essential carrier of temporal-local motion messages. To evaluate the proposed method, we build and publish the first dynamic passive NLOS tracking dataset, NLOS-Track.
  arXiv  Detail & Related papers  (2023-03-21T12:18:57Z)
• Tracker Meets Night: A Transformer Enhancer for UAV Tracking [20.74868878876137]
  spatial-channel Transformer-based low-light enhancer is proposed and plugged prior to tracking approaches. To achieve semantic-level low-light enhancement targeting the high-level task, novel spatial-channel attention module is proposed. In the enhancement process, SCT denoises and illuminates nighttime images simultaneously.
  arXiv  Detail & Related papers  (2023-03-20T09:18:52Z)
• AVisT: A Benchmark for Visual Object Tracking in Adverse Visibility [125.77396380698639]
  AVisT is a benchmark for visual tracking in diverse scenarios with adverse visibility. AVisT comprises 120 challenging sequences with 80k annotated frames, spanning 18 diverse scenarios. We benchmark 17 popular and recent trackers on AVisT with detailed analysis of their tracking performance across attributes.
  arXiv  Detail & Related papers  (2022-08-14T17:49:37Z)
• HighlightNet: Highlighting Low-Light Potential Features for Real-Time UAV Tracking [13.076998989872212]
  Low-light environments have posed a formidable challenge for robust unmanned aerial vehicle (UAV) tracking. This work proposes a novel enhancer, i.e., HighlightNet, to light up potential objects for both human operators and UAV trackers.
  arXiv  Detail & Related papers  (2022-08-14T10:09:35Z)
• ADTrack: Target-Aware Dual Filter Learning for Real-Time Anti-Dark UAV Tracking [17.80444543935194]
  The proposed method integrates an efficient and effective low-light image enhancer into a CF-based tracker. The target-aware mask can be applied to jointly train a target-focused filter that assists the context filter for robust tracking. The results have shown that ADTrack favorably outperforms other state-of-the-art trackers and achieves a real-time speed of 34 frames/s on a single CPU.
  arXiv  Detail & Related papers  (2021-06-04T14:05:24Z)
• LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search [104.84999119090887]
  We present LightTrack, which uses neural architecture search (NAS) to design more lightweight and efficient object trackers. Comprehensive experiments show that our LightTrack is effective. It can find trackers that achieve superior performance compared to handcrafted SOTA trackers, such as SiamRPN++ and Ocean.
  arXiv  Detail & Related papers  (2021-04-29T17:55:24Z)
• All-Day Object Tracking for Unmanned Aerial Vehicle [19.10142725484355]
  This work proposes a novel correlation filter based tracker with illumination adaptive and anti dark capability, namely ADTrack. ADTrack exploits image illuminance information to enable adaptability of the model to the given light condition. This work also constructed one UAV nighttime tracking benchmark UAVDark135, comprising of more than 125k manually annotated frames.
  arXiv  Detail & Related papers  (2021-01-21T05:12:37Z)
• Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks [62.836429958476735]
  We propose a Two-Stream Residual Convolutional Network (TS-RCN) for visual tracking. Our TS-RCN can be integrated with existing deep learning based visual trackers. To further improve the tracking performance, we adopt a "wider" residual network ResNeXt as its feature extraction backbone.
  arXiv  Detail & Related papers  (2020-05-13T19:05:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.