HighlightNet: Highlighting Low-Light Potential Features for Real-Time UAV Tracking

• URL: http://arxiv.org/abs/2208.06818v1
• Date: Sun, 14 Aug 2022 10:09:35 GMT
• Title: HighlightNet: Highlighting Low-Light Potential Features for Real-Time UAV Tracking
• Authors: Changhong Fu, Haolin Dong, Junjie Ye, Guangze Zheng, Sihang Li, Jilin Zhao
• Abstract summary: Low-light environments have posed a formidable challenge for robust unmanned aerial vehicle (UAV) tracking. This work proposes a novel enhancer, i.e., HighlightNet, to light up potential objects for both human operators and UAV trackers.
• Score: 13.076998989872212
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Low-light environments have posed a formidable challenge for robust unmanned aerial vehicle (UAV) tracking even with state-of-the-art (SOTA) trackers since the potential image features are hard to extract under adverse light conditions. Besides, due to the low visibility, accurate online selection of the object also becomes extremely difficult for human monitors to initialize UAV tracking in ground control stations. To solve these problems, this work proposes a novel enhancer, i.e., HighlightNet, to light up potential objects for both human operators and UAV trackers. By employing Transformer, HighlightNet can adjust enhancement parameters according to global features and is thus adaptive for the illumination variation. Pixel-level range mask is introduced to make HighlightNet more focused on the enhancement of the tracking object and regions without light sources. Furthermore, a soft truncation mechanism is built to prevent background noise from being mistaken for crucial features. Evaluations on image enhancement benchmarks demonstrate HighlightNet has advantages in facilitating human perception. Experiments on the public UAVDark135 benchmark show that HightlightNet is more suitable for UAV tracking tasks than other SOTA low-light enhancers. In addition, real-world tests on a typical UAV platform verify HightlightNet's practicability and efficiency in nighttime aerial tracking-related applications. The code and demo videos are available at https://github.com/vision4robotics/HighlightNet.

Related papers

• MambaTrack: Exploiting Dual-Enhancement for Night UAV Tracking [41.76977058932557]
  Night unmanned aerial vehicle (UAV) tracking is impeded by the challenges of poor illumination. We propose an efficient mamba-based tracker, leveraging dual enhancement techniques to boost night UAV tracking.
  arXiv  Detail & Related papers  (2024-11-24T09:12:37Z)
• Enhancing Nighttime UAV Tracking with Light Distribution Suppression [6.950880335490385]
  This work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information. A challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation.
  arXiv  Detail & Related papers  (2024-09-25T05:19:35Z)
• Zero-Reference Low-Light Enhancement via Physical Quadruple Priors [58.77377454210244]
  We propose a new zero-reference low-light enhancement framework trainable solely with normal light images. This framework is able to restore our illumination-invariant prior back to images, automatically achieving low-light enhancement.
  arXiv  Detail & Related papers  (2024-03-19T17:36:28Z)
• Improving Underwater Visual Tracking With a Large Scale Dataset and Image Enhancement [70.2429155741593]
  This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT) It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles. We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality. The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
  arXiv  Detail & Related papers  (2023-08-30T07:41:26Z)
• Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking [84.38335117043907]
  We propose a purely passive method to track a person walking in an invisible room by only observing a relay wall. To excavate imperceptible changes in videos of the relay wall, we introduce difference frames as an essential carrier of temporal-local motion messages. To evaluate the proposed method, we build and publish the first dynamic passive NLOS tracking dataset, NLOS-Track.
  arXiv  Detail & Related papers  (2023-03-21T12:18:57Z)
• Tracker Meets Night: A Transformer Enhancer for UAV Tracking [20.74868878876137]
  spatial-channel Transformer-based low-light enhancer is proposed and plugged prior to tracking approaches. To achieve semantic-level low-light enhancement targeting the high-level task, novel spatial-channel attention module is proposed. In the enhancement process, SCT denoises and illuminates nighttime images simultaneously.
  arXiv  Detail & Related papers  (2023-03-20T09:18:52Z)
• AVisT: A Benchmark for Visual Object Tracking in Adverse Visibility [125.77396380698639]
  AVisT is a benchmark for visual tracking in diverse scenarios with adverse visibility. AVisT comprises 120 challenging sequences with 80k annotated frames, spanning 18 diverse scenarios. We benchmark 17 popular and recent trackers on AVisT with detailed analysis of their tracking performance across attributes.
  arXiv  Detail & Related papers  (2022-08-14T17:49:37Z)
• DarkLighter: Light Up the Darkness for UAV Tracking [14.901582782711627]
  This work proposes a low-light image enhancer namely DarkLighter, which dedicates to alleviate the impact of poor illumination and noise. A lightweight map estimation network, i.e., ME-Net, is trained to efficiently estimate illumination maps and noise maps jointly. Experiments are conducted with several SOTA trackers on numerous UAV dark tracking scenes.
  arXiv  Detail & Related papers  (2021-07-30T01:37:24Z)
• All-Day Object Tracking for Unmanned Aerial Vehicle [19.10142725484355]
  This work proposes a novel correlation filter based tracker with illumination adaptive and anti dark capability, namely ADTrack. ADTrack exploits image illuminance information to enable adaptability of the model to the given light condition. This work also constructed one UAV nighttime tracking benchmark UAVDark135, comprising of more than 125k manually annotated frames.
  arXiv  Detail & Related papers  (2021-01-21T05:12:37Z)
• Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks [62.836429958476735]
  We propose a Two-Stream Residual Convolutional Network (TS-RCN) for visual tracking. Our TS-RCN can be integrated with existing deep learning based visual trackers. To further improve the tracking performance, we adopt a "wider" residual network ResNeXt as its feature extraction backbone.
  arXiv  Detail & Related papers  (2020-05-13T19:05:42Z)
• Cooling-Shrinking Attack: Blinding the Tracker with Imperceptible Noises [87.53808756910452]
  A cooling-shrinking attack method is proposed to deceive state-of-the-art SiameseRPN-based trackers. Our method has good transferability and is able to deceive other top-performance trackers such as DaSiamRPN, DaSiamRPN-UpdateNet, and DiMP.
  arXiv  Detail & Related papers  (2020-03-21T07:13:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.