A Comprehensive Study of Object Tracking in Low-Light Environments

• URL: http://arxiv.org/abs/2312.16250v2
• Date: Wed, 3 Jan 2024 13:59:14 GMT
• Title: A Comprehensive Study of Object Tracking in Low-Light Environments
• Authors: Anqi Yi and Nantheera Anantrasirichai
• Abstract summary: This paper examines the impact of noise, color imbalance, and low contrast on automatic object trackers. We propose a solution to enhance tracking performance by integrating denoising and low-light enhancement methods. Experimental results show that the proposed tracker, trained with low-light synthetic datasets, outperforms both the vanilla MixFormer and Siam R-CNN.
• Score: 3.508168174653255
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate object tracking in low-light environments is crucial, particularly in surveillance and ethology applications. However, achieving this is significantly challenging due to the poor quality of captured sequences. Factors such as noise, color imbalance, and low contrast contribute to these challenges. This paper presents a comprehensive study examining the impact of these distortions on automatic object trackers. Additionally, we propose a solution to enhance tracking performance by integrating denoising and low-light enhancement methods into the transformer-based object tracking system. Experimental results show that the proposed tracker, trained with low-light synthetic datasets, outperforms both the vanilla MixFormer and Siam R-CNN.

Related papers

• HUE Dataset: High-Resolution Event and Frame Sequences for Low-Light Vision [16.432164340779266]
  We introduce the HUE dataset, a collection of high-resolution event and frame sequences captured in low-light conditions. Our dataset includes 106 sequences, encompassing indoor, cityscape, twilight, night, driving, and controlled scenarios. We employ both qualitative and quantitative evaluations to assess state-of-the-art low-light enhancement and event-based image reconstruction methods.
  arXiv  Detail & Related papers  (2024-10-24T21:15:15Z)
• Low-Light Object Tracking: A Benchmark [9.798869093713067]
  We introduce LLOT, a benchmark specifically designed for Low-Light Object Tracking. LLOT comprises 269 challenging sequences with a total of over 132K frames, each carefully annotated with bounding boxes. In response, we propose H-DCPT, a novel tracker that incorporates historical and darkness clue prompts to set a stronger baseline.
  arXiv  Detail & Related papers  (2024-08-21T09:27:57Z)
• Multi-Object Tracking in the Dark [12.463106088827924]
  Low-light scenes are prevalent in real-world applications (e.g. autonomous driving and surveillance at night) In this paper, we focus on multi-object tracking in dark scenes. We propose a low-light multi-object tracking method, termed as LTrack.
  arXiv  Detail & Related papers  (2024-05-10T17:00:04Z)
• Multi-Scale Denoising in the Feature Space for Low-Light Instance Segmentation [2.642212767247493]
  Instance segmentation for low-light imagery remains largely unexplored. Our proposed method implements weighted non-local blocks (wNLB) in the feature extractor. We introduce additional learnable weights at each layer in order to enhance the network's adaptability to real-world noise characteristics.
  arXiv  Detail & Related papers  (2024-02-28T13:07:16Z)
• Robust Tiny Object Detection in Aerial Images amidst Label Noise [50.257696872021164]
  This study addresses the issue of tiny object detection under noisy label supervision. We propose a DeNoising Tiny Object Detector (DN-TOD), which incorporates a Class-aware Label Correction scheme. Our method can be seamlessly integrated into both one-stage and two-stage object detection pipelines.
  arXiv  Detail & Related papers  (2024-01-16T02:14:33Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Low-Light Hyperspectral Image Enhancement [90.84144276935464]
  This work focuses on the low-light HSI enhancement task, which aims to reveal the spatial-spectral information hidden in darkened areas. Based on Laplacian pyramid decomposition and reconstruction, we developed an end-to-end data-driven low-light HSI enhancement (HSIE) approach. The effectiveness and efficiency of HSIE both in quantitative assessment measures and visual effects are demonstrated.
  arXiv  Detail & Related papers  (2022-08-05T08:45:52Z)
• Physics-based Noise Modeling for Extreme Low-light Photography [63.65570751728917]
  We study the noise statistics in the imaging pipeline of CMOS photosensors. We formulate a comprehensive noise model that can accurately characterize the real noise structures. Our noise model can be used to synthesize realistic training data for learning-based low-light denoising algorithms.
  arXiv  Detail & Related papers  (2021-08-04T16:36:29Z)
• Deep Bilateral Retinex for Low-Light Image Enhancement [96.15991198417552]
  Low-light images suffer from poor visibility caused by low contrast, color distortion and measurement noise. This paper proposes a deep learning method for low-light image enhancement with a particular focus on handling the measurement noise. The proposed method is very competitive to the state-of-the-art methods, and has significant advantage over others when processing images captured in extremely low lighting conditions.
  arXiv  Detail & Related papers  (2020-07-04T06:26:44Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.