NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset

• URL: http://arxiv.org/abs/2110.10364v1
• Date: Wed, 20 Oct 2021 03:44:04 GMT
• Title: NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset
• Authors: Igor Morawski, Yu-An Chen, Yu-Sheng Lin, Winston H. Hsu
• Abstract summary: Low light proves more difficult for machine cognition than previously thought. We present a large-scale dataset showing dynamic scenes captured on the streets at night. We propose to incorporate an image enhancement module into the object detection framework and two novel data augmentation techniques.
• Score: 25.29013780731876
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recent work indicates that, besides being a challenge in producing perceptually pleasing images, low light proves more difficult for machine cognition than previously thought. In our work, we take a closer look at object detection in low light. First, to support the development and evaluation of new methods in this domain, we present a high-quality large-scale Night Object Detection (NOD) dataset showing dynamic scenes captured on the streets at night. Next, we directly link the lighting conditions to perceptual difficulty and identify what makes low light problematic for machine cognition. Accordingly, we provide instance-level annotation for a subset of the dataset for an in-depth evaluation of future methods. We also present an analysis of the baseline model performance to highlight opportunities for future research and show that low light is a non-trivial problem that requires special attention from the researchers. Further, to address the issues caused by low light, we propose to incorporate an image enhancement module into the object detection framework and two novel data augmentation techniques. Our image enhancement module is trained under the guidance of the object detector to learn image representation optimal for machine cognition rather than for the human visual system. Finally, experimental results confirm that the proposed method shows consistent improvement of the performance on low-light datasets.

Related papers

• HUE Dataset: High-Resolution Event and Frame Sequences for Low-Light Vision [16.432164340779266]
  We introduce the HUE dataset, a collection of high-resolution event and frame sequences captured in low-light conditions. Our dataset includes 106 sequences, encompassing indoor, cityscape, twilight, night, driving, and controlled scenarios. We employ both qualitative and quantitative evaluations to assess state-of-the-art low-light enhancement and event-based image reconstruction methods.
  arXiv  Detail & Related papers  (2024-10-24T21:15:15Z)
• Low-Light Enhancement Effect on Classification and Detection: An Empirical Study [48.6762437869172]
  We evaluate the impact of Low-Light Image Enhancement (LLIE) methods on high-level vision tasks. Our findings suggest a disconnect between image enhancement for human visual perception and for machine analysis. This insight is crucial for the development of LLIE techniques that align with the needs of both human and machine vision.
  arXiv  Detail & Related papers  (2024-09-22T14:21:31Z)
• Boosting Object Detection with Zero-Shot Day-Night Domain Adaptation [33.142262765252795]
  Detectors trained on well-lit data exhibit significant performance degradation on low-light data due to low visibility. We propose to boost low-light object detection with zero-shot day-night domain adaptation. Our method generalizes a detector from well-lit scenarios to low-light ones without requiring real low-light data.
  arXiv  Detail & Related papers  (2023-12-02T20:11:48Z)
• Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection [55.2480439325792]
  We present an in-depth evaluation of an object detection model that integrates the LSKNet backbone with the DiffusionDet head. The proposed model achieves a mean average precision (MAP) of approximately 45.7%, which is a significant improvement. This advancement underscores the effectiveness of the proposed modifications and sets a new benchmark in aerial image analysis.
  arXiv  Detail & Related papers  (2023-11-21T19:49:13Z)
• Visibility Enhancement for Low-light Hazy Scenarios [18.605784907840473]
  Low-light hazy scenes commonly appear at dusk and early morning. We propose a novel method to enhance visibility for low-light hazy scenarios. The framework is designed for enhancing visibility of the input image via fully utilizing the clues from different sub-tasks. The simulation is designed for generating the dataset with ground-truths by the proposed low-light hazy imaging model.
  arXiv  Detail & Related papers  (2023-08-01T15:07:38Z)
• Human Pose Estimation in Extremely Low-Light Conditions [21.210706205233286]
  We develop a dedicated camera system and build a new dataset of real low-light images with accurate pose labels. Thanks to our camera system, each low-light image in our dataset is coupled with an aligned well-lit image, which enables accurate pose labeling. We also propose a new model and a new training strategy that fully exploit the privileged information to learn representation insensitive to lighting conditions.
  arXiv  Detail & Related papers  (2023-03-27T17:28:25Z)
• Enhancing Low-Light Images in Real World via Cross-Image Disentanglement [58.754943762945864]
  We propose a new low-light image enhancement dataset consisting of misaligned training images with real-world corruptions. Our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets.
  arXiv  Detail & Related papers  (2022-01-10T03:12:52Z)
• Lighting the Darkness in the Deep Learning Era [118.35081853500411]
  Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions. We provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues.
  arXiv  Detail & Related papers  (2021-04-21T19:12:19Z)
• Exploring Image Enhancement for Salient Object Detection in Low Light Images [27.61080096436953]
  We propose an image enhancement approach to facilitate the salient object detection in low light images. The proposed model embeds the physical lighting model into the deep neural network to describe the degradation of low light images. We construct a low light Images dataset with pixel-level human-labeled ground-truth annotations and report promising results.
  arXiv  Detail & Related papers  (2020-07-31T15:09:03Z)
• Deep Bilateral Retinex for Low-Light Image Enhancement [96.15991198417552]
  Low-light images suffer from poor visibility caused by low contrast, color distortion and measurement noise. This paper proposes a deep learning method for low-light image enhancement with a particular focus on handling the measurement noise. The proposed method is very competitive to the state-of-the-art methods, and has significant advantage over others when processing images captured in extremely low lighting conditions.
  arXiv  Detail & Related papers  (2020-07-04T06:26:44Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.