Dimma: Semi-supervised Low Light Image Enhancement with Adaptive Dimming

• URL: http://arxiv.org/abs/2310.09633v1
• Date: Sat, 14 Oct 2023 17:59:46 GMT
• Title: Dimma: Semi-supervised Low Light Image Enhancement with Adaptive Dimming
• Authors: Wojciech Koz{\l}owski, Micha{\l} Szachniewicz, Micha{\l} Stypu{\l}kowski, Maciej Zi\k{e}ba
• Abstract summary: Enhancing low-light images while maintaining natural colors is a challenging problem due to camera processing variations. We propose Dimma, a semi-supervised approach that aligns with any camera by utilizing a small set of image pairs. We achieve that by introducing a convolutional mixture density network that generates distorted colors of the scene based on the illumination differences.
• Score: 0.728258471592763
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Enhancing low-light images while maintaining natural colors is a challenging problem due to camera processing variations and limited access to photos with ground-truth lighting conditions. The latter is a crucial factor for supervised methods that achieve good results on paired datasets but do not handle out-of-domain data well. On the other hand, unsupervised methods, while able to generalize, often yield lower-quality enhancements. To fill this gap, we propose Dimma, a semi-supervised approach that aligns with any camera by utilizing a small set of image pairs to replicate scenes captured under extreme lighting conditions taken by that specific camera. We achieve that by introducing a convolutional mixture density network that generates distorted colors of the scene based on the illumination differences. Additionally, our approach enables accurate grading of the dimming factor, which provides a wide range of control and flexibility in adjusting the brightness levels during the low-light image enhancement process. To further improve the quality of our results, we introduce an architecture based on a conditional UNet. The lightness value provided by the user serves as the conditional input to generate images with the desired lightness. Our approach using only few image pairs achieves competitive results compared to fully supervised methods. Moreover, when trained on the full dataset, our model surpasses state-of-the-art methods in some metrics and closely approaches them in others.

Related papers

• ALEN: A Dual-Approach for Uniform and Non-Uniform Low-Light Image Enhancement [6.191556429706728]
  Inadequate illumination can lead to significant information loss and poor image quality, impacting various applications such as surveillance. Current enhancement techniques often use specific datasets to enhance low-light images, but still present challenges when adapting to diverse real-world conditions. The Adaptive Light Enhancement Network (ALEN) is introduced, whose main approach is the use of a classification mechanism to determine whether local or global illumination enhancement is required.
  arXiv  Detail & Related papers  (2024-07-29T05:19:23Z)
• A Non-Uniform Low-Light Image Enhancement Method with Multi-Scale Attention Transformer and Luminance Consistency Loss [11.585269110131659]
  Low-light image enhancement aims to improve the perception of images collected in dim environments. Existing methods cannot adaptively extract the differentiated luminance information, which will easily cause over-exposure and under-exposure. We propose a multi-scale attention Transformer named MSATr, which sufficiently extracts local and global features for light balance to improve the visual quality.
  arXiv  Detail & Related papers  (2023-12-27T10:07:11Z)
• Diving into Darkness: A Dual-Modulated Framework for High-Fidelity Super-Resolution in Ultra-Dark Environments [51.58771256128329]
  This paper proposes a specialized dual-modulated learning framework that attempts to deeply dissect the nature of the low-light super-resolution task. We develop Illuminance-Semantic Dual Modulation (ISDM) components to enhance feature-level preservation of illumination and color details. Comprehensive experiments showcases the applicability and generalizability of our approach to diverse and challenging ultra-low-light conditions.
  arXiv  Detail & Related papers  (2023-09-11T06:55:32Z)
• Fearless Luminance Adaptation: A Macro-Micro-Hierarchical Transformer for Exposure Correction [65.5397271106534]
  A single neural network is difficult to handle all exposure problems. In particular, convolutions hinder the ability to restore faithful color or details on extremely over-/under- exposed regions. We propose a Macro-Micro-Hierarchical transformer, which consists of a macro attention to capture long-range dependencies, a micro attention to extract local features, and a hierarchical structure for coarse-to-fine correction.
  arXiv  Detail & Related papers  (2023-09-02T09:07:36Z)
• Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Network [69.96295927854042]
  Low-light environments usually lead to less informative large-scale dark areas. We propose to integrate the effectiveness of gamma correction with the strong modelling capacities of deep networks. Because exponential operation introduces high computational complexity, we propose to use Taylor Series to approximate gamma correction.
  arXiv  Detail & Related papers  (2023-08-16T08:46:51Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• CuDi: Curve Distillation for Efficient and Controllable Exposure Adjustment [86.97592472794724]
  We present Curve Distillation, CuDi, for efficient and controllable exposure adjustment without the requirement of paired or unpaired data. Our method inherits the zero-reference learning and curve-based framework from an effective low-light image enhancement method, Zero-DCE. We show that our method is appealing for its fast, robust, and flexible performance, outperforming state-of-the-art methods in real scenes.
  arXiv  Detail & Related papers  (2022-07-28T17:53:46Z)
• Progressive Joint Low-light Enhancement and Noise Removal for Raw Images [10.778200442212334]
  Low-light imaging on mobile devices is typically challenging due to insufficient incident light coming through the relatively small aperture. We propose a low-light image processing framework that performs joint illumination adjustment, color enhancement, and denoising. Our framework does not need to recollect massive data when being adapted to another camera model.
  arXiv  Detail & Related papers  (2021-06-28T16:43:52Z)
• Adaptive Enhancement of Extreme Low-Light Images [4.511923587827301]
  We create a dataset of 1500 raw images taken in both indoor and outdoor low-light conditions. We introduce a deep learning model capable of enhancing input images with a wide range of intensity levels at runtime. Our experimental results demonstrate that our proposed dataset combined with our model can consistently and effectively enhance images.
  arXiv  Detail & Related papers  (2020-12-07T23:31:59Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.