Generalized Lightness Adaptation with Channel Selective Normalization
- URL: http://arxiv.org/abs/2308.13783v1
- Date: Sat, 26 Aug 2023 06:35:32 GMT
- Title: Generalized Lightness Adaptation with Channel Selective Normalization
- Authors: Mingde Yao, Jie Huang, Xin Jin, Ruikang Xu, Shenglong Zhou, Man Zhou,
Zhiwei Xiong
- Abstract summary: Lightness adaptation is vital to the success of image processing to avoid unexpected visual deterioration.
Existing methods typically work well on their trained lightness conditions but perform poorly in unknown ones due to their limited generalization ability.
We propose a novel generalized lightness adaptation algorithm that extends conventional normalization techniques through a channel filtering design.
- Score: 62.71259777447607
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Lightness adaptation is vital to the success of image processing to avoid
unexpected visual deterioration, which covers multiple aspects, e.g., low-light
image enhancement, image retouching, and inverse tone mapping. Existing methods
typically work well on their trained lightness conditions but perform poorly in
unknown ones due to their limited generalization ability. To address this
limitation, we propose a novel generalized lightness adaptation algorithm that
extends conventional normalization techniques through a channel filtering
design, dubbed Channel Selective Normalization (CSNorm). The proposed CSNorm
purposely normalizes the statistics of lightness-relevant channels and keeps
other channels unchanged, so as to improve feature generalization and
discrimination. To optimize CSNorm, we propose an alternating training strategy
that effectively identifies lightness-relevant channels. The model equipped
with our CSNorm only needs to be trained on one lightness condition and can be
well generalized to unknown lightness conditions. Experimental results on
multiple benchmark datasets demonstrate the effectiveness of CSNorm in
enhancing the generalization ability for the existing lightness adaptation
methods. Code is available at https://github.com/mdyao/CSNorm.
Related papers
- Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors [38.96909959677438]
Low-light image enhancement (LIE) aims at precisely and efficiently recovering an image degraded in poor illumination environments.
Recent advanced LIE techniques are using deep neural networks, which require lots of low-normal light image pairs, network parameters, and computational resources.
We devise a novel unsupervised LIE framework based on diffusion priors and lookup tables to achieve efficient low-light image recovery.
arXiv Detail & Related papers (2024-09-27T16:37:27Z) - ALEN: A Dual-Approach for Uniform and Non-Uniform Low-Light Image Enhancement [6.191556429706728]
Inadequate illumination can lead to significant information loss and poor image quality, impacting various applications such as surveillance.
Current enhancement techniques often use specific datasets to enhance low-light images, but still present challenges when adapting to diverse real-world conditions.
The Adaptive Light Enhancement Network (ALEN) is introduced, whose main approach is the use of a classification mechanism to determine whether local or global illumination enhancement is required.
arXiv Detail & Related papers (2024-07-29T05:19:23Z) - CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement [97.95330185793358]
Low-light image enhancement (LLIE) aims to improve low-illumination images.
Existing methods face two challenges: uncertainty in restoration from diverse brightness degradations and loss of texture and color information.
We propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement.
arXiv Detail & Related papers (2024-04-08T07:34:39Z) - Diving into Darkness: A Dual-Modulated Framework for High-Fidelity
Super-Resolution in Ultra-Dark Environments [51.58771256128329]
This paper proposes a specialized dual-modulated learning framework that attempts to deeply dissect the nature of the low-light super-resolution task.
We develop Illuminance-Semantic Dual Modulation (ISDM) components to enhance feature-level preservation of illumination and color details.
Comprehensive experiments showcases the applicability and generalizability of our approach to diverse and challenging ultra-low-light conditions.
arXiv Detail & Related papers (2023-09-11T06:55:32Z) - Low-Light Image Enhancement with Illumination-Aware Gamma Correction and
Complete Image Modelling Network [69.96295927854042]
Low-light environments usually lead to less informative large-scale dark areas.
We propose to integrate the effectiveness of gamma correction with the strong modelling capacities of deep networks.
Because exponential operation introduces high computational complexity, we propose to use Taylor Series to approximate gamma correction.
arXiv Detail & Related papers (2023-08-16T08:46:51Z) - Self-Reference Deep Adaptive Curve Estimation for Low-Light Image
Enhancement [7.253235412867934]
We propose a 2-stage low-light image enhancement method called Self-Reference Deep Adaptive Curve Estimation (Self-DACE)
In the first stage, we present an intuitive, lightweight, fast, and unsupervised luminance enhancement algorithm.
We also propose a new loss function with a simplified physical model designed to preserve natural images' color, structure, and fidelity.
arXiv Detail & Related papers (2023-08-16T07:57:35Z) - Low-light Image and Video Enhancement via Selective Manipulation of
Chromaticity [1.4680035572775534]
We present a simple yet effective approach for low-light image and video enhancement.
The above adaptivity allows us to avoid the costly step of low-light image decomposition into illumination and reflectance.
Our results on standard lowlight image datasets show the efficacy of our algorithm and its qualitative and quantitative superiority over several state-of-the-art techniques.
arXiv Detail & Related papers (2022-03-09T17:01:28Z) - Low-light Image Enhancement by Retinex Based Algorithm Unrolling and
Adjustment [50.13230641857892]
We propose a new deep learning framework for the low-light image enhancement (LIE) problem.
The proposed framework contains a decomposition network inspired by algorithm unrolling, and adjustment networks considering both global brightness and local brightness sensitivity.
Experiments on a series of typical LIE datasets demonstrated the effectiveness of the proposed method, both quantitatively and visually, as compared with existing methods.
arXiv Detail & Related papers (2022-02-12T03:59:38Z) - Preconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for
Image Restoration [54.23646128082018]
We extend the concept of plug-and-play optimization to use denoisers that can be parameterized for non-constant noise variance.
We show that our pixel-wise adjustable denoiser, along with a suitable preconditioning strategy, can further improve the plug-and-play ADMM approach for several applications.
arXiv Detail & Related papers (2021-10-01T15:46:35Z) - ALCN: Adaptive Local Contrast Normalization [31.703987699518102]
We propose a novel illumination normalization method that can easily be used for different problems with challenging illumination conditions.
We show that our method significantly outperforms standard normalization methods and would also be appear to be universal since it does not have to be re-trained for each new application.
arXiv Detail & Related papers (2020-04-15T13:40:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.