Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement

• URL: http://arxiv.org/abs/2302.11831v1
• Date: Thu, 23 Feb 2023 07:43:41 GMT
• Title: Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement
• Authors: Chongyi Li and Chun-Le Guo and Man Zhou and Zhexin Liang and Shangchen Zhou and Ruicheng Feng and Chen Change Loy
• Abstract summary: Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. We propose a new solution, UHDFour, that embeds Fourier transform into a cascaded network. We also contribute the first real UHD LLIE dataset, textbfUHD-LL, that contains 2,150 low-noise/normal-clear 4K image pairs.
• Score: 78.67036949708795
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. The new standard unveils many issues in existing approaches for low-light image enhancement (LLIE), especially in dealing with the intricate issue of joint luminance enhancement and noise removal while remaining efficient. Unlike existing methods that address the problem in the spatial domain, we propose a new solution, UHDFour, that embeds Fourier transform into a cascaded network. Our approach is motivated by a few unique characteristics in the Fourier domain: 1) most luminance information concentrates on amplitudes while noise is closely related to phases, and 2) a high-resolution image and its low-resolution version share similar amplitude patterns.Through embedding Fourier into our network, the amplitude and phase of a low-light image are separately processed to avoid amplifying noise when enhancing luminance. Besides, UHDFour is scalable to UHD images by implementing amplitude and phase enhancement under the low-resolution regime and then adjusting the high-resolution scale with few computations. We also contribute the first real UHD LLIE dataset, \textbf{UHD-LL}, that contains 2,150 low-noise/normal-clear 4K image pairs with diverse darkness and noise levels captured in different scenarios. With this dataset, we systematically analyze the performance of existing LLIE methods for processing UHD images and demonstrate the advantage of our solution. We believe our new framework, coupled with the dataset, would push the frontier of LLIE towards UHD. The code and dataset are available at https://li-chongyi.github.io/UHDFour.

Related papers

• Dropout the High-rate Downsampling: A Novel Design Paradigm for UHD Image Restoration [11.866565346920781]
  D2Net enables direct full-resolution inference on Ultra-high-definition (UHD) images. We show that our model achieves better quantitative and qualitative results than state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-11-10T13:05:36Z)
• Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancement [7.891750065129094]
  We propose Wave-Mamba, a novel approach based on two pivotal insights derived from the wavelet domain. Our method has demonstrated superior performance, significantly outshining current leading techniques.
  arXiv  Detail & Related papers  (2024-08-02T14:01:34Z)
• Towards Ultra-High-Definition Image Deraining: A Benchmark and An Efficient Method [42.331058889312466]
  This paper contributes the first large-scale UHD image deraining dataset, 4K-Rain13k, that contains 13,000 image pairs at 4K resolution. We develop an effective and efficient vision-based architecture (UDR-Mixer) to better solve this task.
  arXiv  Detail & Related papers  (2024-05-27T11:45:08Z)
• Spatial-frequency Dual-Domain Feature Fusion Network for Low-Light Remote Sensing Image Enhancement [49.15531684596958]
  We propose a Dual-Domain Feature Fusion Network (DFFN) for low-light remote sensing image enhancement. The first phase learns amplitude information to restore image brightness, and the second phase learns phase information to refine details. We have constructed two dark light remote sensing datasets to address the current lack of datasets in dark light remote sensing image enhancement.
  arXiv  Detail & Related papers  (2024-04-26T13:21:31Z)
• You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement [50.37253008333166]
  Low-Light Image Enhancement (LLIE) task tends to restore the details and visual information from corrupted low-light images. We propose a novel trainable color space, named Horizontal/Vertical-Intensity (HVI) It not only decouples brightness and color from RGB channels to mitigate the instability during enhancement but also adapts to low-light images in different illumination ranges due to the trainable parameters.
  arXiv  Detail & Related papers  (2024-02-08T16:47:43Z)
• FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information [19.478293277978935]
  We propose a two-stage Fourier-based Low-Light Image Enhancement (LLIE) network (FourLLIE) In the first stage, we improve the lightness of low-light images by estimating the amplitude transform map in the Fourier space. In the second stage, we introduce the Signal-to-Noise-Ratio (SNR) map to provide the prior for integrating the global Fourier frequency and the local spatial information.
  arXiv  Detail & Related papers  (2023-08-06T06:14:14Z)
• Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method [51.30748775681917]
  We consider the task of low-light image enhancement (LLIE) and introduce a large-scale database consisting of images at 4K and 8K resolution. We conduct systematic benchmarking studies and provide a comparison of current LLIE algorithms. As a second contribution, we introduce LLFormer, a transformer-based low-light enhancement method.
  arXiv  Detail & Related papers  (2022-12-22T09:05:07Z)
• Seeing Through The Noisy Dark: Toward Real-world Low-Light Image Enhancement and Denoising [125.56062454927755]
  Real-world low-light environment usually suffer from lower visibility and heavier noise, due to insufficient light or hardware limitation. We propose a novel end-to-end method termed Real-world Low-light Enhancement & Denoising Network (RLED-Net)
  arXiv  Detail & Related papers  (2022-10-02T14:57:23Z)
• CERL: A Unified Optimization Framework for Light Enhancement with Realistic Noise [81.47026986488638]
  Low-light images captured in the real world are inevitably corrupted by sensor noise. Existing light enhancement methods either overlook the important impact of real-world noise during enhancement, or treat noise removal as a separate pre- or post-processing step. We present Coordinated Enhancement for Real-world Low-light Noisy Images (CERL), that seamlessly integrates light enhancement and noise suppression parts into a unified and physics-grounded framework.
  arXiv  Detail & Related papers  (2021-08-01T15:31:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.