Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancement

• URL: http://arxiv.org/abs/2408.01276v1
• Date: Fri, 2 Aug 2024 14:01:34 GMT
• Title: Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancement
• Authors: Wenbin Zou, Hongxia Gao, Weipeng Yang, Tongtong Liu,
• Abstract summary: We propose Wave-Mamba, a novel approach based on two pivotal insights derived from the wavelet domain. Our method has demonstrated superior performance, significantly outshining current leading techniques.
• Score: 7.891750065129094
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ultra-high-definition (UHD) technology has attracted widespread attention due to its exceptional visual quality, but it also poses new challenges for low-light image enhancement (LLIE) techniques. UHD images inherently possess high computational complexity, leading existing UHD LLIE methods to employ high-magnification downsampling to reduce computational costs, which in turn results in information loss. The wavelet transform not only allows downsampling without loss of information, but also separates the image content from the noise. It enables state space models (SSMs) to avoid being affected by noise when modeling long sequences, thus making full use of the long-sequence modeling capability of SSMs. On this basis, we propose Wave-Mamba, a novel approach based on two pivotal insights derived from the wavelet domain: 1) most of the content information of an image exists in the low-frequency component, less in the high-frequency component. 2) The high-frequency component exerts a minimal influence on the outcomes of low-light enhancement. Specifically, to efficiently model global content information on UHD images, we proposed a low-frequency state space block (LFSSBlock) by improving SSMs to focus on restoring the information of low-frequency sub-bands. Moreover, we propose a high-frequency enhance block (HFEBlock) for high-frequency sub-band information, which uses the enhanced low-frequency information to correct the high-frequency information and effectively restore the correct high-frequency details. Through comprehensive evaluation, our method has demonstrated superior performance, significantly outshining current leading techniques while maintaining a more streamlined architecture. The code is available at https://github.com/AlexZou14/Wave-Mamba.

Related papers

• High-Frequency Enhanced Hybrid Neural Representation for Video Compression [32.38933743785333]
  This paper introduces a High-Frequency Enhanced Hybrid Neural Representation Network. Our method focuses on leveraging high-frequency information to improve the synthesis of fine details by the network. Experiments on the Bunny and UVG datasets demonstrate that our method outperforms other methods.
  arXiv  Detail & Related papers  (2024-11-11T03:04:46Z)
• Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution [15.610136214020947]
  Implicit neural representations have recently demonstrated promising potential in arbitrary-scale Super-Resolution (SR) of images. Most existing methods predict the pixel in the SR image based on the queried coordinate and ensemble nearby features. We propose the Local Implicit Wavelet Transformer (LIWT) to enhance the restoration of high-frequency texture details.
  arXiv  Detail & Related papers  (2024-11-10T12:21:14Z)
• WaveDH: Wavelet Sub-bands Guided ConvNet for Efficient Image Dehazing [20.094839751816806]
  We introduce WaveDH, a novel and compact ConvNet designed to address this efficiency gap in image dehazing. Our WaveDH leverages wavelet sub-bands for guided up-and-downsampling and frequency-aware feature refinement. Our method, WaveDH, outperforms many state-of-the-art methods on several image dehazing benchmarks with significantly reduced computational costs.
  arXiv  Detail & Related papers  (2024-04-02T02:52:05Z)
• Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restoration [6.185197290440237]
  We introduce WF-Diff, designed to fully leverage the characteristics of frequency domain information and diffusion models. WF-Diff consists of two detachable networks: Wavelet-based Fourier information interaction network (WFI2-net) and Frequency Residual Diffusion Adjustment Module (FRDAM) Our algorithm can show SOTA performance on real-world underwater image datasets, and achieves competitive performance in visual quality.
  arXiv  Detail & Related papers  (2023-11-28T14:58:32Z)
• WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields [149.2296890464997]
  We design WaveNeRF, which integrates wavelet frequency decomposition into MVS and NeRF. WaveNeRF achieves superior generalizable radiance field modeling when only given three images as input.
  arXiv  Detail & Related papers  (2023-08-09T09:24:56Z)
• A High-Frequency Focused Network for Lightweight Single Image Super-Resolution [16.264904771818507]
  High-frequency detail is much more difficult to reconstruct than low-frequency information. Most SISR models allocate equal computational resources for low-frequency and high-frequency information. We propose a novel High-Frequency Focused Network (HFFN) that selectively enhance high-frequency information.
  arXiv  Detail & Related papers  (2023-03-21T09:41:13Z)
• Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement [78.67036949708795]
  Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. We propose a new solution, UHDFour, that embeds Fourier transform into a cascaded network. We also contribute the first real UHD LLIE dataset, textbfUHD-LL, that contains 2,150 low-noise/normal-clear 4K image pairs.
  arXiv  Detail & Related papers  (2023-02-23T07:43:41Z)
• Low-Light Hyperspectral Image Enhancement [90.84144276935464]
  This work focuses on the low-light HSI enhancement task, which aims to reveal the spatial-spectral information hidden in darkened areas. Based on Laplacian pyramid decomposition and reconstruction, we developed an end-to-end data-driven low-light HSI enhancement (HSIE) approach. The effectiveness and efficiency of HSIE both in quantitative assessment measures and visual effects are demonstrated.
  arXiv  Detail & Related papers  (2022-08-05T08:45:52Z)
• Inception Transformer [151.939077819196]
  Inception Transformer, or iFormer, learns comprehensive features with both high- and low-frequency information in visual data. We benchmark the iFormer on a series of vision tasks, and showcase that it achieves impressive performance on image classification, COCO detection and ADE20K segmentation.
  arXiv  Detail & Related papers  (2022-05-25T17:59:54Z)
• Wavelet-Based Network For High Dynamic Range Imaging [64.66969585951207]
  Existing methods, such as optical flow based and end-to-end deep learning based solutions, are error-prone either in detail restoration or ghosting artifacts removal. In this work, we propose a novel frequency-guided end-to-end deep neural network (FNet) to conduct HDR fusion in the frequency domain, and Wavelet Transform (DWT) is used to decompose inputs into different frequency bands. The low-frequency signals are used to avoid specific ghosting artifacts, while the high-frequency signals are used for preserving details.
  arXiv  Detail & Related papers  (2021-08-03T12:26:33Z)
• Wavelet Integrated CNNs for Noise-Robust Image Classification [51.18193090255933]
  We enhance CNNs by replacing max-pooling, strided-convolution, and average-pooling with Discrete Wavelet Transform (DWT) WaveCNets, the wavelet integrated versions of VGG, ResNets, and DenseNet, achieve higher accuracy and better noise-robustness than their vanilla versions.
  arXiv  Detail & Related papers  (2020-05-07T09:10:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.