Low-Light Image Enhancement via Structure Modeling and Guidance

• URL: http://arxiv.org/abs/2305.05839v1
• Date: Wed, 10 May 2023 02:08:22 GMT
• Title: Low-Light Image Enhancement via Structure Modeling and Guidance
• Authors: Xiaogang Xu, Ruixing Wang, Jiangbo Lu
• Abstract summary: This paper proposes a new framework for low-light image enhancement by simultaneously conducting the appearance and structure modeling. The structure modeling in our framework is implemented as the edge detection in low-light images. To improve the appearance modeling, which is implemented with a simple U-Net, a novel structure-guided enhancement module is proposed.
• Score: 13.375551436077423
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a new framework for low-light image enhancement by simultaneously conducting the appearance as well as structure modeling. It employs the structural feature to guide the appearance enhancement, leading to sharp and realistic results. The structure modeling in our framework is implemented as the edge detection in low-light images. It is achieved with a modified generative model via designing a structure-aware feature extractor and generator. The detected edge maps can accurately emphasize the essential structural information, and the edge prediction is robust towards the noises in dark areas. Moreover, to improve the appearance modeling, which is implemented with a simple U-Net, a novel structure-guided enhancement module is proposed with structure-guided feature synthesis layers. The appearance modeling, edge detector, and enhancement module can be trained end-to-end. The experiments are conducted on representative datasets (sRGB and RAW domains), showing that our model consistently achieves SOTA performance on all datasets with the same architecture.

Related papers

• Mesh Mamba: A Unified State Space Model for Saliency Prediction in Non-Textured and Textured Meshes [50.23625950905638]
  Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. We introduce mesh Mamba, a unified saliency prediction model based on a state space model (SSM) Mesh Mamba effectively analyzes the geometric structure of the mesh while seamlessly incorporating texture features into the topological framework.
  arXiv  Detail & Related papers  (2025-04-02T08:22:25Z)
• HRR: Hierarchical Retrospection Refinement for Generated Image Detection [16.958383381415445]
  We propose a diffusion model-based generative image detection framework termed Hierarchical Retrospection Refinement(HRR) The HRR framework consistently delivers significant performance improvements, outperforming state-of-the-art methods in generated image detection task.
  arXiv  Detail & Related papers  (2025-02-25T05:13:44Z)
• Windowed-FourierMixer: Enhancing Clutter-Free Room Modeling with Fourier Transform [3.864321514889099]
  Inpainting indoor environments from a single image plays a crucial role in modeling the internal structure of interior spaces. We propose an innovative approach based on a U-Former architecture and a new Windowed-FourierMixer block. This new architecture proves advantageous for tasks involving indoor scenes where symmetry is prevalent.
  arXiv  Detail & Related papers  (2024-02-28T12:27:28Z)
• Improving Few-shot Image Generation by Structural Discrimination and Textural Modulation [10.389698647141296]
  Few-shot image generation aims to produce plausible and diverse images for one category given a few images from this category. Existing approaches either globally interpolate different images or fuse local representations with pre-defined coefficients. This paper proposes a novel mechanism to inject external semantic signals into internal local representations.
  arXiv  Detail & Related papers  (2023-08-30T16:10:21Z)
• Semantic-aware Texture-Structure Feature Collaboration for Underwater Image Enhancement [58.075720488942125]
  Underwater image enhancement has become an attractive topic as a significant technology in marine engineering and aquatic robotics. We develop an efficient and compact enhancement network in collaboration with a high-level semantic-aware pretrained model. We also apply the proposed algorithm to the underwater salient object detection task to reveal the favorable semantic-aware ability for high-level vision tasks.
  arXiv  Detail & Related papers  (2022-11-19T07:50:34Z)
• SIM-Trans: Structure Information Modeling Transformer for Fine-grained Visual Categorization [59.732036564862796]
  We propose the Structure Information Modeling Transformer (SIM-Trans) to incorporate object structure information into transformer for enhancing discriminative representation learning. The proposed two modules are light-weighted and can be plugged into any transformer network and trained end-to-end easily. Experiments and analyses demonstrate that the proposed SIM-Trans achieves state-of-the-art performance on fine-grained visual categorization benchmarks.
  arXiv  Detail & Related papers  (2022-08-31T03:00:07Z)
• Real Image Restoration via Structure-preserving Complementarity Attention [10.200625895876023]
  We propose a novel lightweight Complementary Attention Module, which includes a density module and a sparse module. To reduce the loss of details caused by denoising, this paper constructs a gradient-based structure-preserving branch.
  arXiv  Detail & Related papers  (2022-07-28T04:24:20Z)
• Dynamically Grown Generative Adversarial Networks [111.43128389995341]
  We propose a method to dynamically grow a GAN during training, optimizing the network architecture and its parameters together with automation. The method embeds architecture search techniques as an interleaving step with gradient-based training to periodically seek the optimal architecture-growing strategy for the generator and discriminator.
  arXiv  Detail & Related papers  (2021-06-16T01:25:51Z)
• Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement [58.72667941107544]
  We propose Retinex-inspired Unrolling with Architecture Search (RUAS) to construct lightweight yet effective enhancement network for low-light images. RUAS is able to obtain a top-performing image enhancement network, which is with fast speed and requires few computational resources.
  arXiv  Detail & Related papers  (2020-12-10T11:51:23Z)
• S2RMs: Spatially Structured Recurrent Modules [105.0377129434636]
  We take a step towards exploiting dynamic structure that are capable of simultaneously exploiting both modular andtemporal structures. We find our models to be robust to the number of available views and better capable of generalization to novel tasks without additional training.
  arXiv  Detail & Related papers  (2020-07-13T17:44:30Z)
• Region-adaptive Texture Enhancement for Detailed Person Image Synthesis [86.69934638569815]
  RATE-Net is a novel framework for synthesizing person images with sharp texture details. The proposed framework leverages an additional texture enhancing module to extract appearance information from the source image. Experiments conducted on DeepFashion benchmark dataset have demonstrated the superiority of our framework compared with existing networks.
  arXiv  Detail & Related papers  (2020-05-26T02:33:21Z)
• Spectrally Consistent UNet for High Fidelity Image Transformations [5.494315657902533]
  Convolutional Neural Networks (CNNs) are the current de-facto models used for many imaging tasks. In this work, a method for assessing the structural biases of UNets and the effects these have on the outputs is presented. A new upsampling module is proposed, based on a novel use of the Guided Image Filter, that provides spectrally consistent outputs.
  arXiv  Detail & Related papers  (2020-04-22T17:04:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.