MSR-Net: Multi-Scale Relighting Network for One-to-One Relighting

• URL: http://arxiv.org/abs/2107.06125v1
• Date: Tue, 13 Jul 2021 14:25:05 GMT
• Title: MSR-Net: Multi-Scale Relighting Network for One-to-One Relighting
• Authors: Sourya Dipta Das, Nisarg A. Shah, Saikat Dutta
• Abstract summary: Deep image relighting allows photo enhancement by illumination-specific retouching without human effort. Most of the existing popular methods available for relighting are run-time intensive and memory inefficient. We propose the use of Stacked Deep Multi-Scale Hierarchical Network, which aggregates features from each image at different scales.
• Score: 6.544716087553996
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep image relighting allows photo enhancement by illumination-specific retouching without human effort and so it is getting much interest lately. Most of the existing popular methods available for relighting are run-time intensive and memory inefficient. Keeping these issues in mind, we propose the use of Stacked Deep Multi-Scale Hierarchical Network, which aggregates features from each image at different scales. Our solution is differentiable and robust for translating image illumination setting from input image to target image. Additionally, we have also shown that using a multi-step training approach to this problem with two different loss functions can significantly boost performance and can achieve a high quality reconstruction of a relighted image.

Related papers

• CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement [97.95330185793358]
  Low-light image enhancement (LLIE) aims to improve low-illumination images. Existing methods face two challenges: uncertainty in restoration from diverse brightness degradations and loss of texture and color information. We propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement.
  arXiv  Detail & Related papers  (2024-04-08T07:34:39Z)
• Unified-Width Adaptive Dynamic Network for All-In-One Image Restoration [50.81374327480445]
  We introduce a novel concept positing that intricate image degradation can be represented in terms of elementary degradation. We propose the Unified-Width Adaptive Dynamic Network (U-WADN), consisting of two pivotal components: a Width Adaptive Backbone (WAB) and a Width Selector (WS) The proposed U-WADN achieves better performance while simultaneously reducing up to 32.3% of FLOPs and providing approximately 15.7% real-time acceleration.
  arXiv  Detail & Related papers  (2024-01-24T04:25:12Z)
• Exposure Bracketing is All You Need for Unifying Image Restoration and Enhancement Tasks [50.822601495422916]
  We propose to utilize exposure bracketing photography to unify image restoration and enhancement tasks. Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data. In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed.
  arXiv  Detail & Related papers  (2024-01-01T14:14:35Z)
• A Non-Uniform Low-Light Image Enhancement Method with Multi-Scale Attention Transformer and Luminance Consistency Loss [11.585269110131659]
  Low-light image enhancement aims to improve the perception of images collected in dim environments. Existing methods cannot adaptively extract the differentiated luminance information, which will easily cause over-exposure and under-exposure. We propose a multi-scale attention Transformer named MSATr, which sufficiently extracts local and global features for light balance to improve the visual quality.
  arXiv  Detail & Related papers  (2023-12-27T10:07:11Z)
• Simplifying Low-Light Image Enhancement Networks with Relative Loss Functions [14.63586364951471]
  We introduce FLW-Net (Fast and LightWeight Network) and two relative loss functions to make learning easier in low-light image enhancement. We first recognize the challenges of the need for a large receptive field to obtain global contrast. Then, we propose an efficient global feature information extraction component and two loss functions based on relative information to overcome these challenges.
  arXiv  Detail & Related papers  (2023-04-06T10:05:54Z)
• Controllable Image Enhancement [66.18525728881711]
  We present a semiautomatic image enhancement algorithm that can generate high-quality images with multiple styles by controlling a few parameters. An encoder-decoder framework encodes the retouching skills into latent codes and decodes them into the parameters of image signal processing functions.
  arXiv  Detail & Related papers  (2022-06-16T23:54:53Z)
• Invertible Network for Unpaired Low-light Image Enhancement [78.33382003460903]
  We propose to leverage the invertible network to enhance low-light image in forward process and degrade the normal-light one inversely with unpaired learning. In addition to the adversarial loss, we design various loss functions to ensure the stability of training and preserve more image details. We present a progressive self-guided enhancement process for low-light images and achieve favorable performance against the SOTAs.
  arXiv  Detail & Related papers  (2021-12-24T17:00:54Z)
• ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancement [21.680891925479195]
  Low-light image enhancement (LLIE) is a pervasive yet challenging problem. This paper presents a novel deep reinforcement learning based method, dubbed ReLLIE, for customized low-light enhancement.
  arXiv  Detail & Related papers  (2021-07-13T03:36:30Z)
• Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement [52.49231695707198]
  We investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps. Inspired by the color image formulation, we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color. Our proposed method has surpassed the SOTA by 0.95dB in PSNR on LOL1000 dataset and 3.18% in mAP on ExDark dataset.
  arXiv  Detail & Related papers  (2021-03-19T04:00:27Z)
• DSRN: an Efficient Deep Network for Image Relighting [8.346635942881722]
  Deep image relighting allows automatic photo enhancement by illumination-specific retouching. In this paper, we propose an efficient, real-time framework Deep Stacked Relighting Network (DSRN) for image relighting. Our model is very lightweight with total size of about 42 MB and has an average inference time of about 0.0116s for image of resolution $1024 times 1024$.
  arXiv  Detail & Related papers  (2021-02-18T09:54:15Z)
• Shed Various Lights on a Low-Light Image: Multi-Level Enhancement Guided by Arbitrary References [17.59529931863947]
  This paper proposes a neural network for multi-level low-light image enhancement. Inspired by style transfer, our method decomposes an image into two low-coupling feature components in the latent space. In such a way, the network learns to extract scene-invariant and brightness-specific information from a set of image pairs.
  arXiv  Detail & Related papers  (2021-01-04T07:38:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.