Revisiting and Optimising a CNN Colour Constancy Method for Multi-Illuminant Estimation

• URL: http://arxiv.org/abs/2211.01946v1
• Date: Thu, 3 Nov 2022 16:33:56 GMT
• Title: Revisiting and Optimising a CNN Colour Constancy Method for Multi-Illuminant Estimation
• Authors: Ghalia Hemrit and Joseph Meehan
• Abstract summary: The aim of colour constancy is to discount the effect of the scene illumination from the image colours and restore the colours of the objects as captured under a 'white' illuminant. We present in this paper a simple yet very effective framework using a deep CNN-based method to estimate and use multiple illuminants for colour constancy.
• Score: 0.76146285961466
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The aim of colour constancy is to discount the effect of the scene illumination from the image colours and restore the colours of the objects as captured under a 'white' illuminant. For the majority of colour constancy methods, the first step is to estimate the scene illuminant colour. Generally, it is assumed that the illumination is uniform in the scene. However, real world scenes have multiple illuminants, like sunlight and spot lights all together in one scene. We present in this paper a simple yet very effective framework using a deep CNN-based method to estimate and use multiple illuminants for colour constancy. Our approach works well in both the multi and single illuminant cases. The output of the CNN method is a region-wise estimate map of the scene which is smoothed and divided out from the image to perform colour constancy. The method that we propose outperforms other recent and state of the art methods and has promising visual results.

Related papers

• Modeling the Lighting in Scenes as Style for Auto White-Balance Correction [3.441021278275805]
  We introduce an enhanced auto white-balance (AWB) method that models the lighting in single- and mixed-illuminant scenes as the style factor. Our AWB method does not require any illumination estimation step, yet contains a network learning to generate the weighting maps of the images. Experiments on single- and mixed-illuminant datasets demonstrate that our proposed method achieves promising correction results.
  arXiv  Detail & Related papers  (2022-10-17T13:35:17Z)
• Physically-Based Editing of Indoor Scene Lighting from a Single Image [106.60252793395104]
  We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. We tackle this problem using two novel components: 1) a holistic scene reconstruction method that estimates scene reflectance and parametric 3D lighting, and 2) a neural rendering framework that re-renders the scene from our predictions.
  arXiv  Detail & Related papers  (2022-05-19T06:44:37Z)
• Neural Radiance Fields for Outdoor Scene Relighting [70.97747511934705]
  We present NeRF-OSR, the first approach for outdoor scene relighting based on neural radiance fields. In contrast to the prior art, our technique allows simultaneous editing of both scene illumination and camera viewpoint. It also includes a dedicated network for shadow reproduction, which is crucial for high-quality outdoor scene relighting.
  arXiv  Detail & Related papers  (2021-12-09T18:59:56Z)
• Auto White-Balance Correction for Mixed-Illuminant Scenes [52.641704254001844]
  Auto white balance (AWB) is applied by camera hardware to remove color cast caused by scene illumination. This paper presents an effective AWB method to deal with such mixed-illuminant scenes. Our method does not require illuminant estimation, as is the case in traditional camera AWB modules.
  arXiv  Detail & Related papers  (2021-09-17T20:13:31Z)
• Generative Models for Multi-Illumination Color Constancy [23.511249515559122]
  We propose a seed (physics driven) based multi-illumination color constancy method. GANs are exploited to model the illumination estimation problem as an image-to-image domain translation problem. Experiments on single and multi-illumination datasets show that our methods outperform sota methods.
  arXiv  Detail & Related papers  (2021-09-02T12:24:40Z)
• Relighting Images in the Wild with a Self-Supervised Siamese Auto-Encoder [62.580345486483886]
  We propose a self-supervised method for image relighting of single view images in the wild. The method is based on an auto-encoder which deconstructs an image into two separate encodings. We train our model on large-scale datasets such as Youtube 8M and CelebA.
  arXiv  Detail & Related papers  (2020-12-11T16:08:50Z)
• The Cube++ Illumination Estimation Dataset [50.58610459038332]
  A new illumination estimation dataset is proposed in this paper. It consists of 4890 images with known illumination colors as well as with additional semantic data. The dataset can be used for training and testing of methods that perform single or two-illuminant estimation.
  arXiv  Detail & Related papers  (2020-11-19T18:50:08Z)
• Light Direction and Color Estimation from Single Image with Deep Regression [25.45529007045549]
  We present a method to estimate the direction and color of the scene light source from a single image. Our method is based on two main ideas: (a) we use a new synthetic dataset with strong shadow effects with similar constraints to the SID dataset; (b) we define a deep architecture trained on the mentioned dataset to estimate the direction and color of the scene light source.
  arXiv  Detail & Related papers  (2020-09-18T17:33:49Z)
• Probabilistic Color Constancy [88.85103410035929]
  We define a framework for estimating the illumination of a scene by weighting the contribution of different image regions. The proposed method achieves competitive performance, compared to the state-of-the-art, on INTEL-TAU dataset.
  arXiv  Detail & Related papers  (2020-05-06T11:03:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.