Deep White-Balance Editing
- URL: http://arxiv.org/abs/2004.01354v1
- Date: Fri, 3 Apr 2020 03:18:42 GMT
- Title: Deep White-Balance Editing
- Authors: Mahmoud Afifi and Michael S. Brown
- Abstract summary: Cameras capture sensor images that are rendered by their integrated signal processor (ISP) to a standard RGB (sRGB) color space encoding.
Recent work by [3] showed that sRGB images that were rendered with the incorrect white balance cannot be easily corrected due to the ISP's nonlinear rendering.
We propose to solve this problem with a deep neural network (DNN) architecture trained in an end-to-end manner to learn the correct white balance.
- Score: 50.08927449718674
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce a deep learning approach to realistically edit an sRGB image's
white balance. Cameras capture sensor images that are rendered by their
integrated signal processor (ISP) to a standard RGB (sRGB) color space
encoding. The ISP rendering begins with a white-balance procedure that is used
to remove the color cast of the scene's illumination. The ISP then applies a
series of nonlinear color manipulations to enhance the visual quality of the
final sRGB image. Recent work by [3] showed that sRGB images that were rendered
with the incorrect white balance cannot be easily corrected due to the ISP's
nonlinear rendering. The work in [3] proposed a k-nearest neighbor (KNN)
solution based on tens of thousands of image pairs. We propose to solve this
problem with a deep neural network (DNN) architecture trained in an end-to-end
manner to learn the correct white balance. Our DNN maps an input image to two
additional white-balance settings corresponding to indoor and outdoor
illuminations. Our solution not only is more accurate than the KNN approach in
terms of correcting a wrong white-balance setting but also provides the user
the freedom to edit the white balance in the sRGB image to other illumination
settings.
Related papers
- Simple Image Signal Processing using Global Context Guidance [56.41827271721955]
Deep learning-based ISPs aim to transform RAW images into DSLR-like RGB images using deep neural networks.
We propose a novel module that can be integrated into any neural ISP to capture the global context information from the full RAW images.
Our model achieves state-of-the-art results on different benchmarks using diverse and real smartphone images.
arXiv Detail & Related papers (2024-04-17T17:11:47Z) - WB LUTs: Contrastive Learning for White Balancing Lookup Tables [2.340368527699536]
An incorrect white balance (WB) setting or AWB failure can lead to an undesired blue or red tint in the rendered sRGB image.
Recent methods pose the post-capture WB correction problem as an image-to-image translation task and train deep neural networks to learn the necessary color adjustments at a lower resolution.
We introduce a contrastive learning framework with a novel hard sample mining strategy, which improves the WB correction quality of baseline 3D LUTs by 25.5%.
arXiv Detail & Related papers (2024-04-15T20:48:33Z) - Training Neural Networks on RAW and HDR Images for Restoration Tasks [59.41340420564656]
In this work, we test approaches on three popular image restoration applications: denoising, deblurring, and single-image super-resolution.
Our results indicate that neural networks train significantly better on HDR and RAW images represented in display color spaces.
This small change to the training strategy can bring a very substantial gain in performance, up to 10-15 dB.
arXiv Detail & Related papers (2023-12-06T17:47:16Z) - Transform your Smartphone into a DSLR Camera: Learning the ISP in the
Wild [159.71025525493354]
We propose a trainable Image Signal Processing framework that produces DSLR quality images given RAW images captured by a smartphone.
To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image.
arXiv Detail & Related papers (2022-03-20T20:13:59Z) - Auto White-Balance Correction for Mixed-Illuminant Scenes [52.641704254001844]
Auto white balance (AWB) is applied by camera hardware to remove color cast caused by scene illumination.
This paper presents an effective AWB method to deal with such mixed-illuminant scenes.
Our method does not require illuminant estimation, as is the case in traditional camera AWB modules.
arXiv Detail & Related papers (2021-09-17T20:13:31Z) - Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision [76.41657124981549]
This paper presents a joint learning model for image alignment and RAW-to-sRGB mapping.
Experiments show that our method performs favorably against state-of-the-arts on ZRR and SR-RAW datasets.
arXiv Detail & Related papers (2021-08-18T12:41:36Z) - Image color correction, enhancement, and editing [14.453616946103132]
We study the color correction problem from the standpoint of the camera's image signal processor (ISP)
In particular, we propose auto image recapture methods to generate different realistic versions of the same camera-rendered image with new colors.
arXiv Detail & Related papers (2021-07-28T01:14:12Z) - UIEC^2-Net: CNN-based Underwater Image Enhancement Using Two Color Space [9.318613337883097]
We propose an end-to-end trainable network, consisting of three blocks as follow: a RGB pixel-level block, a HSV global-adjust block for globally adjusting underwater image luminance, color and saturation, and an attention map block for combining the advantages of RGB and HSV block output images by distributing weight to each pixel.
Experimental results on synthetic and real-world underwater images show the good performance of our proposed method in both subjective comparisons and objective metrics.
arXiv Detail & Related papers (2021-03-12T08:23:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.