WB LUTs: Contrastive Learning for White Balancing Lookup Tables

• URL: http://arxiv.org/abs/2404.10133v1
• Date: Mon, 15 Apr 2024 20:48:33 GMT
• Title: WB LUTs: Contrastive Learning for White Balancing Lookup Tables
• Authors: Sai Kumar Reddy Manne, Michael Wan,
• Abstract summary: An incorrect white balance (WB) setting or AWB failure can lead to an undesired blue or red tint in the rendered sRGB image. Recent methods pose the post-capture WB correction problem as an image-to-image translation task and train deep neural networks to learn the necessary color adjustments at a lower resolution. We introduce a contrastive learning framework with a novel hard sample mining strategy, which improves the WB correction quality of baseline 3D LUTs by 25.5%.
• Score: 2.340368527699536
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automatic white balancing (AWB), one of the first steps in an integrated signal processing (ISP) pipeline, aims to correct the color cast induced by the scene illuminant. An incorrect white balance (WB) setting or AWB failure can lead to an undesired blue or red tint in the rendered sRGB image. To address this, recent methods pose the post-capture WB correction problem as an image-to-image translation task and train deep neural networks to learn the necessary color adjustments at a lower resolution. These low resolution outputs are post-processed to generate high resolution WB corrected images, forming a bottleneck in the end-to-end run time. In this paper we present a 3D Lookup Table (LUT) based WB correction model called WB LUTs that can generate high resolution outputs in real time. We introduce a contrastive learning framework with a novel hard sample mining strategy, which improves the WB correction quality of baseline 3D LUTs by 25.5%. Experimental results demonstrate that the proposed WB LUTs perform competitively against state-of-the-art models on two benchmark datasets while being 300 times faster using 12.7 times less memory. Our model and code are available at https://github.com/skrmanne/3DLUT_sRGB_WB.

Related papers

• Deterministic Neural Illumination Mapping for Efficient Auto-White Balance Correction [3.441021278275805]
  Auto-white balance (AWB) correction is a critical operation in image signal processors for accurate and consistent color correction across various illumination scenarios. This paper presents a novel and efficient AWB correction method that achieves at least 35 times faster processing with equivalent or superior performance on high-resolution images.
  arXiv  Detail & Related papers  (2023-08-07T22:44:26Z)
• SepLUT: Separable Image-adaptive Lookup Tables for Real-time Image Enhancement [21.963622337032344]
  We present SepLUT (separable image-adaptive lookup table) to tackle the above limitations. Specifically, we separate a single color transform into a cascade of component-independent and component-correlated sub-transforms instantiated as 1D and 3D LUTs. In this way, the capabilities of two sub-transforms can facilitate each other, where the 3D LUT complements the ability to mix up color components.
  arXiv  Detail & Related papers  (2022-07-18T02:27:19Z)
• Learning Weighting Map for Bit-Depth Expansion within a Rational Range [64.15915577164894]
  Bit-depth expansion (BDE) is one of the emerging technologies to display high bit-depth (HBD) image from low bit-depth (LBD) source. Existing BDE methods have no unified solution for various BDE situations. We design a bit restoration network (BRNet) to learn a weight for each pixel, which indicates the ratio of the replenished value within a rational range.
  arXiv  Detail & Related papers  (2022-04-26T02:27:39Z)
• Auto White-Balance Correction for Mixed-Illuminant Scenes [52.641704254001844]
  Auto white balance (AWB) is applied by camera hardware to remove color cast caused by scene illumination. This paper presents an effective AWB method to deal with such mixed-illuminant scenes. Our method does not require illuminant estimation, as is the case in traditional camera AWB modules.
  arXiv  Detail & Related papers  (2021-09-17T20:13:31Z)
• Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement [52.49231695707198]
  We investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps. Inspired by the color image formulation, we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color. Our proposed method has surpassed the SOTA by 0.95dB in PSNR on LOL1000 dataset and 3.18% in mAP on ExDark dataset.
  arXiv  Detail & Related papers  (2021-03-19T04:00:27Z)
• Interactive White Balancing for Camera-Rendered Images [50.08927449718674]
  White balance (WB) is one of the first photo-finishing steps used to render a captured image to its final output. We introduce a new framework that links the nonlinear color-mapping functions directly to user-selected colors to enable it interactive WB manipulation.
  arXiv  Detail & Related papers  (2020-09-26T16:22:05Z)
• Deblurring by Realistic Blurring [110.54173799114785]
  We propose a new method which combines two GAN models, i.e., a learning-to-blurr GAN (BGAN) and learning-to-DeBlur GAN (DBGAN) The first model, BGAN, learns how to blur sharp images with unpaired sharp and blurry image sets, and then guides the second model, DBGAN, to learn how to correctly deblur such images. As an additional contribution, this paper also introduces a Real-World Blurred Image (RWBI) dataset including diverse blurry images.
  arXiv  Detail & Related papers  (2020-04-04T05:25:15Z)
• Deep White-Balance Editing [50.08927449718674]
  Cameras capture sensor images that are rendered by their integrated signal processor (ISP) to a standard RGB (sRGB) color space encoding. Recent work by [3] showed that sRGB images that were rendered with the incorrect white balance cannot be easily corrected due to the ISP's nonlinear rendering. We propose to solve this problem with a deep neural network (DNN) architecture trained in an end-to-end manner to learn the correct white balance.
  arXiv  Detail & Related papers  (2020-04-03T03:18:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.