GCC: Generative Color Constancy via Diffusing a Color Checker

• URL: http://arxiv.org/abs/2502.17435v2
• Date: Tue, 25 Mar 2025 16:17:47 GMT
• Title: GCC: Generative Color Constancy via Diffusing a Color Checker
• Authors: Chen-Wei Chang, Cheng-De Fan, Chia-Che Chang, Yi-Chen Lo, Yu-Chee Tseng, Jiun-Long Huang, Yu-Lun Liu,
• Abstract summary: We present GCC, which leverages diffusion models to inpaint color checkers into images for illumination estimation.<n>Our key innovations include (1) a single-step deterministic inference approach that inpaints color checkers reflecting scene illumination, (2) a Laplacian decomposition technique that checker preserves structure while allowing illumination-dependent color adaptation, and (3) a mask-based data augmentation strategy for handling color checker annotations.
• Score: 10.283908511005176
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Color constancy methods often struggle to generalize across different camera sensors due to varying spectral sensitivities. We present GCC, which leverages diffusion models to inpaint color checkers into images for illumination estimation. Our key innovations include (1) a single-step deterministic inference approach that inpaints color checkers reflecting scene illumination, (2) a Laplacian decomposition technique that preserves checker structure while allowing illumination-dependent color adaptation, and (3) a mask-based data augmentation strategy for handling imprecise color checker annotations. By harnessing rich priors from pre-trained diffusion models, GCC demonstrates strong robustness in challenging cross-camera scenarios. These results highlight our method's effective generalization capability across different camera characteristics without requiring sensor-specific training, making it a versatile and practical solution for real-world applications.

Related papers

• CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis [75.25966323298003]
  Spectral imaging offers promising applications across diverse domains, including medicine and urban scene understanding. variability in channel dimensionality and captured wavelengths among spectral cameras impede the development of AI-driven methodologies. We introduce $textbfCARL$, a model for $textbfC$amera-$textbfA$gnostic $textbfR$esupervised $textbfL$ across RGB, multispectral, and hyperspectral imaging modalities.
  arXiv  Detail & Related papers  (2025-04-27T13:06:40Z)
• Leveraging Semantic Attribute Binding for Free-Lunch Color Control in Diffusion Models [53.73253164099701]
  We introduce ColorWave, a training-free approach that achieves exact RGB-level color control in diffusion models without fine-tuning. We demonstrate that ColorWave establishes a new paradigm for structured, color-consistent diffusion-based image synthesis.
  arXiv  Detail & Related papers  (2025-03-12T21:49:52Z)
• Control Color: Multimodal Diffusion-based Interactive Image Colorization [81.68817300796644]
  Control Color (Ctrl Color) is a multi-modal colorization method that leverages the pre-trained Stable Diffusion (SD) model. We present an effective way to encode user strokes to enable precise local color manipulation. We also introduce a novel module based on self-attention and a content-guided deformable autoencoder to address the long-standing issues of color overflow and inaccurate coloring.
  arXiv  Detail & Related papers  (2024-02-16T17:51:13Z)
• Diving into Darkness: A Dual-Modulated Framework for High-Fidelity Super-Resolution in Ultra-Dark Environments [51.58771256128329]
  This paper proposes a specialized dual-modulated learning framework that attempts to deeply dissect the nature of the low-light super-resolution task. We develop Illuminance-Semantic Dual Modulation (ISDM) components to enhance feature-level preservation of illumination and color details. Comprehensive experiments showcases the applicability and generalizability of our approach to diverse and challenging ultra-low-light conditions.
  arXiv  Detail & Related papers  (2023-09-11T06:55:32Z)
• MIMT: Multi-Illuminant Color Constancy via Multi-Task Local Surface and Light Color Learning [42.72878256074646]
  We introduce a multi-task learning method to discount multiple light colors in a single input image. To have better cues of the local surface/light colors under multiple light color conditions, we design a novel multi-task learning framework. Our model achieves 47.1% improvement compared to a state-of-the-art multi-illuminant color constancy method on a multi-illuminant dataset.
  arXiv  Detail & Related papers  (2022-11-16T09:00:20Z)
• Cross-Camera Deep Colorization [10.254243409261898]
  We propose an end-to-end convolutional neural network to align and fuse images from a color-plus-mono dual-camera system. Our method consistently achieves substantial improvements, i.e., around 10dB PSNR gain.
  arXiv  Detail & Related papers  (2022-08-26T11:02:14Z)
• Detecting Recolored Image by Spatial Correlation [60.08643417333974]
  Image recoloring is an emerging editing technique that can manipulate the color values of an image to give it a new style. In this paper, we explore a solution from the perspective of the spatial correlation, which exhibits the generic detection capability for both conventional and deep learning-based recoloring. Our method achieves the state-of-the-art detection accuracy on multiple benchmark datasets and exhibits well generalization for unknown types of recoloring methods.
  arXiv  Detail & Related papers  (2022-04-23T01:54:06Z)
• Learning Enriched Illuminants for Cross and Single Sensor Color Constancy [182.4997117953705]
  We propose cross-sensor self-supervised training to train the network. We train the network by randomly sampling the artificial illuminants in a sensor-independent manner. Experiments show that our cross-sensor model and single-sensor model outperform other state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2022-03-21T15:45:35Z)
• Colour alignment for relative colour constancy via non-standard references [11.92389176996629]
  Relative colour constancy is an essential requirement for many scientific imaging applications. We propose a colour alignment model that considers the camera image formation as a black-box. It formulates colour alignment as a three-step process: camera response calibration, response linearisation, and colour matching.
  arXiv  Detail & Related papers  (2021-12-30T15:58:55Z)
• Image color correction, enhancement, and editing [14.453616946103132]
  We study the color correction problem from the standpoint of the camera's image signal processor (ISP) In particular, we propose auto image recapture methods to generate different realistic versions of the same camera-rendered image with new colors.
  arXiv  Detail & Related papers  (2021-07-28T01:14:12Z)
• Semi-Supervised Raw-to-Raw Mapping [19.783856963405754]
  The raw-RGB colors of a camera sensor vary due to the spectral sensitivity differences across different sensor makes and models. We present a semi-supervised raw-to-raw mapping method trained on a small set of paired images alongside an unpaired set of images captured by each camera device.
  arXiv  Detail & Related papers  (2021-06-25T21:01:45Z)
• CoRe: Color Regression for Multicolor Fashion Garments [80.57724826629176]
  In this paper, we handle color detection as a regression problem to predict the exact RGB values. We include a second regression stage for refinement in our newly proposed architecture. This architecture is modular and easily expanded to detect the RGBs of all colors in a multicolor garment.
  arXiv  Detail & Related papers  (2020-10-06T16:12:30Z)
• Probabilistic Color Constancy [88.85103410035929]
  We define a framework for estimating the illumination of a scene by weighting the contribution of different image regions. The proposed method achieves competitive performance, compared to the state-of-the-art, on INTEL-TAU dataset.
  arXiv  Detail & Related papers  (2020-05-06T11:03:05Z)
• A Multi-Hypothesis Approach to Color Constancy [22.35581217222978]
  Current approaches frame the color constancy problem as learning camera specific illuminant mappings. We propose a Bayesian framework that naturally handles color constancy ambiguity via a multi-hypothesis strategy. Our method provides state-of-the-art accuracy on multiple public datasets while maintaining real-time execution.
  arXiv  Detail & Related papers  (2020-02-28T18:05:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.