CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy

• URL: http://arxiv.org/abs/2504.07959v1
• Date: Thu, 10 Apr 2025 17:59:31 GMT
• Title: CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy
• Authors: Dongyoung Kim, Mahmoud Afifi, Dongyun Kim, Michael S. Brown, Seon Joo Kim,
• Abstract summary: Computational color constancy, or white balancing, is a key module in a camera's image signal processor (ISP)<n>This paper introduces a learning-based method for cross-camera color constancy that generalizes to new cameras without retraining.
• Score: 45.85992386314982
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Computational color constancy, or white balancing, is a key module in a camera's image signal processor (ISP) that corrects color casts from scene lighting. Because this operation occurs in the camera-specific raw color space, white balance algorithms must adapt to different cameras. This paper introduces a learning-based method for cross-camera color constancy that generalizes to new cameras without retraining. Our method leverages pre-calibrated color correction matrices (CCMs) available on ISPs that map the camera's raw color space to a standard space (e.g., CIE XYZ). Our method uses these CCMs to transform predefined illumination colors (i.e., along the Planckian locus) into the test camera's raw space. The mapped illuminants are encoded into a compact camera fingerprint embedding (CFE) that enables the network to adapt to unseen cameras. To prevent overfitting due to limited cameras and CCMs during training, we introduce a data augmentation technique that interpolates between cameras and their CCMs. Experimental results across multiple datasets and backbones show that our method achieves state-of-the-art cross-camera color constancy while remaining lightweight and relying only on data readily available in camera ISPs.

Related papers

• Color Matching Using Hypernetwork-Based Kolmogorov-Arnold Networks [44.97307414849601]
  cmKAN is a versatile framework for color matching.<n>We use Kolmogorov-Arnold Networks (KANs) to model the color matching between source and target distributions.<n>We introduce a first large-scale dataset of paired images captured by two distinct cameras.
  arXiv  Detail & Related papers  (2025-03-14T18:17:19Z)
• Discovering an Image-Adaptive Coordinate System for Photography Processing [51.164345878060956]
  We propose a novel algorithm, IAC, to learn an image-adaptive coordinate system in the RGB color space before performing curve operations. This end-to-end trainable approach enables us to efficiently adjust images with a jointly learned image-adaptive coordinate system and curves.
  arXiv  Detail & Related papers  (2025-01-11T06:20:07Z)
• PeLiCal: Targetless Extrinsic Calibration via Penetrating Lines for RGB-D Cameras with Limited Co-visibility [11.048526314073886]
  We present PeLiCal, a novel line-based calibration approach for RGB-D camera systems exhibiting limited overlap. Our method leverages long line features from surroundings, and filters out outliers with a novel convergence voting algorithm.
  arXiv  Detail & Related papers  (2024-04-22T07:50:24Z)
• Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs [53.68932498994655]
  This paper introduces a novel method for unpaired learning of raw-to-raw translation across diverse cameras. It accurately maps raw images captured by a certain camera to the target camera, facilitating the generalization of learnable ISPs to new unseen cameras. Our method demonstrates superior performance on real camera datasets, achieving higher accuracy compared to previous state-of-the-art techniques.
  arXiv  Detail & Related papers  (2024-04-16T16:17:48Z)
• SmartMocap: Joint Estimation of Human and Camera Motion using Uncalibrated RGB Cameras [49.110201064166915]
  Markerless human motion capture (mocap) from multiple RGB cameras is a widely studied problem. Existing methods either need calibrated cameras or calibrate them relative to a static camera, which acts as the reference frame for the mocap system. We propose a mocap method which uses multiple static and moving extrinsically uncalibrated RGB cameras.
  arXiv  Detail & Related papers  (2022-09-28T08:21:04Z)
• Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild [159.71025525493354]
  We propose a trainable Image Signal Processing framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image.
  arXiv  Detail & Related papers  (2022-03-20T20:13:59Z)
• Colour alignment for relative colour constancy via non-standard references [11.92389176996629]
  Relative colour constancy is an essential requirement for many scientific imaging applications. We propose a colour alignment model that considers the camera image formation as a black-box. It formulates colour alignment as a three-step process: camera response calibration, response linearisation, and colour matching.
  arXiv  Detail & Related papers  (2021-12-30T15:58:55Z)
• Auto White-Balance Correction for Mixed-Illuminant Scenes [52.641704254001844]
  Auto white balance (AWB) is applied by camera hardware to remove color cast caused by scene illumination. This paper presents an effective AWB method to deal with such mixed-illuminant scenes. Our method does not require illuminant estimation, as is the case in traditional camera AWB modules.
  arXiv  Detail & Related papers  (2021-09-17T20:13:31Z)
• Image color correction, enhancement, and editing [14.453616946103132]
  We study the color correction problem from the standpoint of the camera's image signal processor (ISP) In particular, we propose auto image recapture methods to generate different realistic versions of the same camera-rendered image with new colors.
  arXiv  Detail & Related papers  (2021-07-28T01:14:12Z)
• Semi-Supervised Raw-to-Raw Mapping [19.783856963405754]
  The raw-RGB colors of a camera sensor vary due to the spectral sensitivity differences across different sensor makes and models. We present a semi-supervised raw-to-raw mapping method trained on a small set of paired images alongside an unpaired set of images captured by each camera device.
  arXiv  Detail & Related papers  (2021-06-25T21:01:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.