Leveraging Multispectral Sensors for Color Correction in Mobile Cameras

• URL: http://arxiv.org/abs/2512.08441v1
• Date: Tue, 09 Dec 2025 10:14:13 GMT
• Title: Leveraging Multispectral Sensors for Color Correction in Mobile Cameras
• Authors: Luca Cogo, Marco Buzzelli, Simone Bianco, Javier Vazquez-Corral, Raimondo Schettini,
• Abstract summary: Recent advances in snapshot multispectral (MS) imaging have enabled compact, low-cost spectral sensors for consumer and mobile devices.<n>We propose a unified, learning-based framework that performs end-to-end color correction.<n>We show that our approach improves color accuracy and stability, reducing error by up to 50% compared to RGB-only and MS-driven baselines.
• Score: 22.93423876118074
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in snapshot multispectral (MS) imaging have enabled compact, low-cost spectral sensors for consumer and mobile devices. By capturing richer spectral information than conventional RGB sensors, these systems can enhance key imaging tasks, including color correction. However, most existing methods treat the color correction pipeline in separate stages, often discarding MS data early in the process. We propose a unified, learning-based framework that (i) performs end-to-end color correction and (ii) jointly leverages data from a high-resolution RGB sensor and an auxiliary low-resolution MS sensor. Our approach integrates the full pipeline within a single model, producing coherent and color-accurate outputs. We demonstrate the flexibility and generality of our framework by refactoring two different state-of-the-art image-to-image architectures. To support training and evaluation, we construct a dedicated dataset by aggregating and repurposing publicly available spectral datasets, rendering under multiple RGB camera sensitivities. Extensive experiments show that our approach improves color accuracy and stability, reducing error by up to 50% compared to RGB-only and MS-driven baselines. Datasets, code, and models will be made available upon acceptance.

Related papers

• IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection [92.56025546608699]
  IrisNet is a novel meta-learned framework that adapts detection strategies to the input infrared image status.<n>Our approach establishes a dynamic mapping between infrared image features and entire decoder parameters.<n> Experiments on NUDT-SIRST, NUAA-SIRST, and IRSTD-1K datasets demonstrate the superiority of our IrisNet.
  arXiv  Detail & Related papers  (2025-11-25T13:53:54Z)
• Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection [22.292648672901066]
  Low-light Object detection is crucial for many real-world applications but remains challenging due to degraded image quality.<n>We propose a lightweight and self-adaptive Image Signal Processing (ISP) plugin, Dark-ISP, which directly processes Bayer RAW images in dark environments.<n>Our method outperforms state-of-the-art RGB- and RAW-based detection approaches, achieving superior results with minimal parameters in challenging low-light environments.
  arXiv  Detail & Related papers  (2025-09-11T06:44:43Z)
• AuxDet: Auxiliary Metadata Matters for Omni-Domain Infrared Small Target Detection [49.81255045696323]
  We present the Auxiliary Metadata Driven Infrared Small Target Detector (AuxDet)<n>AuxDet integrates metadata semantics with visual features, guiding adaptive representation learning for each sample.<n>Experiments on the challenging WideIRSTD-Full benchmark demonstrate that AuxDet consistently outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-05-21T07:02:05Z)
• Learned Lightweight Smartphone ISP with Unpaired Data [55.2480439325792]
  We propose a novel training method for a learnable Image Signal Processor (ISP)<n>Our unpaired approach employs a multi-term loss function guided by adversarial training.<n>Compared to paired training methods, our unpaired learning strategy shows strong potential and achieves high fidelity.
  arXiv  Detail & Related papers  (2025-05-15T15:37:51Z)
• Multispectral Demosaicing via Dual Cameras [29.349707272903835]
  Multispectral (MS) images capture detailed scene information across a wide range of spectral bands.<n>A critical step in processing MS data is demosaicing, which reconstructs color information from the mosaic MS images captured by the camera.<n>This paper proposes a method for MS image demosaicing specifically designed for dual-camera setups where both RGB and MS cameras capture the same scene.
  arXiv  Detail & Related papers  (2025-03-27T22:40:55Z)
• Multi-Domain Biometric Recognition using Body Embeddings [51.36007967653781]
  We show that body embeddings perform better than face embeddings in medium-wave infrared (MWIR) and long-wave infrared (LWIR) domains.<n>We leverage a vision transformer architecture to establish benchmark results on the IJB-MDF dataset.<n>We also show that finetuning a body model, pretrained exclusively on VIS data, with a simple combination of cross-entropy and triplet losses achieves state-of-the-art mAP scores.
  arXiv  Detail & Related papers  (2025-03-13T22:38:18Z)
• Joint RGB-Spectral Decomposition Model Guided Image Enhancement in Mobile Photography [36.4031416416813]
  We propose a joint RGB-Spectral decomposition model guided enhancement.<n>We leverage thearity between RGB and Low-resolution Multi-Spectral Images (Lr-MSI) to predict shading, reflectance, and material semantic priors.<n>These priors are seamlessly integrated into the established HDRNet to promote dynamic range enhancement, color mapping, and grid expert learning.
  arXiv  Detail & Related papers  (2024-07-25T12:43:41Z)
• Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysis [27.72795283513315]
  Data-driven spectral reconstruction aims at extracting spectral information from RGB images captured by cost-effective RGB cameras.<n>We evaluate the overfitting limitations with respect to current datasets.<n>We reveal fundamental limitations in the ability of RGB to spectral methods to deal with metameric or near-metameric conditions.
  arXiv  Detail & Related papers  (2024-01-08T11:46:45Z)
• GenISP: Neural ISP for Low-Light Machine Cognition [19.444297600977546]
  In low-light conditions, object detectors using raw image data are more robust than detectors using image data processed by an ISP pipeline. We propose a minimal neural ISP pipeline for machine cognition, named GenISP, that explicitly incorporates Color Space Transformation to a device-independent color space.
  arXiv  Detail & Related papers  (2022-05-07T17:17:24Z)
• Learning Enriched Illuminants for Cross and Single Sensor Color Constancy [182.4997117953705]
  We propose cross-sensor self-supervised training to train the network. We train the network by randomly sampling the artificial illuminants in a sensor-independent manner. Experiments show that our cross-sensor model and single-sensor model outperform other state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2022-03-21T15:45:35Z)
• Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation [59.94819184452694]
  Depth information has proven to be a useful cue in the semantic segmentation of RGBD images for providing a geometric counterpart to the RGB representation. Most existing works simply assume that depth measurements are accurate and well-aligned with the RGB pixels and models the problem as a cross-modal feature fusion. In this paper, we propose a unified and efficient Crossmodality Guided to not only effectively recalibrate RGB feature responses, but also to distill accurate depth information via multiple stages and aggregate the two recalibrated representations alternatively.
  arXiv  Detail & Related papers  (2020-07-17T18:35:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.