Semi-Supervised Raw-to-Raw Mapping

• URL: http://arxiv.org/abs/2106.13883v1
• Date: Fri, 25 Jun 2021 21:01:45 GMT
• Title: Semi-Supervised Raw-to-Raw Mapping
• Authors: Mahmoud Afifi and Abdullah Abuolaim
• Abstract summary: The raw-RGB colors of a camera sensor vary due to the spectral sensitivity differences across different sensor makes and models. We present a semi-supervised raw-to-raw mapping method trained on a small set of paired images alongside an unpaired set of images captured by each camera device.
• Score: 19.783856963405754
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The raw-RGB colors of a camera sensor vary due to the spectral sensitivity differences across different sensor makes and models. This paper focuses on the task of mapping between different sensor raw-RGB color spaces. Prior work addressed this problem using a pairwise calibration to achieve accurate color mapping. Although being accurate, this approach is less practical as it requires: (1) capturing pair of images by both camera devices with a color calibration object placed in each new scene; (2) accurate image alignment or manual annotation of the color calibration object. This paper aims to tackle color mapping in the raw space through a more practical setup. Specifically, we present a semi-supervised raw-to-raw mapping method trained on a small set of paired images alongside an unpaired set of images captured by each camera device. Through extensive experiments, we show that our method achieves better results compared to other domain adaptation alternatives in addition to the single-calibration solution. We have generated a new dataset of raw images from two different smartphone cameras as part of this effort. Our dataset includes unpaired and paired sets for our semi-supervised training and evaluation.

Related papers

• SRPose: Two-view Relative Pose Estimation with Sparse Keypoints [51.49105161103385]
  SRPose is a sparse keypoint-based framework for two-view relative pose estimation in camera-to-world and object-to-camera scenarios. It achieves competitive or superior performance compared to state-of-the-art methods in terms of accuracy and speed. It is robust to different image sizes and camera intrinsics, and can be deployed with low computing resources.
  arXiv  Detail & Related papers  (2024-07-11T05:46:35Z)
• Training Neural Networks on RAW and HDR Images for Restoration Tasks [59.41340420564656]
  In this work, we test approaches on three popular image restoration applications: denoising, deblurring, and single-image super-resolution. Our results indicate that neural networks train significantly better on HDR and RAW images represented in display color spaces. This small change to the training strategy can bring a very substantial gain in performance, up to 10-15 dB.
  arXiv  Detail & Related papers  (2023-12-06T17:47:16Z)
• Learning Enriched Illuminants for Cross and Single Sensor Color Constancy [182.4997117953705]
  We propose cross-sensor self-supervised training to train the network. We train the network by randomly sampling the artificial illuminants in a sensor-independent manner. Experiments show that our cross-sensor model and single-sensor model outperform other state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2022-03-21T15:45:35Z)
• Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild [159.71025525493354]
  We propose a trainable Image Signal Processing framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image.
  arXiv  Detail & Related papers  (2022-03-20T20:13:59Z)
• Colour alignment for relative colour constancy via non-standard references [11.92389176996629]
  Relative colour constancy is an essential requirement for many scientific imaging applications. We propose a colour alignment model that considers the camera image formation as a black-box. It formulates colour alignment as a three-step process: camera response calibration, response linearisation, and colour matching.
  arXiv  Detail & Related papers  (2021-12-30T15:58:55Z)
• Colored Point Cloud to Image Alignment [15.828285556159026]
  We introduce a differential optimization method that aligns a colored point cloud to a given color image via iterative geometric and color matching. We find the transformation between the camera image and the point cloud colors by iterating between matching the relative location of the point cloud and matching colors.
  arXiv  Detail & Related papers  (2021-10-07T08:12:56Z)
• Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision [76.41657124981549]
  This paper presents a joint learning model for image alignment and RAW-to-sRGB mapping. Experiments show that our method performs favorably against state-of-the-arts on ZRR and SR-RAW datasets.
  arXiv  Detail & Related papers  (2021-08-18T12:41:36Z)
• Image color correction, enhancement, and editing [14.453616946103132]
  We study the color correction problem from the standpoint of the camera's image signal processor (ISP) In particular, we propose auto image recapture methods to generate different realistic versions of the same camera-rendered image with new colors.
  arXiv  Detail & Related papers  (2021-07-28T01:14:12Z)
• Illumination Estimation Challenge: experience of past two years [57.13714732760851]
  The 2nd Illumination estimation challenge( IEC#2) was conducted. The challenge had several tracks: general, indoor, and two-illuminant with each of them focusing on different parameters of the scenes. Other main features of it are a new large dataset of images (about 5000) taken with the same camera sensor model, a manual markup accompanying each image, diverse content with scenes taken in numerous countries under a huge variety of illuminations extracted by using the SpyderCube calibration object, and a contest-like markup for the images from the Cube+ dataset that was used in IEC#1.
  arXiv  Detail & Related papers  (2020-12-31T17:59:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.