$\mathbf{R}^3$: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain

• URL: http://arxiv.org/abs/2509.24022v1
• Date: Sun, 28 Sep 2025 18:31:24 GMT
• Title: $\mathbf{R}^3$: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain
• Abstract summary: Most reconstruction networks are trained on post-ISP sRGB images, even though the image-signal-processing pipeline irreversibly mixes colors, clips dynamic range, and blurs fine detail.<n>This paper uses the rain degradation problem as a use case to show that these losses are avoidable, and demonstrates that learning directly on raw Bayer mosaics yields superior reconstructions.
• Score: 5.193141021890106
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Image reconstruction from corrupted images is crucial across many domains. Most reconstruction networks are trained on post-ISP sRGB images, even though the image-signal-processing pipeline irreversibly mixes colors, clips dynamic range, and blurs fine detail. This paper uses the rain degradation problem as a use case to show that these losses are avoidable, and demonstrates that learning directly on raw Bayer mosaics yields superior reconstructions. To substantiate the claim, we (i) evaluate post-ISP and Bayer reconstruction pipelines, (ii) curate Raw-Rain, the first public benchmark of real rainy scenes captured in both 12-bit Bayer and bit-depth-matched sRGB, and (iii) introduce Information Conservation Score (ICS), a color-invariant metric that aligns more closely with human opinion than PSNR or SSIM. On the test split, our raw-domain model improves sRGB results by up to +0.99 dB PSNR and +1.2% ICS, while running faster with half of the GFLOPs. The results advocate an ISP-last paradigm for low-level vision and open the door to end-to-end learnable camera pipelines.

Related papers

• Benchmarking RAW and RGB Restoration in Image Signal Processors [58.613429740440324]
  Modern cameras transform RAW sensor measurements into sRGB images through an image signal processor (ISP)<n>We benchmark two placements for blind restoration around a fixed ISP.<n>Our results show that placement alone does not determine performance.
  arXiv  Detail & Related papers  (2026-09-02T17:15:44Z)
• Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection [22.292648672901066]
  Low-light Object detection is crucial for many real-world applications but remains challenging due to degraded image quality.<n>We propose a lightweight and self-adaptive Image Signal Processing (ISP) plugin, Dark-ISP, which directly processes Bayer RAW images in dark environments.<n>Our method outperforms state-of-the-art RGB- and RAW-based detection approaches, achieving superior results with minimal parameters in challenging low-light environments.
  arXiv  Detail & Related papers  (2025-09-11T06:44:43Z)
• RDDM: Practicing RAW Domain Diffusion Model for Real-world Image Restoration [27.387521556174104]
  We present an end-to-end diffusion model that restores photo-realistic images directly from the sensor RAW data.<n>We develop a scalable degradation pipeline RAW LQ-HQ pairs from existing sRGB datasets for large-scale training.
  arXiv  Detail & Related papers  (2025-08-26T16:06:17Z)
• Toward Efficient Deep Blind RAW Image Restoration [56.41827271721955]
  We design a new realistic degradation pipeline for training deep blind RAW restoration models. Our pipeline considers realistic sensor noise, motion blur, camera shake, and other common degradations. The models trained with our pipeline and data from multiple sensors, can successfully reduce noise and blur, and recover details in RAW images captured from different cameras.
  arXiv  Detail & Related papers  (2024-09-26T18:34:37Z)
• Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement [71.13353154514418]
  Low-light image enhancement, particularly in cross-domain tasks such as mapping from the raw domain to the sRGB domain, remains a significant challenge.<n>We propose a novel Mamba-based method customized for low light RAW images, called RAWMamba, to effectively handle raw images with different CFAs.<n>By bridging demosaicing and denoising, better enhancement for low light RAW images is achieved.
  arXiv  Detail & Related papers  (2024-09-11T06:12:03Z)
• BSRAW: Improving Blind RAW Image Super-Resolution [63.408484584265985]
  We tackle blind image super-resolution in the RAW domain. We design a realistic degradation pipeline tailored specifically for training models with raw sensor data. Our BSRAW models trained with our pipeline can upscale real-scene RAW images and improve their quality.
  arXiv  Detail & Related papers  (2023-12-24T14:17:28Z)
• StereoISP: Rethinking Image Signal Processing for Dual Camera Systems [4.703692756660711]
  StereoISP employs raw measurements from a stereo camera pair to generate a demosaicked, denoised RGB image. Our preliminary results show an improvement in the PSNR of the reconstructed RGB image by at least 2dB on KITTI 2015.
  arXiv  Detail & Related papers  (2022-11-11T18:34:59Z)
• Reversed Image Signal Processing and RAW Reconstruction. AIM 2022 Challenge Report [109.2135194765743]
  This paper introduces the AIM 2022 Challenge on Reversed Image Signal Processing and RAW Reconstruction. We aim to recover raw sensor images from the corresponding RGBs without metadata and, by doing this, "reverse" the ISP transformation.
  arXiv  Detail & Related papers  (2022-10-20T10:43:53Z)
• Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata [46.28281823015191]
  We show how to improve the de-rendering results by jointly learning sampling and reconstruction. Our experiments show that our learned sampling can adapt to the image content to produce better raw reconstructions than existing methods.
  arXiv  Detail & Related papers  (2022-06-03T20:43:17Z)
• Towards Low Light Enhancement with RAW Images [101.35754364753409]
  We make the first benchmark effort to elaborate on the superiority of using RAW images in the low light enhancement. We develop a new evaluation framework, Factorized Enhancement Model (FEM), which decomposes the properties of RAW images into measurable factors. A RAW-guiding Exposure Enhancement Network (REENet) is developed, which makes trade-offs between the advantages and inaccessibility of RAW images in real applications.
  arXiv  Detail & Related papers  (2021-12-28T07:27:51Z)
• Pseudo-ISP: Learning Pseudo In-camera Signal Processing Pipeline from A Color Image Denoiser [73.88164217509816]
  We present an unpaired learning scheme to adapt a color image denoiser for handling test images with noise discrepancy. We consider a practical training setting, i.e., a pre-trained denoiser, a set of test noisy images, and an unpaired set of clean images. Pseudo-ISP is effective in synthesizing realistic noisy sRGB images.
  arXiv  Detail & Related papers  (2021-03-18T13:11:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.