Structural Guidance for Unified Joint Demosaicing and Denoising

• URL: http://arxiv.org/abs/2608.09995v1
• Date: Fri, 07 Aug 2026 10:14:20 GMT
• Title: Structural Guidance for Unified Joint Demosaicing and Denoising
• Abstract summary: Joint demosaicing and denoising is a fundamental step in camera image signal processing.<n>Different Bayer-like color filter arrays (CFAs) and sensor noise jointly corrupt both color sampling and image content.<n>We propose a structural-guided unified restoration framework that injects pretrained structural knowledge into CFA-aware image restoration.
• Score: 15.554336519344078
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Joint demosaicing and denoising is a fundamental step in camera image signal processing, yet remains challenging because different Bayer-like color filter arrays (CFAs) and sensor noise jointly corrupt both color sampling and image content. Existing unified restoration networks explicitly model CFA geometry but are still driven primarily by pixel-level supervision, making them prone to structural degradation around edges, repetitive textures, and moiré patterns where local evidence is unreliable. We attribute this limitation partly to the absence of explicit structural guidance beyond pixel-level reconstruction supervision. Motivated by this observation, we propose a structural-guided unified restoration framework that injects pretrained structural knowledge into CFA-aware image restoration. Our model receives a unified five-channel observation consisting of the raw mosaic, CFA masks, and a noise-level map. A SwinIR restoration branch reconstructs pixel details under CFA-conditioned modulation, while a parallel structural reasoning branch extracts complementary structural cues from a sparse pseudo-RGB observation. To bridge the substantial domain gap between sparse noisy sensor data and the natural-image pretraining domain of the structural encoder, we introduce a lightweight trainable adapter before residually fusing structural and restoration features. A shared decoder jointly predicts the restored RGB image and an auxiliary clean mosaic, providing supervision in both image and sensor domains. Extensive experiments across multiple CFA patterns and noise levels demonstrate consistent improvements over state-of-the-art unified and CFA-specific methods, indicating that adapted structural priors can enhance robust camera image restoration. The source codes and dataset are provided in the supplementary material.

Related papers

• SegDem: Segmentation helps Demosaicing [52.515779223891705]
  Image demosaicing reconstructs a full-color image from incomplete color measurements produced by a sensor covered with a color filter (CFA)<n>Most existing methods formulate demosaicing as pixel-level reconstruction.<n>SegDem is a cross-task decoder representation transfer framework for demosaicing.
  arXiv  Detail & Related papers  (2026-08-08T04:49:20Z)
• FaithIR: Rethinking Infrared Image Super-Resolution from Perceptual Sharpness to Task Relevant Fidelity [50.75932774177958]
  FaithIR is a faithful infrared super-resolution framework for reliable machine perception.<n>Experiments on FLIR-IISR, M3FD, and FMB demonstrate strong reconstruction fidelity, cross-dataset generalization, and superior performance in object detection and semantic segmentation.
  arXiv  Detail & Related papers  (2026-08-04T04:23:30Z)
• LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection [11.780720481629837]
  We present LaP-Forensics, a framework that augments RGB semantics with reconstruction-based forensic evidence.<n> Independent projectors encode the RGB image and residual map before a structured Where-What-Why model predicts a textual analysis and an artifact mask.<n>Experiments show cross-generator detection on UniversalFakeDetect and competitive artifact localization on the official SynthScars benchmark.
  arXiv  Detail & Related papers  (2026-07-28T16:45:52Z)
• CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion [3.7521959864518593]
  CogSENet is a dynamic, semantic-aligned reconstruction framework inspired by the eagle's visual system.<n>CogSENetoutperforms state-of-the-art deblurring methods in both visual quality and structural fidelity with fewer parameters.
  arXiv  Detail & Related papers  (2026-06-29T09:29:21Z)
• Improving Radio Interferometry Imaging by Explicitly Modeling Cross-Domain Consistency in Reconstruction [10.224329769135139]
  We propose a multimodal radio interferometric data reconstruction method that explicitly models cross-domain consistency.<n>Our experimental results demonstrate that CDCRec improves imaging performance through enhanced cross-domain correlation extraction.
  arXiv  Detail & Related papers  (2026-04-18T02:46:26Z)
• SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration [20.873676111265656]
  SSP-IR aims to fully exploit semantic and structure priors from low-quality images.<n>Our method outperforms other state-of-the-art methods overall on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2024-07-04T04:55:14Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Editing Out-of-domain GAN Inversion via Differential Activations [56.62964029959131]
  We propose a novel GAN prior based editing framework to tackle the out-of-domain inversion problem with a composition-decomposition paradigm. With the aid of the generated Diff-CAM mask, a coarse reconstruction can intuitively be composited by the paired original and edited images. In the decomposition phase, we further present a GAN prior based deghosting network for separating the final fine edited image from the coarse reconstruction.
  arXiv  Detail & Related papers  (2022-07-17T10:34:58Z)
• Cross-SRN: Structure-Preserving Super-Resolution Network with Cross Convolution [64.76159006851151]
  It is challenging to restore low-resolution (LR) images to super-resolution (SR) images with correct and clear details. Existing deep learning works almost neglect the inherent structural information of images. We design a hierarchical feature exploitation network to probe and preserve structural information.
  arXiv  Detail & Related papers  (2022-01-05T05:15:01Z)
• Structure-Preserving Image Super-Resolution [94.16949589128296]
  Structures matter in single image super-resolution (SISR) Recent studies have promoted the development of SISR by recovering photo-realistic images. However, there are still undesired structural distortions in the recovered images.
  arXiv  Detail & Related papers  (2021-09-26T08:48:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.