PRISM: Latent Composition Consistency for Single-Image Reflection Removal

• URL: http://arxiv.org/abs/2606.31513v1
• Date: Tue, 30 Jun 2026 11:28:02 GMT
• Title: PRISM: Latent Composition Consistency for Single-Image Reflection Removal
• Abstract summary: Single-image reflection removal (SIRR) seeks to recover the transmission layer from a mixture corrupted by reflections.<n>Existing methods operate in pixel space, where the nonlinear sRGB formation model entangles the two layers.<n>We propose textbfPRISM (Pretrained-latent Reflection Image Separation Model), which reinterprets SIRR as a latent linear separation problem.
• Score: 8.368543987898734
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Single-image reflection removal (SIRR) seeks to recover the transmission layer from a mixture corrupted by reflections -- a severely ill-posed problem. Existing methods operate in pixel space, where the nonlinear sRGB formation model entangles the two layers and limits generalization. We observe that pretrained VAE latent spaces exhibit substantially lower coherence between image layers compared to pixel space, providing a more favorable working space for decomposition. Building on this finding, we propose \textbf{PRISM} (Pretrained-latent Reflection Image Separation Model), which reinterprets SIRR as a latent linear separation problem. Under an approximate additive formulation in latent space, PRISM learns a flow matching velocity field on a pretrained FLUX backbone that recovers both transmission and reflection in a single forward pass. To enforce robust disentanglement, we introduce a Latent Composition Consistency (LCC) strategy that constructs synthetic mixtures by swapping reflection latents across samples and enforces consistent decomposition via a cycle loss. We further propose a Layer Contrastive Separation (LCS) loss that promotes semantic separation between layers through patch-level contrastive learning, without requiring explicit reflection targets. Experiments on six benchmarks demonstrate that PRISM consistently outperforms state-of-the-art methods by significant margins, with strong generalization to in-the-wild images.

Related papers

• Reflection Separation from a Single Image via Joint Latent Diffusion [15.007786845289223]
  Single-image reflection separation is highly challenging under extreme conditions like glare or weak reflections.<n>This paper presents a diffusion model explicitly fine-tuned for this task, leveraging generative diffusion priors for robust separation.<n>Our method simultaneously generates transmission and reflection layers through a unified diffusion model, incorporating a novel cross-layer self-attention mechanism for better feature disentanglement.
  arXiv  Detail & Related papers  (2026-06-02T18:11:20Z)
• Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimization [56.95448807869383]
  Federated Learning (FL) has emerged as a compelling paradigm for privacy-preserving distributed machine learning.<n>Recent studies find that the gradients exchanged in the FL system are also vulnerable to privacy leakage.<n>We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD)
  arXiv  Detail & Related papers  (2026-04-01T14:32:15Z)
• FUMO: Prior-Modulated Diffusion for Single Image Reflection Removal [51.98991734660274]
  This paper presents a diffusion model with prior modulation framework (FUMO) that introduces explicit guidance signals to improve spatial controllability and structural faithfulness.<n>Experiments conducted on both standard benchmarks and challenging images in the wild demonstrate competitive quantitative results and consistently improved perceptual quality.
  arXiv  Detail & Related papers  (2026-03-19T15:33:11Z)
• ReflexSplit: Single Image Reflection Separation via Layer Fusion-Separation [13.290464696196366]
  Single Image Reflection Separation (SIRS) disentangles mixed images into transmission and reflection layers.<n>Existing methods suffer from transmission-reflection confusion under nonlinear mixing.<n>We propose ReflexSplit, a dual-stream framework with three key innovations.
  arXiv  Detail & Related papers  (2026-01-24T13:52:21Z)
• RefLSM: Linearized Structural-Prior Reflectance Model for Medical Image Segmentation and Bias-Field Correction [10.716406019360441]
  We propose a novel variational Reflectance-based Level Set Model (RefLSM) for medical image segmentation.<n>RefLSM explicitly integrates Retinex-inspired reflectance decomposition into the segmentation framework.<n>We show that RefLSM achieves superior segmentation accuracy, robustness, and computational efficiency compared to state-of-the-art level set methods.
  arXiv  Detail & Related papers  (2025-12-08T06:06:29Z)
• Rectifying Latent Space for Generative Single-Image Reflection Removal [16.341477336909765]
  Single-image removal is a highly ill-posed problem, where existing methods struggle to reason about the composition of corrupted regions.<n>This work reframes an editing-purpose latent diffusion model to effectively perceive and process highly ambiguous, layered image inputs.
  arXiv  Detail & Related papers  (2025-12-06T09:16:14Z)
• Dereflection Any Image with Diffusion Priors and Diversified Data [86.15504914121226]
  We propose a comprehensive solution with an efficient data preparation pipeline and a generalizable model for robust reflection removal.<n>First, we introduce a dataset named Diverse Reflection Removal (DRR) created by randomly rotating reflective mediums in target scenes.<n>Second, we propose a diffusion-based framework with one-step diffusion for deterministic outputs and fast inference.
  arXiv  Detail & Related papers  (2025-03-21T17:48:14Z)
• Timestep-Aware Diffusion Model for Extreme Image Rescaling [47.89362819768323]
  We propose a novel framework called Timestep-Aware Diffusion Model (TADM) for extreme image rescaling.<n>TADM performs rescaling operations in the latent space of a pre-trained autoencoder.<n>It effectively leverages powerful natural image priors learned by a pre-trained text-to-image diffusion model.
  arXiv  Detail & Related papers  (2024-08-17T09:51:42Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance [78.34235841168031]
  We present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR) RAG can be used (i) to mitigate the effect of reflection from the observation, and (ii) to generate mask in partial convolution for mitigating the effect of deviating from linear combination hypothesis. Experiments on five commonly used datasets demonstrate the quantitative and qualitative superiority of our RAGNet in comparison to the state-of-the-art SIRR methods.
  arXiv  Detail & Related papers  (2020-12-02T03:14:57Z)
• Learning to See Through Obstructions with Layered Decomposition [117.77024641706451]
  We present a learning-based approach for removing unwanted obstructions from moving images. Our method leverages motion differences between the background and obstructing elements to recover both layers. We show that the proposed approach learned from synthetically generated data performs well to real images.
  arXiv  Detail & Related papers  (2020-08-11T17:59:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.