Principled Reflection Separation via Nonlinear Superposition and Feature Interaction

• URL: http://arxiv.org/abs/2606.02831v1
• Date: Mon, 01 Jun 2026 19:50:52 GMT
• Title: Principled Reflection Separation via Nonlinear Superposition and Feature Interaction
• Abstract summary: Single-image reflection separation is fundamentally challenged by the entanglement of transmission and reflection layers.<n>Existing approaches largely rely on simplified assumptions or independent modeling, limiting their ability to handle real-world scenarios.<n>We introduce a learnable nonlinear superposition model that more faithfully characterizes layer interactions and improves decomposition fidelity.
• Score: 15.424145816267304
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Single-image reflection separation is fundamentally challenged by the entanglement of transmission and reflection layers under complex image formation processes. Existing approaches largely rely on simplified assumptions or independent modeling, limiting their ability to handle real-world scenarios. In this work, we revisit the problem from a unified perspective and identify a key issue of existing approaches, i.e., the widely adopted linear composition model in the sRGB domain fails to capture the nonlinear coupling introduced by real-world image signal processing pipelines. To address this, we introduce a learnable nonlinear superposition model that more faithfully characterizes layer interactions and improves decomposition fidelity. Building upon this formulation, we propose a generalized dual-stream interactive framework that explicitly models bidirectional dependencies between transmission and reflection through feature exchange. This framework unifies activation-, gating-, and attention-based interaction mechanisms, and is compatible with both CNN and Transformer backbones. Extensive experiments on diverse real-world benchmarks demonstrate that the proposed approach achieves superior performance with strong generalization capability. More importantly, our study reveals that reflection separation is not about undoing a linear mixture, but about learning nonlinear formation and interaction}, offering new insights into the design of principled image decomposition models. Code and models are publicly available at https://mingcv.github.io/DIRS-Page.

Related papers

• Toward a mechanistic understanding of inference in visual cortex and diffusion models [46.86106767256413]
  We describe a model of perceptual inference in primary visual cortex (V1)<n>We efficiently train these recurrent dynamics using a denoising score-matching objective and implicit differentiation.<n>This model exhibits exceptionally good denoising performance, restoring image features such as extended contours amid extreme visual ambiguity.
  arXiv  Detail & Related papers  (2026-07-17T07:11:57Z)
• GFRRN: Explore the Gaps in Single Image Reflection Removal [23.018215754935753]
  We propose a Gap-Free Reflection Removal Network (GFRRN) for single image reflection removal.<n>In this work, we first adopt the parameter efficient fine-tuning (PEFT) strategy to align the training directions.<n>Then, a label generator is designed to unify the reflection labels for both synthetic and real-world data.<n>Extensive experiments demonstrate the effectiveness of our GFRRN, achieving superior performance against state-of-the-art SIRR methods.
  arXiv  Detail & Related papers  (2026-02-26T07:17:49Z)
• Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking [154.2388970262703]
  Unified Vision-Language Models (UVLMs) aim to advance multimodal learning by supporting both understanding and generation within a single framework.<n>We introduce the interleaved Analyzing-Drafting problem-solving loop (AD-Loop), a new think paradigm that alternates between analytic and drafting operations.<n>By interleaving textual thoughts with visual thoughts, AD-Loop enables models to iteratively refine both comprehension and outputs, fostering genuine synergy.
  arXiv  Detail & Related papers  (2026-02-24T23:26:09Z)
• Cycle-Consistent Tuning for Layered Image Decomposition [26.331480224165364]
  Disentangling visual layers in real-world images is a persistent challenge in vision and graphics.<n>We present an in-context image decomposition framework that leverages large diffusion foundation models for layered separation.<n>Our approach achieves accurate and coherent decompositions and also generalizes effectively across other decomposition types.
  arXiv  Detail & Related papers  (2026-02-24T15:10:31Z)
• A Lightweight Deep Exclusion Unfolding Network for Single Image Reflection Removal [68.0573194557999]
  Single Image Reflection Removal (SIRR) is a canonical blind source separation problem.<n>We propose a novel Deep Exclusion unfolding Network (DExNet) for SIRR.<n>DExNet is constructed by unfolding and parameterizing a simple iterative Sparse and Auxiliary Feature Update (i-SAFU) algorithm.
  arXiv  Detail & Related papers  (2025-03-03T07:54:27Z)
• Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Method [60.88467353578118]
  We show that a fixed-point-inspired iterative approach to invert real-world images does not achieve convergence, instead oscillating between distinct clusters. We introduce a simple and fast distribution transfer technique that facilitates image enhancement, stroke-based recoloring, as well as visual prompt-guided image editing.
  arXiv  Detail & Related papers  (2024-11-17T17:45:37Z)
• Single Image Reflection Separation via Component Synergy [14.57590565534889]
  The reflection superposition phenomenon is complex and widely distributed in the real world. We propose a more general form of the superposition model by introducing a learnable residue term. In order to fully capitalize on its advantages, we further design the network structure elaborately.
  arXiv  Detail & Related papers  (2023-08-19T14:25:27Z)
• Exploring Invariant Representation for Visible-Infrared Person Re-Identification [77.06940947765406]
  Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy. In this paper, we address the problem from both image-level and feature-level in an end-to-end hybrid learning framework named robust feature mining network (RFM) Experiment results on two standard cross-spectral person re-identification datasets, RegDB and SYSU-MM01, have demonstrated state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-02-02T05:24:50Z)
• RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation [110.4255414234771]
  Existing solutions require massive training data or lack generalizability to unknown rendering configurations. We propose a novel approach that marries domain randomization and differentiable rendering gradients to address this problem. Our approach achieves significantly lower reconstruction errors and has better generalizability among unknown rendering configurations.
  arXiv  Detail & Related papers  (2022-05-11T17:59:51Z)
• SIR: Self-supervised Image Rectification via Seeing the Same Scene from Multiple Different Lenses [82.56853587380168]
  We propose a novel self-supervised image rectification (SIR) method based on an important insight that the rectified results of distorted images of the same scene from different lens should be the same. We leverage a differentiable warping module to generate the rectified images and re-distorted images from the distortion parameters. Our method achieves comparable or even better performance than the supervised baseline method and representative state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-11-30T08:23:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.