Location-aware Single Image Reflection Removal

• URL: http://arxiv.org/abs/2012.07131v1
• Date: Sun, 13 Dec 2020 19:34:35 GMT
• Title: Location-aware Single Image Reflection Removal
• Authors: Zheng Dong, Ke Xu, Yin Yang, Hujun Bao, Weiwei Xu, Rynson W.H. Lau
• Abstract summary: This paper proposes a novel location-aware deep learning-based single image reflection removal method. We use a reflection confidence map as the cues for the network to learn how to encode the reflection information adaptively. The integration of location information into the network significantly improves the quality of reflection removal results.
• Score: 54.93808224890273
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a novel location-aware deep learning-based single image reflection removal method. Our network has a reflection detection module to regress a probabilistic reflection confidence map, taking multi-scale Laplacian features as inputs. This probabilistic map tells whether a region is reflection-dominated or transmission-dominated. The novelty is that we use the reflection confidence map as the cues for the network to learn how to encode the reflection information adaptively and control the feature flow when predicting reflection and transmission layers. The integration of location information into the network significantly improves the quality of reflection removal results. Besides, a set of learnable Laplacian kernel parameters is introduced to facilitate the extraction of discriminative Laplacian features for reflection detection. We design our network as a recurrent network to progressively refine each iteration's reflection removal results. Extensive experiments verify the superior performance of the proposed method over state-of-the-art approaches.

Related papers

• Towards Flexible Interactive Reflection Removal with Human Guidance [75.38207315080624]
  Single image reflection removal is inherently ambiguous, as both the reflection and transmission components requiring separation may follow natural image statistics. Existing methods attempt to address the issue by using various types of low-level and physics-based cues as sources of reflection signals. In this paper, we aim to explore a novel flexible interactive reflection removal approach that leverages various forms of sparse human guidance.
  arXiv  Detail & Related papers  (2024-06-03T17:34:37Z)
• Single Image Reflection Removal with Reflection Intensity Prior Knowledge [14.335849624907611]
  We propose a general reflection intensity prior that captures the intensity of the reflection phenomenon. By segmenting images into regional patches, RPEN learns non-uniform reflection prior in an image. We propose Prior-based Reflection Removal Network (PRRN) using a simple transformer U-Net architecture.
  arXiv  Detail & Related papers  (2023-12-06T14:52:11Z)
• Revisiting Single Image Reflection Removal In the Wild [83.42368937164473]
  This research focuses on the issue of single-image reflection removal (SIRR) in real-world conditions. We devise an advanced reflection collection pipeline that is highly adaptable to a wide range of real-world reflection scenarios. We develop a large-scale, high-quality reflection dataset named Reflection Removal in the Wild (RRW)
  arXiv  Detail & Related papers  (2023-11-29T02:31:10Z)
• Improved Multiple-Image-Based Reflection Removal Algorithm Using Deep Neural Networks [13.16514846876752]
  Reflection of another scene can often be found in a semi-reflective medium such as glass. In this paper, a novel deep neural network approach for solving the reflection problem in imaging is presented.
  arXiv  Detail & Related papers  (2022-08-09T11:55:53Z)
• Iterative Gradient Encoding Network with Feature Co-Occurrence Loss for Single Image Reflection Removal [6.370905925442655]
  We propose an iterative gradient encoding network for single image reflection removal. Our method can remove reflection favorably against the existing state-of-the-art method on all imaging settings.
  arXiv  Detail & Related papers  (2021-03-29T19:29:29Z)
• Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance [78.34235841168031]
  We present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR) RAG can be used (i) to mitigate the effect of reflection from the observation, and (ii) to generate mask in partial convolution for mitigating the effect of deviating from linear combination hypothesis. Experiments on five commonly used datasets demonstrate the quantitative and qualitative superiority of our RAGNet in comparison to the state-of-the-art SIRR methods.
  arXiv  Detail & Related papers  (2020-12-02T03:14:57Z)
• Learning to See Through Obstructions with Layered Decomposition [117.77024641706451]
  We present a learning-based approach for removing unwanted obstructions from moving images. Our method leverages motion differences between the background and obstructing elements to recover both layers. We show that the proposed approach learned from synthetically generated data performs well to real images.
  arXiv  Detail & Related papers  (2020-08-11T17:59:31Z)
• Single image reflection removal via learning with multi-image constraints [50.54095311597466]
  We propose a novel learning-based solution that combines the advantages of the aforementioned approaches and overcomes their drawbacks. Our algorithm works by learning a deep neural network to optimize the target with joint constraints enhanced among multiple input images. Our algorithm runs in real-time and state-of-the-art reflection removal performance on real images.
  arXiv  Detail & Related papers  (2019-12-08T06:10:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.