Robust Reflection Removal with Reflection-free Flash-only Cues

• URL: http://arxiv.org/abs/2103.04273v1
• Date: Sun, 7 Mar 2021 05:27:43 GMT
• Title: Robust Reflection Removal with Reflection-free Flash-only Cues
• Authors: Chenyang Lei and Qifeng Chen
• Abstract summary: We propose a reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. Our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR, 0.04 in SSIM, and 0.068 in LPIPS.
• Score: 52.46297802064146
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a simple yet effective reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. The reflection-free cue exploits a flash-only image obtained by subtracting the ambient image from the corresponding flash image in raw data space. The flash-only image is equivalent to an image taken in a dark environment with only a flash on. We observe that this flash-only image is visually reflection-free, and thus it can provide robust cues to infer the reflection in the ambient image. Since the flash-only image usually has artifacts, we further propose a dedicated model that not only utilizes the reflection-free cue but also avoids introducing artifacts, which helps accurately estimate reflection and transmission. Our experiments on real-world images with various types of reflection demonstrate the effectiveness of our model with reflection-free flash-only cues: our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR, 0.04 in SSIM, and 0.068 in LPIPS. Our source code and dataset will be publicly available at \href{https://github.com/ChenyangLEI/flash-reflection-removal}{this website}.

Related papers

• Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats [13.27784783829039]
  We introduce a simple yet effective approach for separating transmitted and reflected light. Our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D.
  arXiv  Detail & Related papers  (2024-10-03T17:59:59Z)
• Towards Flexible Interactive Reflection Removal with Human Guidance [75.38207315080624]
  Single image reflection removal is inherently ambiguous, as both the reflection and transmission components requiring separation may follow natural image statistics. Existing methods attempt to address the issue by using various types of low-level and physics-based cues as sources of reflection signals. In this paper, we aim to explore a novel flexible interactive reflection removal approach that leverages various forms of sparse human guidance.
  arXiv  Detail & Related papers  (2024-06-03T17:34:37Z)
• Single Image Reflection Removal with Reflection Intensity Prior Knowledge [14.335849624907611]
  We propose a general reflection intensity prior that captures the intensity of the reflection phenomenon. By segmenting images into regional patches, RPEN learns non-uniform reflection prior in an image. We propose Prior-based Reflection Removal Network (PRRN) using a simple transformer U-Net architecture.
  arXiv  Detail & Related papers  (2023-12-06T14:52:11Z)
• Nighttime Smartphone Reflective Flare Removal Using Optical Center Symmetry Prior [81.64647648269889]
  Reflective flare is a phenomenon that occurs when light reflects inside lenses, causing bright spots or a "ghosting effect" in photos. We propose an optical center symmetry prior, which suggests that the reflective flare and light source are always symmetrical around the lens's optical center. We create the first reflective flare removal dataset called BracketFlare, which contains diverse and realistic reflective flare patterns.
  arXiv  Detail & Related papers  (2023-03-27T09:44:40Z)
• WildLight: In-the-wild Inverse Rendering with a Flashlight [77.31815397135381]
  We propose a practical photometric solution for in-the-wild inverse rendering under unknown ambient lighting. Our system recovers scene geometry and reflectance using only multi-view images captured by a smartphone. We demonstrate by extensive experiments that our method is easy to implement, casual to set up, and consistently outperforms existing in-the-wild inverse rendering techniques.
  arXiv  Detail & Related papers  (2023-03-24T17:59:56Z)
• Robust Reflection Removal with Flash-only Cues in the Wild [88.13531903652526]
  We propose a reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. Our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR. We extend our approach to handheld photography to address the misalignment between the flash and no-flash pair.
  arXiv  Detail & Related papers  (2022-11-05T14:09:10Z)
• Polarized Reflection Removal with Perfect Alignment in the Wild [66.48211204364142]
  We present a novel formulation to removing reflection from polarized images in the wild. We first identify the misalignment issues of existing reflection removal datasets. We build a new dataset with more than 100 types of glass in which obtained transmission images are perfectly aligned with input mixed images.
  arXiv  Detail & Related papers  (2020-03-28T13:29:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.