Polarized Reflection Removal with Perfect Alignment in the Wild
- URL: http://arxiv.org/abs/2003.12789v1
- Date: Sat, 28 Mar 2020 13:29:31 GMT
- Title: Polarized Reflection Removal with Perfect Alignment in the Wild
- Authors: Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun and
Qifeng Chen
- Abstract summary: We present a novel formulation to removing reflection from polarized images in the wild.
We first identify the misalignment issues of existing reflection removal datasets.
We build a new dataset with more than 100 types of glass in which obtained transmission images are perfectly aligned with input mixed images.
- Score: 66.48211204364142
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a novel formulation to removing reflection from polarized images
in the wild. We first identify the misalignment issues of existing reflection
removal datasets where the collected reflection-free images are not perfectly
aligned with input mixed images due to glass refraction. Then we build a new
dataset with more than 100 types of glass in which obtained transmission images
are perfectly aligned with input mixed images. Second, capitalizing on the
special relationship between reflection and polarized light, we propose a
polarized reflection removal model with a two-stage architecture. In addition,
we design a novel perceptual NCC loss that can improve the performance of
reflection removal and general image decomposition tasks. We conduct extensive
experiments, and results suggest that our model outperforms state-of-the-art
methods on reflection removal.
Related papers
- Planar Reflection-Aware Neural Radiance Fields [32.709468082010126]
We introduce a reflection-aware NeRF that jointly models planar reflectors, such as windows, and explicitly casts reflected rays to capture the source of the high-frequency reflections.
Rendering along the primary ray results in a clean, reflection-free view, while explicitly rendering along the reflected ray allows us to reconstruct highly detailed reflections.
arXiv Detail & Related papers (2024-11-07T18:55:08Z) - NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images [62.752710734332894]
NeRSP is a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images.
We derive photometric and geometric cues from the polarimetric image formation model and multiview azimuth consistency.
We achieve the state-of-the-art surface reconstruction results with only 6 views as input.
arXiv Detail & Related papers (2024-06-11T09:53:18Z) - Reflection Removal Using Recurrent Polarization-to-Polarization Network [14.97144413954432]
We propose a polarization-to-polarization approach that applies polarized images as the inputs and predicts "polarized" reflection and transmission images.
Experimental results on a public dataset demonstrate that our method outperforms other state-of-the-art methods.
arXiv Detail & Related papers (2024-02-28T09:08:22Z) - Revisiting Single Image Reflection Removal In the Wild [83.42368937164473]
This research focuses on the issue of single-image reflection removal (SIRR) in real-world conditions.
We devise an advanced reflection collection pipeline that is highly adaptable to a wide range of real-world reflection scenarios.
We develop a large-scale, high-quality reflection dataset named Reflection Removal in the Wild (RRW)
arXiv Detail & Related papers (2023-11-29T02:31:10Z) - A Categorized Reflection Removal Dataset with Diverse Real-world Scenes [54.662456878340215]
We construct a new reflection removal dataset that is categorized, diverse, and real-world (CDR)
The dataset is constructed using diverse glass types under various environments to ensure diversity.
We show that state-of-the-art reflection removal methods generally perform well on blurry reflection but fail in obtaining satisfying performance on other types of real-world reflection.
arXiv Detail & Related papers (2021-08-07T06:56:57Z) - ReflectNet -- A Generative Adversarial Method for Single Image
Reflection Suppression [0.6980076213134382]
We propose a single image reflection removal method based on context understanding modules and adversarial training.
Our proposed reflection removal method outperforms state-of-the-art methods in terms of PSNR and SSIM on the SIR benchmark dataset.
arXiv Detail & Related papers (2021-05-11T17:33:40Z) - Iterative Gradient Encoding Network with Feature Co-Occurrence Loss for
Single Image Reflection Removal [6.370905925442655]
We propose an iterative gradient encoding network for single image reflection removal.
Our method can remove reflection favorably against the existing state-of-the-art method on all imaging settings.
arXiv Detail & Related papers (2021-03-29T19:29:29Z) - Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance [78.34235841168031]
We present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR)
RAG can be used (i) to mitigate the effect of reflection from the observation, and (ii) to generate mask in partial convolution for mitigating the effect of deviating from linear combination hypothesis.
Experiments on five commonly used datasets demonstrate the quantitative and qualitative superiority of our RAGNet in comparison to the state-of-the-art SIRR methods.
arXiv Detail & Related papers (2020-12-02T03:14:57Z) - Learning to See Through Obstructions with Layered Decomposition [117.77024641706451]
We present a learning-based approach for removing unwanted obstructions from moving images.
Our method leverages motion differences between the background and obstructing elements to recover both layers.
We show that the proposed approach learned from synthetically generated data performs well to real images.
arXiv Detail & Related papers (2020-08-11T17:59:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.