Toward Real Flare Removal: A Comprehensive Pipeline and A New Benchmark
- URL: http://arxiv.org/abs/2306.15884v1
- Date: Wed, 28 Jun 2023 02:57:25 GMT
- Title: Toward Real Flare Removal: A Comprehensive Pipeline and A New Benchmark
- Authors: Zheyan Jin, Shiqi Chen, Huajun Feng, Zhihai Xu, Yueting Chen
- Abstract summary: We propose a well-developed methodology for generating data-pairs with flare deterioration.
The similarity of scattered flares and symmetric effect of reflected ghosts are realized.
We also construct a real-shot pipeline that respectively processes the effects of scattering and reflective flares.
- Score: 12.1632995709273
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Photographing in the under-illuminated scenes, the presence of complex light
sources often leave strong flare artifacts in images, where the intensity, the
spectrum, the reflection, and the aberration altogether contribute the
deterioration. Besides the image quality, it also influence the performance of
down-stream visual applications. Thus, removing the lens flare and ghosts is a
challenge issue especially in low-light environment. However, existing methods
for flare removal mainly restricted to the problems of inadequate simulation
and real-world capture, where the categories of scattered flares are singular
and the reflected ghosts are unavailable. Therefore, a comprehensive
deterioration procedure is crucial for constructing the dataset of flare
removal. Based on the theoretical analysis and real-world evaluation, we
propose a well-developed methodology for generating the data-pairs with flare
deterioration. The procedure is comprehensive, where the similarity of
scattered flares and the symmetric effect of reflected ghosts are realized.
Moreover, we also construct a real-shot pipeline that respectively processes
the effects of scattering and reflective flares, aiming to directly generate
the data for end-to-end methods. Experimental results show that the proposed
methodology add diversity to the existing flare datasets and construct a
comprehensive mapping procedure for flare data pairs. And our method facilities
the data-driven model to realize better restoration in flare images and
proposes a better evaluation system based on real shots, resulting promote
progress in the area of real flare removal.
Related papers
- Harmonizing Light and Darkness: A Symphony of Prior-guided Data Synthesis and Adaptive Focus for Nighttime Flare Removal [44.35766203309201]
Intense light sources often produce flares in captured images at night, which deteriorates the visual quality and negatively affects downstream applications.
In order to train an effective flare removal network, a reliable dataset is essential.
We synthesize a prior-guided dataset named Flare7K*, which contains multi-flare images where the brightness of flares adheres to the laws of illumination.
We propose a plug-and-play Adaptive Focus Module (AFM) that can adaptively mask the clean background areas and assist models in focusing on the regions severely affected by flares.
arXiv Detail & Related papers (2024-03-30T10:37:56Z) - RANRAC: Robust Neural Scene Representations via Random Ray Consensus [12.161889666145127]
RANdom RAy Consensus (RANRAC) is an efficient approach to eliminate the effect of inconsistent data.
We formulate a fuzzy adaption of the RANSAC paradigm, enabling its application to large scale models.
Results indicate significant improvements compared to state-of-the-art robust methods for novel-view synthesis.
arXiv Detail & Related papers (2023-12-15T13:33:09Z) - Toward Flare-Free Images: A Survey [1.0878040851637998]
Lens flare is an artifact that can significantly degrade image quality and affect the performance of computer vision systems.
This survey delves into the complex optics of flare formation, arising from factors like internal reflection, scattering, diffraction, and dispersion within the camera lens system.
The survey extensively covers the wide range of methods proposed for flare removal, including hardware optimization strategies, classical image processing techniques, and learning-based methods using deep learning.
arXiv Detail & Related papers (2023-10-22T16:46:12Z) - Improving Lens Flare Removal with General Purpose Pipeline and Multiple
Light Sources Recovery [69.71080926778413]
flare artifacts can affect image visual quality and downstream computer vision tasks.
Current methods do not consider automatic exposure and tone mapping in image signal processing pipeline.
We propose a solution to improve the performance of lens flare removal by revisiting the ISP and design a more reliable light sources recovery strategy.
arXiv Detail & Related papers (2023-08-31T04:58:17Z) - LLDiffusion: Learning Degradation Representations in Diffusion Models
for Low-Light Image Enhancement [118.83316133601319]
Current deep learning methods for low-light image enhancement (LLIE) typically rely on pixel-wise mapping learned from paired data.
We propose a degradation-aware learning scheme for LLIE using diffusion models, which effectively integrates degradation and image priors into the diffusion process.
arXiv Detail & Related papers (2023-07-27T07:22:51Z) - ExposureDiffusion: Learning to Expose for Low-light Image Enhancement [87.08496758469835]
This work addresses the issue by seamlessly integrating a diffusion model with a physics-based exposure model.
Our method obtains significantly improved performance and reduced inference time compared with vanilla diffusion models.
The proposed framework can work with both real-paired datasets, SOTA noise models, and different backbone networks.
arXiv Detail & Related papers (2023-07-15T04:48:35Z) - Nighttime Smartphone Reflective Flare Removal Using Optical Center
Symmetry Prior [81.64647648269889]
Reflective flare is a phenomenon that occurs when light reflects inside lenses, causing bright spots or a "ghosting effect" in photos.
We propose an optical center symmetry prior, which suggests that the reflective flare and light source are always symmetrical around the lens's optical center.
We create the first reflective flare removal dataset called BracketFlare, which contains diverse and realistic reflective flare patterns.
arXiv Detail & Related papers (2023-03-27T09:44:40Z) - AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using
Denoising Diffusion Probabilistic Models [64.24948495708337]
Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion.
Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed.
Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
arXiv Detail & Related papers (2022-08-24T03:13:04Z) - How to Train Neural Networks for Flare Removal [45.51943926089249]
We train neural networks to remove lens flare for the first time.
Our data synthesis approach is critical for accurate flare removal.
Models trained with our technique generalize well to real lens flares across different scenes, lighting conditions, and cameras.
arXiv Detail & Related papers (2020-11-25T02:23:50Z) - Learning to See Through Obstructions with Layered Decomposition [117.77024641706451]
We present a learning-based approach for removing unwanted obstructions from moving images.
Our method leverages motion differences between the background and obstructing elements to recover both layers.
We show that the proposed approach learned from synthetically generated data performs well to real images.
arXiv Detail & Related papers (2020-08-11T17:59:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.