Foreground color prediction through inverse compositing
- URL: http://arxiv.org/abs/2103.13423v1
- Date: Wed, 24 Mar 2021 18:10:15 GMT
- Title: Foreground color prediction through inverse compositing
- Authors: Sebastian Lutz, Aljosa Smolic
- Abstract summary: In natural image matting, the goal is to estimate the opacity of the foreground object in the image.
In recent years, advances in deep learning have led to many natural image matting algorithms that have achieved outstanding performance in a fully automatic manner.
We propose a novel recurrent neural network that can be used as a post-processing method to recover the foreground and background colors of an image.
- Score: 19.0945877082419
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In natural image matting, the goal is to estimate the opacity of the
foreground object in the image. This opacity controls the way the foreground
and background is blended in transparent regions. In recent years, advances in
deep learning have led to many natural image matting algorithms that have
achieved outstanding performance in a fully automatic manner. However, most of
these algorithms only predict the alpha matte from the image, which is not
sufficient to create high-quality compositions. Further, it is not possible to
manually interact with these algorithms in any way except by directly changing
their input or output. We propose a novel recurrent neural network that can be
used as a post-processing method to recover the foreground and background
colors of an image, given an initial alpha estimation. Our method outperforms
the state-of-the-art in color estimation for natural image matting and show
that the recurrent nature of our method allows users to easily change candidate
solutions that lead to superior color estimations.
Related papers
- DiffusionMat: Alpha Matting as Sequential Refinement Learning [87.76572845943929]
DiffusionMat is an image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes.
A correction module adjusts the output at each denoising step, ensuring that the final result is consistent with the input image's structures.
We evaluate our model across several image matting benchmarks, and the results indicate that DiffusionMat consistently outperforms existing methods.
arXiv Detail & Related papers (2023-11-22T17:16:44Z) - Incorporating Ensemble and Transfer Learning For An End-To-End
Auto-Colorized Image Detection Model [0.0]
This paper presents a novel approach that combines the advantages of transfer and ensemble learning approaches to help reduce training time and resource requirements.
The proposed model shows promising results, with accuracy ranging from 94.55% to 99.13%.
arXiv Detail & Related papers (2023-09-25T19:22:57Z) - Deep Richardson-Lucy Deconvolution for Low-Light Image Deblurring [48.80983873199214]
We develop a data-driven approach to model the saturated pixels by a learned latent map.
Based on the new model, the non-blind deblurring task can be formulated into a maximum a posterior (MAP) problem.
To estimate high-quality deblurred images without amplified artifacts, we develop a prior estimation network.
arXiv Detail & Related papers (2023-08-10T12:53:30Z) - $PC^2$: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D
Reconstruction [97.06927852165464]
Reconstructing the 3D shape of an object from a single RGB image is a long-standing and highly challenging problem in computer vision.
We propose a novel method for single-image 3D reconstruction which generates a sparse point cloud via a conditional denoising diffusion process.
arXiv Detail & Related papers (2023-02-21T13:37:07Z) - Long-Range Feature Propagating for Natural Image Matting [93.20589403997505]
Natural image matting estimates alpha values of unknown regions in the trimap.
Recently, deep learning based methods propagate the alpha values from the known regions to unknown regions according to the similarity between them.
We propose Long-Range Feature Propagating Network (LFPNet), which learns the long-range context features outside the reception fields for alpha matte estimation.
arXiv Detail & Related papers (2021-09-25T01:17:17Z) - Deep Automatic Natural Image Matting [82.56853587380168]
Automatic image matting (AIM) refers to estimating the soft foreground from an arbitrary natural image without any auxiliary input like trimap.
We propose a novel end-to-end matting network, which can predict a generalized trimap for any image of the above types as a unified semantic representation.
Our network trained on available composite matting datasets outperforms existing methods both objectively and subjectively.
arXiv Detail & Related papers (2021-07-15T10:29:01Z) - Fast Multi-Level Foreground Estimation [0.4588028371034407]
The resulting alpha matte describes pixel-wise to what amount foreground and background colors contribute to the color of the composite image.
While most methods in literature focus on estimating the alpha matte, the process of estimating the foreground colors given the input image and its alpha matte is often neglected.
We propose a novel method for foreground estimation given the alpha matte.
arXiv Detail & Related papers (2020-06-26T13:16:13Z) - High-Resolution Image Inpainting with Iterative Confidence Feedback and
Guided Upsampling [122.06593036862611]
Existing image inpainting methods often produce artifacts when dealing with large holes in real applications.
We propose an iterative inpainting method with a feedback mechanism.
Experiments show that our method significantly outperforms existing methods in both quantitative and qualitative evaluations.
arXiv Detail & Related papers (2020-05-24T13:23:45Z) - $F$, $B$, Alpha Matting [0.0]
We propose a low-cost modification to alpha matting networks to also predict the foreground and background colours.
Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality.
arXiv Detail & Related papers (2020-03-17T13:27:51Z) - Natural Image Matting via Guided Contextual Attention [18.034160025888056]
We develop a novel end-to-end approach for natural image matting with a guided contextual attention module.
The proposed method can mimic information flow of affinity-based methods and utilize rich features learned by deep neural networks simultaneously.
Experiment results on Composition-1k testing set and alphamatting.com benchmark dataset demonstrate that our method outperforms state-of-the-art approaches in natural image matting.
arXiv Detail & Related papers (2020-01-13T05:59:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.