Human Perception Modeling for Automatic Natural Image Matting
- URL: http://arxiv.org/abs/2103.17020v1
- Date: Wed, 31 Mar 2021 12:08:28 GMT
- Title: Human Perception Modeling for Automatic Natural Image Matting
- Authors: Yuhongze Zhou, Liguang Zhou, Tin Lun Lam, Yangsheng Xu
- Abstract summary: Natural image matting aims to precisely separate foreground objects from background using alpha matte.
We propose an intuitively-designed trimap-free two-stage matting approach without additional annotations.
Our matting algorithm has competitive performance with current state-of-the-art methods in both trimap-free and trimap-needed aspects.
- Score: 2.179313476241343
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Natural image matting aims to precisely separate foreground objects from
background using alpha matte. Fully automatic natural image matting without
external annotation is quite challenging. Well-performed matting methods
usually require accurate handcrafted trimap as extra input, which is
labor-intensive and time-consuming, while the performance of automatic trimap
generation method of dilating foreground segmentation fluctuates with
segmentation quality. In this paper, we argue that how to handle trade-off of
additional information input is a major issue in automatic matting, which we
decompose into two subtasks: trimap and alpha estimation. By leveraging
easily-accessible coarse annotations and modeling alpha matte handmade process
of capturing rough foreground/background/transition boundary and carving
delicate details in transition region, we propose an intuitively-designed
trimap-free two-stage matting approach without additional annotations, e.g.
trimap and background image. Specifically, given an image and its coarse
foreground segmentation, Trimap Generation Network estimates probabilities of
foreground, unknown, and background regions to guide alpha feature flow of our
proposed Non-Local Matting network, which is equipped with trimap-guided global
aggregation attention block. Experimental results show that our matting
algorithm has competitive performance with current state-of-the-art methods in
both trimap-free and trimap-needed aspects.
Related papers
- Learning Trimaps via Clicks for Image Matting [103.6578944248185]
We introduce Click2Trimap, an interactive model capable of predicting high-quality trimaps and alpha mattes with minimal user click inputs.
In the user study, Click2Trimap achieves high-quality trimap and matting predictions in just an average of 5 seconds per image.
arXiv Detail & Related papers (2024-03-30T12:10:34Z) - DiffusionMat: Alpha Matting as Sequential Refinement Learning [87.76572845943929]
DiffusionMat is an image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes.
A correction module adjusts the output at each denoising step, ensuring that the final result is consistent with the input image's structures.
We evaluate our model across several image matting benchmarks, and the results indicate that DiffusionMat consistently outperforms existing methods.
arXiv Detail & Related papers (2023-11-22T17:16:44Z) - Deep Image Matting: A Comprehensive Survey [85.77905619102802]
This paper presents a review of recent advancements in image matting in the era of deep learning.
We focus on two fundamental sub-tasks: auxiliary input-based image matting and automatic image matting.
We discuss relevant applications of image matting and highlight existing challenges and potential opportunities for future research.
arXiv Detail & Related papers (2023-04-10T15:48:55Z) - PP-Matting: High-Accuracy Natural Image Matting [11.68134059283327]
PP-Matting is a trimap-free architecture that can achieve high-accuracy natural image matting.
Our method applies a high-resolution detail branch (HRDB) that extracts fine-grained details of the foreground.
Also, we propose a semantic context branch (SCB) that adopts a semantic segmentation subtask.
arXiv Detail & Related papers (2022-04-20T12:54:06Z) - Deep Image Matting with Flexible Guidance Input [16.651948566049846]
We propose a matting method that use Flexible Guidance Input as user hint.
Our method can achieve state-of-the-art results comparing with existing trimap-based and trimap-free methods.
arXiv Detail & Related papers (2021-10-21T04:59:27Z) - Deep Automatic Natural Image Matting [82.56853587380168]
Automatic image matting (AIM) refers to estimating the soft foreground from an arbitrary natural image without any auxiliary input like trimap.
We propose a novel end-to-end matting network, which can predict a generalized trimap for any image of the above types as a unified semantic representation.
Our network trained on available composite matting datasets outperforms existing methods both objectively and subjectively.
arXiv Detail & Related papers (2021-07-15T10:29:01Z) - Semantic Image Matting [75.21022252141474]
We show how to obtain better alpha mattes by incorporating into our framework semantic classification of matting regions.
Specifically, we consider and learn 20 classes of matting patterns, and propose to extend the conventional trimap to semantic trimap.
Experiments on multiple benchmarks show that our method outperforms other methods and has achieved the most competitive state-of-the-art performance.
arXiv Detail & Related papers (2021-04-16T16:21:02Z) - Salient Image Matting [0.0]
We propose an image matting framework called Salient Image Matting to estimate the per-pixel opacity value of the most salient foreground in an image.
Our framework simultaneously deals with the challenge of learning a wide range of semantics and salient object types.
Our framework requires only a fraction of expensive matting data as compared to other automatic methods.
arXiv Detail & Related papers (2021-03-23T06:22:33Z) - Improved Image Matting via Real-time User Clicks and Uncertainty
Estimation [87.84632514927098]
This paper proposes an improved deep image matting framework which is trimap-free and only needs several user click interactions to eliminate the ambiguity.
We introduce a new uncertainty estimation module that can predict which parts need polishing and a following local refinement module.
Results show that our method performs better than existing trimap-free methods and comparably to state-of-the-art trimap-based methods with minimal user effort.
arXiv Detail & Related papers (2020-12-15T14:32:36Z) - AlphaNet: An Attention Guided Deep Network for Automatic Image Matting [0.0]
We propose an end to end solution for image matting i.e. high-precision extraction of foreground objects from natural images.
We propose a method that assimilates semantic segmentation and deep image matting processes into a single network to generate semantic mattes.
We also construct a fashion e-commerce focused dataset with high-quality alpha mattes to facilitate the training and evaluation for image matting.
arXiv Detail & Related papers (2020-03-07T17:25:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.