Background Matting

• URL: http://arxiv.org/abs/2002.04433v1
• Date: Tue, 11 Feb 2020 14:46:57 GMT
• Title: Background Matting
• Authors: Hossein Javidnia, Fran\c{c}ois Piti\'e
• Abstract summary: This paper investigates the effects of utilising the background information as well as trimap in the process of alpha calculation. To achieve this goal, a state of the art method, AlphaGan is adopted and modified to process the background information as an extra input channel.
• Score: 0.40611352512781856
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The current state of the art alpha matting methods mainly rely on the trimap as the secondary and only guidance to estimate alpha. This paper investigates the effects of utilising the background information as well as trimap in the process of alpha calculation. To achieve this goal, a state of the art method, AlphaGan is adopted and modified to process the background information as an extra input channel. Extensive experiments are performed to analyse the effect of the background information in image and video matting such as training with mildly and heavily distorted backgrounds. Based on the quantitative evaluations performed on Adobe Composition-1k dataset, the proposed pipeline significantly outperforms the state of the art methods using AlphaMatting benchmark metrics.

Related papers

• DiffusionMat: Alpha Matting as Sequential Refinement Learning [87.76572845943929]
  DiffusionMat is an image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes. A correction module adjusts the output at each denoising step, ensuring that the final result is consistent with the input image's structures. We evaluate our model across several image matting benchmarks, and the results indicate that DiffusionMat consistently outperforms existing methods.
  arXiv  Detail & Related papers  (2023-11-22T17:16:44Z)
• Disentangled Pre-training for Image Matting [74.10407744483526]
  Image matting requires high-quality pixel-level human annotations to support the training of a deep model. We propose a self-supervised pre-training approach that can leverage infinite numbers of data to boost the matting performance.
  arXiv  Detail & Related papers  (2023-04-03T08:16:02Z)
• Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentation [83.31087402305306]
  robustness to trimaps and generalization to images from different domains is still under-explored. We propose an image matting method which achieves higher robustness (RMat) via multilevel context assembling and strong data augmentation targeting matting.
  arXiv  Detail & Related papers  (2022-01-18T11:45:17Z)
• Long-Range Feature Propagating for Natural Image Matting [93.20589403997505]
  Natural image matting estimates alpha values of unknown regions in the trimap. Recently, deep learning based methods propagate the alpha values from the known regions to unknown regions according to the similarity between them. We propose Long-Range Feature Propagating Network (LFPNet), which learns the long-range context features outside the reception fields for alpha matte estimation.
  arXiv  Detail & Related papers  (2021-09-25T01:17:17Z)
• Deep Video Matting via Spatio-Temporal Alignment and Aggregation [63.6870051909004]
  We propose a deep learning-based video matting framework which employs a novel aggregation feature module (STFAM) To eliminate frame-by-frame trimap annotations, a lightweight interactive trimap propagation network is also introduced. Our framework significantly outperforms conventional video matting and deep image matting methods.
  arXiv  Detail & Related papers  (2021-04-22T17:42:08Z)
• Semantic Image Matting [75.21022252141474]
  We show how to obtain better alpha mattes by incorporating into our framework semantic classification of matting regions. Specifically, we consider and learn 20 classes of matting patterns, and propose to extend the conventional trimap to semantic trimap. Experiments on multiple benchmarks show that our method outperforms other methods and has achieved the most competitive state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-04-16T16:21:02Z)
• Fast Multi-Level Foreground Estimation [0.4588028371034407]
  The resulting alpha matte describes pixel-wise to what amount foreground and background colors contribute to the color of the composite image. While most methods in literature focus on estimating the alpha matte, the process of estimating the foreground colors given the input image and its alpha matte is often neglected. We propose a novel method for foreground estimation given the alpha matte.
  arXiv  Detail & Related papers  (2020-06-26T13:16:13Z)
• Combining Deep Learning with Geometric Features for Image based Localization in the Gastrointestinal Tract [8.510792628268824]
  We propose a novel approach to combine Deep Learning method with traditional feature based approach to achieve better localization with small training data. Our method fully exploits the best of both worlds by introducing a Siamese network structure to perform few-shot classification to the closest zone in the segmented training image set. The accuracy is improved by 28.94% (Position) and 10.97% (Orientation) with respect to state-of-art method.
  arXiv  Detail & Related papers  (2020-05-11T23:04:00Z)
• $F$, $B$, Alpha Matting [0.0]
  We propose a low-cost modification to alpha matting networks to also predict the foreground and background colours. Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality.
  arXiv  Detail & Related papers  (2020-03-17T13:27:51Z)
• Natural Image Matting via Guided Contextual Attention [18.034160025888056]
  We develop a novel end-to-end approach for natural image matting with a guided contextual attention module. The proposed method can mimic information flow of affinity-based methods and utilize rich features learned by deep neural networks simultaneously. Experiment results on Composition-1k testing set and alphamatting.com benchmark dataset demonstrate that our method outperforms state-of-the-art approaches in natural image matting.
  arXiv  Detail & Related papers  (2020-01-13T05:59:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.