$F$, $B$, Alpha Matting

• URL: http://arxiv.org/abs/2003.07711v1
• Date: Tue, 17 Mar 2020 13:27:51 GMT
• Title: $F$, $B$, Alpha Matting
• Authors: Marco Forte and Fran\c{c}ois Piti\'e
• Abstract summary: We propose a low-cost modification to alpha matting networks to also predict the foreground and background colours. Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cutting out an object and estimating its opacity mask, known as image matting, is a key task in many image editing applications. Deep learning approaches have made significant progress by adapting the encoder-decoder architecture of segmentation networks. However, most of the existing networks only predict the alpha matte and post-processing methods must then be used to recover the original foreground and background colours in the transparent regions. Recently, two methods have shown improved results by also estimating the foreground colours, but at a significant computational and memory cost. In this paper, we propose a low-cost modification to alpha matting networks to also predict the foreground and background colours. We study variations of the training regime and explore a wide range of existing and novel loss functions for the joint prediction. Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality. It is also the current best performing method on the alphamatting.com online evaluation.

Related papers

• DiffusionMat: Alpha Matting as Sequential Refinement Learning [87.76572845943929]
  DiffusionMat is an image matting framework that employs a diffusion model for the transition from coarse to refined alpha mattes. A correction module adjusts the output at each denoising step, ensuring that the final result is consistent with the input image's structures. We evaluate our model across several image matting benchmarks, and the results indicate that DiffusionMat consistently outperforms existing methods.
  arXiv  Detail & Related papers  (2023-11-22T17:16:44Z)
• Color-aware Deep Temporal Backdrop Duplex Matting System [26.114550071165628]
  We propose a temporal multi-backdrop production system that combines beneficial features from chroma keying and alpha matting. The proposed studio set is actor friendly, and produces high-quality, temporal consistent alpha and color estimations.
  arXiv  Detail & Related papers  (2023-06-05T15:20:44Z)
• Disentangled Pre-training for Image Matting [74.10407744483526]
  Image matting requires high-quality pixel-level human annotations to support the training of a deep model. We propose a self-supervised pre-training approach that can leverage infinite numbers of data to boost the matting performance.
  arXiv  Detail & Related papers  (2023-04-03T08:16:02Z)
• Learning Prior Feature and Attention Enhanced Image Inpainting [63.21231753407192]
  This paper incorporates the pre-training based Masked AutoEncoder (MAE) into the inpainting model. We propose to use attention priors from MAE to make the inpainting model learn more long-distance dependencies between masked and unmasked regions.
  arXiv  Detail & Related papers  (2022-08-03T04:32:53Z)
• Alpha Matte Generation from Single Input for Portrait Matting [79.62140902232628]
  The goal is to predict an alpha matte that identifies the effect of each pixel on the foreground subject. Traditional approaches and most of the existing works utilized an additional input, e.g., trimap, background image, to predict alpha matte. We introduce an additional input-free approach to perform portrait matting using Generative Adversarial Nets (GANs)
  arXiv  Detail & Related papers  (2021-06-06T18:53:42Z)
• Foreground color prediction through inverse compositing [19.0945877082419]
  In natural image matting, the goal is to estimate the opacity of the foreground object in the image. In recent years, advances in deep learning have led to many natural image matting algorithms that have achieved outstanding performance in a fully automatic manner. We propose a novel recurrent neural network that can be used as a post-processing method to recover the foreground and background colors of an image.
  arXiv  Detail & Related papers  (2021-03-24T18:10:15Z)
• Fast Multi-Level Foreground Estimation [0.4588028371034407]
  The resulting alpha matte describes pixel-wise to what amount foreground and background colors contribute to the color of the composite image. While most methods in literature focus on estimating the alpha matte, the process of estimating the foreground colors given the input image and its alpha matte is often neglected. We propose a novel method for foreground estimation given the alpha matte.
  arXiv  Detail & Related papers  (2020-06-26T13:16:13Z)
• High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling [122.06593036862611]
  Existing image inpainting methods often produce artifacts when dealing with large holes in real applications. We propose an iterative inpainting method with a feedback mechanism. Experiments show that our method significantly outperforms existing methods in both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2020-05-24T13:23:45Z)
• Instance-aware Image Colorization [51.12040118366072]
  In this paper, we propose a method for achieving instance-aware colorization. Our network architecture leverages an off-the-shelf object detector to obtain cropped object images. We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
  arXiv  Detail & Related papers  (2020-05-21T17:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.