Unsupervised Foreground-Background Segmentation with Equivariant Layered GANs

• URL: http://arxiv.org/abs/2104.00483v1
• Date: Thu, 1 Apr 2021 14:13:25 GMT
• Title: Unsupervised Foreground-Background Segmentation with Equivariant Layered GANs
• Authors: Yu Yang, Hakan Bilen, Qiran Zou, Wing Yin Cheung, Xiangyang Ji
• Abstract summary: We propose an unsupervised foreground-background segmentation method via training a segmentation network on the synthetic pseudo segmentation dataset generated from GANs. To efficiently generate foreground and background layers and overlay them to compose novel images, the construction of such GANs is fulfilled by our proposed Equivariant Layered GAN. Our methods are evaluated on unsupervised object segmentation datasets including Caltech-UCSD Birds and LSUN Car, achieving state-of-the-art performance.
• Score: 48.3919579579129
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose an unsupervised foreground-background segmentation method via training a segmentation network on the synthetic pseudo segmentation dataset generated from GANs, which are trained from a collection of images without annotations to explicitly disentangle foreground and background. To efficiently generate foreground and background layers and overlay them to compose novel images, the construction of such GANs is fulfilled by our proposed Equivariant Layered GAN, whose improvement, compared to the precedented layered GAN, is embodied in the following two aspects. (1) The disentanglement of foreground and background is improved by extending the previous perturbation strategy and introducing private code recovery that reconstructs the private code of foreground from the composite image. (2) The latent space of the layered GANs is regularized by minimizing our proposed equivariance loss, resulting in interpretable latent codes and better disentanglement of foreground and background. Our methods are evaluated on unsupervised object segmentation datasets including Caltech-UCSD Birds and LSUN Car, achieving state-of-the-art performance.

Related papers

• Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removal [5.083330121710086]
  GAN-based training often faces issues such as mode collapse and unstable optimization. We propose a semantic-guided adversarial diffusion framework for self-supervised shadow removal. We conduct experiments on multiple public datasets, and the experimental results demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2024-07-01T09:14:38Z)
• GIFD: A Generative Gradient Inversion Method with Feature Domain Optimization [52.55628139825667]
  Federated Learning (FL) has emerged as a promising distributed machine learning framework to preserve clients' privacy. Recent studies find that an attacker can invert the shared gradients and recover sensitive data against an FL system by leveraging pre-trained generative adversarial networks (GAN) as prior knowledge. We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD), which disassembles the GAN model and searches the feature domains of the intermediate layers.
  arXiv  Detail & Related papers  (2023-08-09T04:34:21Z)
• ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentation [49.61394755739333]
  Unsupervised foreground-background segmentation aims at extracting salient objects from cluttered backgrounds. We propose a simple-yet-effective explicit layer independence modeling approach, termed Independent Layer Synthesis GAN (ILSGAN) Our ILSGAN achieves strong state-of-the-art generation quality and segmentation performance on complex real-world data.
  arXiv  Detail & Related papers  (2022-11-25T09:35:46Z)
• Progressively Dual Prior Guided Few-shot Semantic Segmentation [57.37506990980975]
  Few-shot semantic segmentation task aims at performing segmentation in query images with a few annotated support samples. We propose a progressively dual prior guided few-shot semantic segmentation network.
  arXiv  Detail & Related papers  (2022-11-20T16:19:47Z)
• Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models [92.92095626286223]
  We develop an automatic procedure for finding directions that lead to foreground-background image separation. We use these directions to train an image segmentation model without human supervision.
  arXiv  Detail & Related papers  (2021-05-17T19:34:24Z)
• Labels4Free: Unsupervised Segmentation using StyleGAN [40.39780497423365]
  We propose an unsupervised segmentation framework for StyleGAN generated objects. We report comparable results against state-of-the-art supervised segmentation networks.
  arXiv  Detail & Related papers  (2021-03-27T18:59:22Z)
• Deep Semantic Matching with Foreground Detection and Cycle-Consistency [103.22976097225457]
  We address weakly supervised semantic matching based on a deep network. We explicitly estimate the foreground regions to suppress the effect of background clutter. We develop cycle-consistent losses to enforce the predicted transformations across multiple images to be geometrically plausible and consistent.
  arXiv  Detail & Related papers  (2020-03-31T22:38:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.