Multimodal Shape Completion via Conditional Generative Adversarial Networks

• URL: http://arxiv.org/abs/2003.07717v3
• Date: Wed, 8 Jul 2020 13:38:29 GMT
• Title: Multimodal Shape Completion via Conditional Generative Adversarial Networks
• Authors: Rundi Wu, Xuelin Chen, Yixin Zhuang, Baoquan Chen
• Abstract summary: Several deep learning methods have been proposed for completing partial data from shape acquisition setups. We seek to complete the partial shape with multiple outputs by learning a one-to-many mapping. We develop the first multimodal shape completion method that completes the partial shape via conditional generative modeling.
• Score: 34.51271516263473
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Several deep learning methods have been proposed for completing partial data from shape acquisition setups, i.e., filling the regions that were missing in the shape. These methods, however, only complete the partial shape with a single output, ignoring the ambiguity when reasoning the missing geometry. Hence, we pose a multi-modal shape completion problem, in which we seek to complete the partial shape with multiple outputs by learning a one-to-many mapping. We develop the first multimodal shape completion method that completes the partial shape via conditional generative modeling, without requiring paired training data. Our approach distills the ambiguity by conditioning the completion on a learned multimodal distribution of possible results. We extensively evaluate the approach on several datasets that contain varying forms of shape incompleteness, and compare among several baseline methods and variants of our methods qualitatively and quantitatively, demonstrating the merit of our method in completing partial shapes with both diversity and quality.

Related papers

• Beyond Complete Shapes: A quantitative Evaluation of 3D Shape Matching Algorithms [41.95394677818476]
  Finding correspondences between 3D shapes is an important problem in computer vision, graphics and beyond. We provide a generic and flexible framework for the procedural generation of challenging partial shape matching scenarios. We manually create cross-dataset correspondences between seven existing (complete geometry) shape matching datasets, leading to a total of 2543 shapes.
  arXiv  Detail & Related papers  (2024-11-05T21:08:19Z)
• 3D Shape Completion on Unseen Categories:A Weakly-supervised Approach [61.76304400106871]
  We introduce a novel weakly-supervised framework to reconstruct the complete shapes from unseen categories. We first propose an end-to-end prior-assisted shape learning network that leverages data from the seen categories to infer a coarse shape. In addition, we propose a self-supervised shape refinement model to further refine the coarse shape.
  arXiv  Detail & Related papers  (2024-01-19T09:41:09Z)
• Diverse Shape Completion via Style Modulated Generative Adversarial Networks [0.0]
  Shape completion aims to recover the full 3D geometry of an object from a partial observation. This problem is inherently multi-modal since there can be many ways to plausibly complete the missing regions of a shape. We propose a novel conditional generative adversarial network that can produce many diverse plausible completions of a partially observed point cloud.
  arXiv  Detail & Related papers  (2023-11-18T23:40:20Z)
• Geometrically Consistent Partial Shape Matching [50.29468769172704]
  Finding correspondences between 3D shapes is a crucial problem in computer vision and graphics. An often neglected but essential property of matching geometrics is consistency. We propose a novel integer linear programming partial shape matching formulation.
  arXiv  Detail & Related papers  (2023-09-10T12:21:42Z)
• PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformation [59.70430570779819]
  We introduce a data-driven shape completion approach that focuses on completing geometric details of missing regions of 3D shapes. Our key insight is to copy and deform patches from the partial input to complete missing regions. We leverage repeating patterns by retrieving patches from the partial input, and learn global structural priors by using a neural network to guide the retrieval and deformation steps.
  arXiv  Detail & Related papers  (2022-07-24T18:59:09Z)
• Shape Completion via IMLE [9.716911810130576]
  Shape completion is the problem of completing partial input shapes such as partial scans. We propose a novel multimodal shape completion technique that is effectively able to learn a one-to-many mapping. We show that our method is superior to alternatives in terms of completeness and diversity of shapes.
  arXiv  Detail & Related papers  (2021-06-30T17:45:10Z)
• Unsupervised 3D Shape Completion through GAN Inversion [116.27680045885849]
  We present ShapeInversion, which introduces Generative Adrial Network (GAN) inversion to shape completion for the first time. ShapeInversion uses a GAN pre-trained on complete shapes by searching for a latent code that gives a complete shape that best fits the given partial input. On the ShapeNet benchmark, the proposed ShapeInversion outperforms the SOTA unsupervised method, and is comparable with supervised methods that are learned using paired data.
  arXiv  Detail & Related papers  (2021-04-27T17:53:46Z)
• Isometric Multi-Shape Matching [50.86135294068138]
  Finding correspondences between shapes is a fundamental problem in computer vision and graphics. While isometries are often studied in shape correspondence problems, they have not been considered explicitly in the multi-matching setting. We present a suitable optimisation algorithm for solving our formulation and provide a convergence and complexity analysis.
  arXiv  Detail & Related papers  (2020-12-04T15:58:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.