The Shape Part Slot Machine: Contact-based Reasoning for Generating 3D Shapes from Parts

• URL: http://arxiv.org/abs/2112.00584v1
• Date: Wed, 1 Dec 2021 15:54:54 GMT
• Title: The Shape Part Slot Machine: Contact-based Reasoning for Generating 3D Shapes from Parts
• Authors: Kai Wang, Paul Guerrero, Vladimir Kim, Siddhartha Chaudhuri, Minhyuk Sung, Daniel Ritchie
• Abstract summary: We present a new method for assembling novel 3D shapes from existing parts by performing contact-based reasoning. Our method represents each shape as a graph of "slots," where each slot is a region of contact between two shape parts. We demonstrate that our method generates shapes that outperform existing modeling-by-assembly approaches in terms of quality, diversity, and structural complexity.
• Score: 33.924785333723115
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present the Shape Part Slot Machine, a new method for assembling novel 3D shapes from existing parts by performing contact-based reasoning. Our method represents each shape as a graph of "slots," where each slot is a region of contact between two shape parts. Based on this representation, we design a graph-neural-network-based model for generating new slot graphs and retrieving compatible parts, as well as a gradient-descent-based optimization scheme for assembling the retrieved parts into a complete shape that respects the generated slot graph. This approach does not require any semantic part labels; interestingly, it also does not require complete part geometries -- reasoning about the regions where parts connect proves sufficient to generate novel, high-quality 3D shapes. We demonstrate that our method generates shapes that outperform existing modeling-by-assembly approaches in terms of quality, diversity, and structural complexity.

Related papers

• Part123: Part-aware 3D Reconstruction from a Single-view Image [54.589723979757515]
  Part123 is a novel framework for part-aware 3D reconstruction from a single-view image. We introduce contrastive learning into a neural rendering framework to learn a part-aware feature space. A clustering-based algorithm is also developed to automatically derive 3D part segmentation results from the reconstructed models.
  arXiv  Detail & Related papers  (2024-05-27T07:10:21Z)
• NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation [52.772319840580074]
  3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation. We introduce a novel spatial-aware 3D shape generation framework that leverages 2D plane representations for enhanced 3D shape modeling.
  arXiv  Detail & Related papers  (2024-03-27T04:09:34Z)
• Diverse Part Synthesis for 3D Shape Creation [5.203892715273396]
  Methods that use neural networks for 3D shapes in the form of a part-based representation have been introduced over the last few years. Current methods do not allow easily regenerating individual shape parts according to user preferences. We investigate techniques that allow the user to generate multiple, diverse suggestions for individual parts.
  arXiv  Detail & Related papers  (2024-01-17T17:55:06Z)
• Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes [118.406721663244]
  We introduce a novel part-level modelling and alignment framework that facilitates abstraction modelling and cross-modal correspondence. Our approach seamlessly extends to sketch modelling by establishing correspondence between CLIPasso edgemaps and projected 3D part regions.
  arXiv  Detail & Related papers  (2023-12-07T05:04:33Z)
• Geometrically Consistent Partial Shape Matching [50.29468769172704]
  Finding correspondences between 3D shapes is a crucial problem in computer vision and graphics. An often neglected but essential property of matching geometrics is consistency. We propose a novel integer linear programming partial shape matching formulation.
  arXiv  Detail & Related papers  (2023-09-10T12:21:42Z)
• Attention-based Part Assembly for 3D Volumetric Shape Modeling [0.0]
  We propose a VoxAttention network architecture for attention-based part assembly. Experimental results show that our method outperforms most state-of-the-art methods for the part relation-aware 3D shape modeling task.
  arXiv  Detail & Related papers  (2023-04-17T16:53:27Z)
• SP-GAN: Sphere-Guided 3D Shape Generation and Manipulation [50.53931728235875]
  We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds. Compared with existing models, SP-GAN is able to synthesize diverse and high-quality shapes with fine details.
  arXiv  Detail & Related papers  (2021-08-10T06:49:45Z)
• Learning to generate shape from global-local spectra [0.0]
  We build our method on top of recent advances on the so called shape-from-spectrum paradigm. We consider the spectrum as a natural and ready to use representation to encode variability of the shapes. Our results confirm the improvement of the proposed approach in comparison to existing and alternative methods.
  arXiv  Detail & Related papers  (2021-08-04T16:39:56Z)
• Discovering 3D Parts from Image Collections [98.16987919686709]
  We tackle the problem of 3D part discovery from only 2D image collections. Instead of relying on manually annotated parts for supervision, we propose a self-supervised approach. Our key insight is to learn a novel part shape prior that allows each part to fit an object shape faithfully while constrained to have simple geometry.
  arXiv  Detail & Related papers  (2021-07-28T20:29:16Z)
• COALESCE: Component Assembly by Learning to Synthesize Connections [45.120186220205994]
  We introduce COALESCE, the first data-driven framework for component-based shape assembly. We use a joint synthesis step, which is learned from data, to fill the gap and arrive at a natural and plausible part joint. We demonstrate that our method significantly outperforms prior approaches including baseline deep models for 3D shape synthesis.
  arXiv  Detail & Related papers  (2020-08-05T05:12:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.