DeepMend: Learning Occupancy Functions to Represent Shape for Repair

• URL: http://arxiv.org/abs/2210.05728v1
• Date: Tue, 11 Oct 2022 18:42:20 GMT
• Title: DeepMend: Learning Occupancy Functions to Represent Shape for Repair
• Authors: Nikolas Lamb, Sean Banerjee, and Natasha Kholgade Banerjee
• Abstract summary: DeepMend is a novel approach to reconstruct restorations to fractured shapes using learned occupancy functions. We represent the occupancy of a fractured shape as the conjunction of the occupancy of an underlying complete shape and the fracture surface. We show results with simulated fractures on synthetic and real-world scanned objects, and with scanned real fractured mugs.
• Score: 0.6087960723103347
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present DeepMend, a novel approach to reconstruct restorations to fractured shapes using learned occupancy functions. Existing shape repair approaches predict low-resolution voxelized restorations, or require symmetries or access to a pre-existing complete oracle. We represent the occupancy of a fractured shape as the conjunction of the occupancy of an underlying complete shape and the fracture surface, which we model as functions of latent codes using neural networks. Given occupancy samples from an input fractured shape, we estimate latent codes using an inference loss augmented with novel penalty terms that avoid empty or voluminous restorations. We use inferred codes to reconstruct the restoration shape. We show results with simulated fractures on synthetic and real-world scanned objects, and with scanned real fractured mugs. Compared to the existing voxel approach and two baseline methods, our work shows state-of-the-art results in accuracy and avoiding restoration artifacts over non-fracture regions of the fractured shape.

Related papers

• 3D Shape Completion with Test-Time Training [6.764513343390546]
  We use a decoder network motivated by related work on the prediction of signed distance functions (DeepSDF) We demonstrate that our overfitting to the fractured parts leads to significant improvements in the restoration of eight different shape categories of the ShapeNet data set in terms of their chamfer distances.
  arXiv  Detail & Related papers  (2024-10-24T11:59:32Z)
• Shape Matters: Detecting Vertebral Fractures Using Differentiable Point-Based Shape Decoding [51.38395069380457]
  Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae.
  arXiv  Detail & Related papers  (2023-12-08T18:11:22Z)
• DeepFracture: A Generative Approach for Predicting Brittle Fractures [2.7669937245634757]
  This paper introduces a novel learning-based approach for seamlessly merging realistic brittle fracture animations with rigid-body simulations. Our method utilizes BEM brittle fracture simulations to create fractured patterns and collision conditions for a given shape. Our experimental results demonstrate that our approach can generate significantly more detailed brittle fractures compared to existing techniques.
  arXiv  Detail & Related papers  (2023-10-20T08:15:13Z)
• Pix2Repair: Implicit Shape Restoration from Images [7.663519916453075]
  Pix2Repair takes an image of a fractured object as input and automatically generates a 3D printable restoration shape. We also introduce Fantastic Breaks Imaged, the first large-scale dataset of 11,653 real-world images of fractured objects.
  arXiv  Detail & Related papers  (2023-05-29T17:48:09Z)
• Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Grading [72.45699658852304]
  This paper proposes a novel approach to train a generative Diffusion Autoencoder model as an unsupervised feature extractor. We model fracture grading as a continuous regression, which is more reflective of the smooth progression of fractures. Importantly, the generative nature of our method allows us to visualize different grades of a given vertebra, providing interpretability and insight into the features that contribute to automated grading.
  arXiv  Detail & Related papers  (2023-03-21T17:16:01Z)
• NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies [87.06532943371575]
  We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. In this paper, we propose to represent surfaces as the Unsigned Distance Function (UDF) and develop a new volume rendering scheme to learn the neural UDF representation.
  arXiv  Detail & Related papers  (2022-11-25T15:21:45Z)
• DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair [0.684225774857327]
  DeepJoin is an automated approach to generate high-resolution repairs for fractured shapes using deep neural networks. We present a novel implicit shape representation for fractured shape repair that combines the occupancy function, signed distance function, and normal field.
  arXiv  Detail & Related papers  (2022-11-22T16:44:57Z)
• 3D Textured Shape Recovery with Learned Geometric Priors [58.27543892680264]
  This technical report presents our approach to address limitations by incorporating learned geometric priors. We generate a SMPL model from learned pose prediction and fuse it into the partial input to add prior knowledge of human bodies. We also propose a novel completeness-aware bounding box adaptation for handling different levels of scales.
  arXiv  Detail & Related papers  (2022-09-07T16:03:35Z)
• Point Scene Understanding via Disentangled Instance Mesh Reconstruction [21.92736190195887]
  We propose aDisentangled Instance Mesh Reconstruction (DIMR) framework for effective point scene understanding. A segmentation-based backbone is applied to reduce false positive object proposals. We leverage a mesh-aware latent code space to disentangle the processes of shape completion and mesh generation.
  arXiv  Detail & Related papers  (2022-03-31T06:36:07Z)
• A Self-Supervised Deep Framework for Reference Bony Shape Estimation in Orthognathic Surgical Planning [55.30223654196882]
  A virtual orthognathic surgical planning involves simulating surgical corrections of jaw deformities on 3D facial bony shape models. A reference facial bony shape model representing normal anatomies can provide an objective guidance to improve planning accuracy. We propose a self-supervised deep framework to automatically estimate reference facial bony shape models.
  arXiv  Detail & Related papers  (2021-09-11T05:24:40Z)
• Temporally-Coherent Surface Reconstruction via Metric-Consistent Atlases [131.50372468579067]
  We represent the reconstructed surface as an atlas, using a neural network. We empirically show that our method achieves results that exceed that state of the art in the accuracy of unsupervised correspondences and accuracy of surface reconstruction.
  arXiv  Detail & Related papers  (2021-04-14T16:21:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.