Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterparts

• URL: http://arxiv.org/abs/2303.14152v4
• Date: Mon, 1 May 2023 12:58:51 GMT
• Title: Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterparts
• Authors: Nikolas Lamb, Cameron Palmer, Benjamin Molloy, Sean Banerjee, Natasha Kholgade Banerjee
• Abstract summary: We present Fantastic Breaks, a dataset containing scanned, waterproofed, and cleaned 3D meshes for 150 broken objects. Fantastic Breaks contains class and material labels, proxy repair parts that join to broken meshes, and manually annotated fracture boundaries. We show experimental shape repair evaluation with Fantastic Breaks using multiple learning-based approaches.
• Score: 0.5572870549559665
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated shape repair approaches currently lack access to datasets that describe real-world damaged geometry. We present Fantastic Breaks (and Where to Find Them: https://terascale-all-sensing-research-studio.github.io/FantasticBreaks), a dataset containing scanned, waterproofed, and cleaned 3D meshes for 150 broken objects, paired and geometrically aligned with complete counterparts. Fantastic Breaks contains class and material labels, proxy repair parts that join to broken meshes to generate complete meshes, and manually annotated fracture boundaries. Through a detailed analysis of fracture geometry, we reveal differences between Fantastic Breaks and synthetic fracture datasets generated using geometric and physics-based methods. We show experimental shape repair evaluation with Fantastic Breaks using multiple learning-based approaches pre-trained with synthetic datasets and re-trained with subset of Fantastic Breaks.

Related papers

• Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving [46.073519734119266]
  Our dataset has unique properties that are uncommon to current benchmarks for 2D and 3D puzzle solving. The fragments and fractures are realistic, caused by a collapse of a fresco during a World War II bombing at the Pompeii archaeological park. The dataset is multi-modal providing high resolution images with characteristic pictorial elements.
  arXiv  Detail & Related papers  (2024-10-31T15:10:38Z)
• Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering [93.94371335579321]
  We propose a learning framework that trains models to predict geometry-preserving depth without requiring extra data or annotations. Comprehensive experiments underscore our framework's superior generalization capabilities. Our innovative loss functions empower the model to autonomously recover domain-specific scale-and-shift coefficients.
  arXiv  Detail & Related papers  (2023-09-18T12:36:39Z)
• Pix2Repair: Implicit Shape Restoration from Images [7.663519916453075]
  Pix2Repair takes an image of a fractured object as input and automatically generates a 3D printable restoration shape. We also introduce Fantastic Breaks Imaged, the first large-scale dataset of 11,653 real-world images of fractured objects.
  arXiv  Detail & Related papers  (2023-05-29T17:48:09Z)
• Jigsaw: Learning to Assemble Multiple Fractured Objects [30.32138466263263]
  Jigsaw is a novel framework for assembling physically broken 3D objects from multiple pieces. We show how to jointly learn segmentation and matching and seamlessly integrate feature matching and rigidity constraints. Our method also generalizes well to diverse fracture modes, objects, and unseen instances.
  arXiv  Detail & Related papers  (2023-05-29T09:33:43Z)
• DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair [0.684225774857327]
  DeepJoin is an automated approach to generate high-resolution repairs for fractured shapes using deep neural networks. We present a novel implicit shape representation for fractured shape repair that combines the occupancy function, signed distance function, and normal field.
  arXiv  Detail & Related papers  (2022-11-22T16:44:57Z)
• Breaking Bad: A Dataset for Geometric Fracture and Reassembly [47.2247928468233]
  We introduce Breaking Bad, a large-scale dataset of fractured objects. Our dataset consists of over one million fractured objects simulated from ten thousand base models.
  arXiv  Detail & Related papers  (2022-10-20T17:57:19Z)
• PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformation [59.70430570779819]
  We introduce a data-driven shape completion approach that focuses on completing geometric details of missing regions of 3D shapes. Our key insight is to copy and deform patches from the partial input to complete missing regions. We leverage repeating patterns by retrieving patches from the partial input, and learn global structural priors by using a neural network to guide the retrieval and deformation steps.
  arXiv  Detail & Related papers  (2022-07-24T18:59:09Z)
• Unsupervised Learning of 3D Object Categories from Videos in the Wild [75.09720013151247]
  We focus on learning a model from multiple views of a large collection of object instances. We propose a new neural network design, called warp-conditioned ray embedding (WCR), which significantly improves reconstruction. Our evaluation demonstrates performance improvements over several deep monocular reconstruction baselines on existing benchmarks.
  arXiv  Detail & Related papers  (2021-03-30T17:57:01Z)
• AutoSweep: Recovering 3D Editable Objectsfrom a Single Photograph [54.701098964773756]
  We aim to recover 3D objects with semantic parts and can be directly edited. Our work makes an attempt towards recovering two types of primitive-shaped objects, namely, generalized cuboids and generalized cylinders. Our algorithm can recover high quality 3D models and outperforms existing methods in both instance segmentation and 3D reconstruction.
  arXiv  Detail & Related papers  (2020-05-27T12:16:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.