Cranial Implant Prediction using Low-Resolution 3D Shape Completion and High-Resolution 2D Refinement

• URL: http://arxiv.org/abs/2009.10769v3
• Date: Sun, 27 Sep 2020 23:19:08 GMT
• Title: Cranial Implant Prediction using Low-Resolution 3D Shape Completion and High-Resolution 2D Refinement
• Authors: Amirhossein Bayat, Suprosanna Shit, Adrian Kilian, J\"urgen T. Liechtenstein, Jan S. Kirschke, Bjoern H. Menze
• Abstract summary: We propose a fully convolutional network composed of two convolutionworks. The first subnetwork is designed to complete the shape of the downsampled defective skull. The second subnetwork upsamples the reconstructed shape slice-wise. We train the 3D and 2D networks together end-to-end, with a hierarchical loss function.
• Score: 3.7939799826234375
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Designing of a cranial implant needs a 3D understanding of the complete skull shape. Thus, taking a 2D approach is sub-optimal, since a 2D model lacks a holistic 3D view of both the defective and healthy skulls. Further, loading the whole 3D skull shapes at its original image resolution is not feasible in commonly available GPUs. To mitigate these issues, we propose a fully convolutional network composed of two subnetworks. The first subnetwork is designed to complete the shape of the downsampled defective skull. The second subnetwork upsamples the reconstructed shape slice-wise. We train the 3D and 2D networks together end-to-end, with a hierarchical loss function. Our proposed solution accurately predicts a high-resolution 3D implant in the challenge test case in terms of dice-score and the Hausdorff distance.

Related papers

• High-fidelity 3D Human Digitization from Single 2K Resolution Images [16.29087820634057]
  We propose 2K2K, which constructs a large-scale 2K human dataset and infers 3D human models from 2K resolution images. We also provide 2,050 3D human models, including texture maps, 3D joints, and SMPL parameters for research purposes.
  arXiv  Detail & Related papers  (2023-03-27T11:22:54Z)
• Conjugate Product Graphs for Globally Optimal 2D-3D Shape Matching [12.740151710302397]
  We consider the problem of finding a continuous and non-rigid matching between a 2D contour and a 3D mesh. Existing solutions heavily rely on unrealistic prior assumptions to avoid degenerate solutions. We propose a novel 2D-3D shape matching formalism based on the conjugate product graph between the 2D contour and the 3D shape.
  arXiv  Detail & Related papers  (2022-11-21T15:41:28Z)
• Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape [77.95154911528365]
  3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. Previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry. This paper proposes a complete solution to capture the personalized shape so that the reconstructed shape looks identical to the corresponding person.
  arXiv  Detail & Related papers  (2022-04-09T03:46:18Z)
• Deep Hybrid Self-Prior for Full 3D Mesh Generation [57.78562932397173]
  We propose to exploit a novel hybrid 2D-3D self-prior in deep neural networks to significantly improve the geometry quality. In particular, we first generate an initial mesh using a 3D convolutional neural network with 3D self-prior, and then encode both 3D information and color information in the 2D UV atlas. Our method recovers the 3D textured mesh model of high quality from sparse input, and outperforms the state-of-the-art methods in terms of both the geometry and texture quality.
  arXiv  Detail & Related papers  (2021-08-18T07:44:21Z)
• To The Point: Correspondence-driven monocular 3D category reconstruction [39.811816510186475]
  To The Point (TTP) is a method for reconstructing 3D objects from a single image using 2D to 3D correspondences learned from weak supervision. We replace CNN-based regression of camera pose and non-rigid deformation and obtain substantially more accurate 3D reconstructions.
  arXiv  Detail & Related papers  (2021-06-10T11:21:14Z)
• FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detection [78.00922683083776]
  It is non-trivial to make a general adapted 2D detector work in this 3D task. In this technical report, we study this problem with a practice built on fully convolutional single-stage detector. Our solution achieves 1st place out of all the vision-only methods in the nuScenes 3D detection challenge of NeurIPS 2020.
  arXiv  Detail & Related papers  (2021-04-22T09:35:35Z)
• 3D-to-2D Distillation for Indoor Scene Parsing [78.36781565047656]
  We present a new approach that enables us to leverage 3D features extracted from large-scale 3D data repository to enhance 2D features extracted from RGB images. First, we distill 3D knowledge from a pretrained 3D network to supervise a 2D network to learn simulated 3D features from 2D features during the training. Second, we design a two-stage dimension normalization scheme to calibrate the 2D and 3D features for better integration. Third, we design a semantic-aware adversarial training model to extend our framework for training with unpaired 3D data.
  arXiv  Detail & Related papers  (2021-04-06T02:22:24Z)
• 3DBooSTeR: 3D Body Shape and Texture Recovery [76.91542440942189]
  3DBooSTeR is a novel method to recover a textured 3D body mesh from a partial 3D scan. The proposed approach decouples the shape and texture completion into two sequential tasks.
  arXiv  Detail & Related papers  (2020-10-23T21:07:59Z)
• ComboNet: Combined 2D & 3D Architecture for Aorta Segmentation [0.0]
  3D segmentation with deep learning if trained with full resolution is the ideal way of achieving the best accuracy. Most of the 3D segmentation applications handle sub-sampled input instead of full resolution, which comes with the cost of losing precision at the boundary. Combonet is designed in an end to end fashion with three sub-network structures.
  arXiv  Detail & Related papers  (2020-06-09T15:02:55Z)
• Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion [53.885984328273686]
  Implicit Feature Networks (IF-Nets) deliver continuous outputs, can handle multiple topologies, and complete shapes for missing or sparse input data. IF-Nets clearly outperform prior work in 3D object reconstruction in ShapeNet, and obtain significantly more accurate 3D human reconstructions.
  arXiv  Detail & Related papers  (2020-03-03T11:14:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.