Automatic Cranial Defect Reconstruction with Self-Supervised Deep Deformable Masked Autoencoders

• URL: http://arxiv.org/abs/2404.13106v2
• Date: Mon, 3 Jun 2024 10:44:26 GMT
• Title: Automatic Cranial Defect Reconstruction with Self-Supervised Deep Deformable Masked Autoencoders
• Authors: Marek Wodzinski, Daria Hemmerling, Mateusz Daniol,
• Abstract summary: Thousands of people suffer from cranial injuries every year. They require personalized implants that need to be designed and manufactured before the reconstruction surgery. The problem can be formulated as volumetric shape completion and solved by deep neural networks dedicated to supervised image segmentation. In our work, we propose an alternative and simple approach to use a self-supervised masked autoencoder to solve the problem.
• Score: 0.12301374769426145
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Thousands of people suffer from cranial injuries every year. They require personalized implants that need to be designed and manufactured before the reconstruction surgery. The manual design is expensive and time-consuming leading to searching for algorithms whose goal is to automatize the process. The problem can be formulated as volumetric shape completion and solved by deep neural networks dedicated to supervised image segmentation. However, such an approach requires annotating the ground-truth defects which is costly and time-consuming. Usually, the process is replaced with synthetic defect generation. However, even the synthetic ground-truth generation is time-consuming and limits the data heterogeneity, thus the deep models' generalizability. In our work, we propose an alternative and simple approach to use a self-supervised masked autoencoder to solve the problem. This approach by design increases the heterogeneity of the training set and can be seen as a form of data augmentation. We compare the proposed method with several state-of-the-art deep neural networks and show both the quantitative and qualitative improvement on the SkullBreak and SkullFix datasets. The proposed method can be used to efficiently reconstruct the cranial defects in real time.

Related papers

• TSynD: Targeted Synthetic Data Generation for Enhanced Medical Image Classification [0.011037620731410175]
  This work aims to guide the generative model to synthesize data with high uncertainty. We alter the feature space of the autoencoder through an optimization process. We improve the robustness against test time data augmentations and adversarial attacks on several classifications tasks.
  arXiv  Detail & Related papers  (2024-06-25T11:38:46Z)
• Improving Deep Learning-based Automatic Cranial Defect Reconstruction by Heavy Data Augmentation: From Image Registration to Latent Diffusion Models [0.2911706166691895]
  The work is a considerable contribution to the field of artificial intelligence in the automatic modeling of personalized cranial implants. We show that the use of heavy data augmentation significantly increases both the quantitative and qualitative outcomes. We also show that the synthetically augmented network successfully reconstructs real clinical defects.
  arXiv  Detail & Related papers  (2024-06-10T15:34:23Z)
• Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy [55.2480439325792]
  We introduce deep unrolled self-supervised learning, which alleviates the need for such data by training a sequence-specific, model-based autoencoder. Our proposed method exceeds the performance of its supervised counterparts.
  arXiv  Detail & Related papers  (2024-03-25T17:40:32Z)
• Deep Generative Networks for Heterogeneous Augmentation of Cranial Defects [0.15720523553334917]
  We show that it is possible to generate dozens of thousands of defective skulls with compatible defects. The generated skulls may improve the automatic design of personalized cranial implants for real medical cases.
  arXiv  Detail & Related papers  (2023-08-09T11:29:16Z)
• High-Resolution Cranial Defect Reconstruction by Iterative, Low-Resolution, Point Cloud Completion Transformers [0.11260580067718602]
  The problem of the automatic cranial defect reconstruction can be formulated as the shape completion task. We propose an iterative, transformer-based method to reconstruct the cranial defect at any resolution.
  arXiv  Detail & Related papers  (2023-08-07T10:39:23Z)
• An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design [55.62660894625669]
  Lithography modeling is a crucial problem in chip design to ensure a chip design mask is manufacturable. Recent developments in machine learning have provided alternative solutions in replacing the time-consuming lithography simulations with deep neural networks. We propose a litho-aware data augmentation framework to resolve the dilemma of limited data and improve the machine learning model performance.
  arXiv  Detail & Related papers  (2022-10-27T20:53:39Z)
• Deep Learning-based Framework for Automatic Cranial Defect Reconstruction and Implant Modeling [0.2020478014317493]
  The goal of this work is to propose a robust, fast, and fully automatic method for personalized cranial defect reconstruction and implant modeling. We propose a two-step deep learning-based method using a modified U-Net architecture to perform the defect reconstruction. We then propose a dedicated iterative procedure to improve the implant geometry, followed by automatic generation of models ready for 3-D printing.
  arXiv  Detail & Related papers  (2022-04-13T11:33:26Z)
• Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative Replay [67.50637511633212]
  A lifelong learning agent is able to continually learn from potentially infinite streams of pattern sensory data. One major historic difficulty in building agents that adapt is that neural systems struggle to retain previously-acquired knowledge when learning from new samples. This problem is known as catastrophic forgetting (interference) and remains an unsolved problem in the domain of machine learning to this day.
  arXiv  Detail & Related papers  (2021-12-09T07:11:14Z)
• Deep Metric Learning with Locality Sensitive Angular Loss for Self-Correcting Source Separation of Neural Spiking Signals [77.34726150561087]
  We propose a methodology based on deep metric learning to address the need for automated post-hoc cleaning and robust separation filters. We validate this method with an artificially corrupted label set based on source-separated high-density surface electromyography recordings. This approach enables a neural network to learn to accurately decode neurophysiological time series using any imperfect method of labelling the signal.
  arXiv  Detail & Related papers  (2021-10-13T21:51:56Z)
• Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis [69.09526348527203]
  Deep generative models have led to highly realistic media, known as deepfakes, that are commonly indistinguishable from real to human eyes. We propose a novel fake detection that is designed to re-synthesize testing images and extract visual cues for detection. We demonstrate the improved effectiveness, cross-GAN generalization, and robustness against perturbations of our approach in a variety of detection scenarios.
  arXiv  Detail & Related papers  (2021-05-29T21:22:24Z)
• Anytime Sampling for Autoregressive Models via Ordered Autoencoding [88.01906682843618]
  Autoregressive models are widely used for tasks such as image and audio generation. The sampling process of these models does not allow interruptions and cannot adapt to real-time computational resources. We propose a new family of autoregressive models that enables anytime sampling.
  arXiv  Detail & Related papers  (2021-02-23T05:13:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.