Oral-3D: Reconstructing the 3D Bone Structure of Oral Cavity from 2D
Panoramic X-ray
- URL: http://arxiv.org/abs/2003.08413v4
- Date: Sat, 9 Jan 2021 00:22:42 GMT
- Title: Oral-3D: Reconstructing the 3D Bone Structure of Oral Cavity from 2D
Panoramic X-ray
- Authors: Weinan Song, Yuan Liang, Jiawei Yang, Kun Wang, and Lei He
- Abstract summary: We propose a framework, named Oral-3D, to reconstruct the 3D oral cavity from a single PX image and prior information of the dental arch.
We show that Oral-3D can efficiently and effectively reconstruct the 3D oral structure and show critical information in clinical applications.
- Score: 17.34835093235681
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Panoramic X-ray (PX) provides a 2D picture of the patient's mouth in a
panoramic view to help dentists observe the invisible disease inside the gum.
However, it provides limited 2D information compared with cone-beam computed
tomography (CBCT), another dental imaging method that generates a 3D picture of
the oral cavity but with more radiation dose and a higher price. Consequently,
it is of great interest to reconstruct the 3D structure from a 2D X-ray image,
which can greatly explore the application of X-ray imaging in dental surgeries.
In this paper, we propose a framework, named Oral-3D, to reconstruct the 3D
oral cavity from a single PX image and prior information of the dental arch.
Specifically, we first train a generative model to learn the cross-dimension
transformation from 2D to 3D. Then we restore the shape of the oral cavity with
a deformation module with the dental arch curve, which can be obtained simply
by taking a photo of the patient's mouth. To be noted, Oral-3D can restore both
the density of bony tissues and the curved mandible surface. Experimental
results show that Oral-3D can efficiently and effectively reconstruct the 3D
oral structure and show critical information in clinical applications, e.g.,
tooth pulling and dental implants. To the best of our knowledge, we are the
first to explore this domain transformation problem between these two imaging
methods.
Related papers
- PX2Tooth: Reconstructing the 3D Point Cloud Teeth from a Single Panoramic X-ray [20.913080797758816]
We propose PX2Tooth, a novel approach to reconstruct 3D teeth using a single PX image with a two-stage framework.
First, we design the PXSegNet to segment the permanent teeth from the PX images, providing clear positional, morphological, and categorical information for each tooth.
Subsequently, we design a novel tooth generation network (TGNet) that learns to transform random point clouds into 3D teeth.
arXiv Detail & Related papers (2024-11-06T07:44:04Z) - TeethDreamer: 3D Teeth Reconstruction from Five Intra-oral Photographs [45.0864129371874]
We propose a 3D teeth reconstruction framework, named TeethDreamer, to restore the shape and position of the upper and lower teeth.
Given five intra-oral photographs, our approach first leverages a large diffusion model's prior knowledge to generate novel multi-view images.
To ensure the 3D consistency across generated views, we integrate a 3D-aware feature attention mechanism in the reverse diffusion process.
arXiv Detail & Related papers (2024-07-16T06:24:32Z) - X-Ray: A Sequential 3D Representation For Generation [54.160173837582796]
We introduce X-Ray, a novel 3D sequential representation inspired by x-ray scans.
X-Ray transforms a 3D object into a series of surface frames at different layers, making it suitable for generating 3D models from images.
arXiv Detail & Related papers (2024-04-22T16:40:11Z) - 3D Structure-guided Network for Tooth Alignment in 2D Photograph [47.51314162367702]
A 2D photograph depicting aligned teeth prior to orthodontic treatment is crucial for effective dentist-patient communication.
We propose a 3D structure-guided tooth alignment network that takes 2D photographs as input and aligns the teeth within the 2D image space.
We evaluate our network on various facial photographs, demonstrating its exceptional performance and strong applicability within the orthodontic industry.
arXiv Detail & Related papers (2023-10-17T09:44:30Z) - Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction [53.93674177236367]
Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging.
Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image.
This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses.
We introduce a novel geometry-aware encoder-decoder framework to solve this problem.
arXiv Detail & Related papers (2023-03-26T14:38:42Z) - Oral-3Dv2: 3D Oral Reconstruction from Panoramic X-Ray Imaging with
Implicit Neural Representation [3.8215162658168524]
Oral-3Dv2 is a non-adversarial-learning-based model in 3D radiology reconstruction from a single panoramic X-ray image.
Our model learns to represent the 3D oral structure in an implicit way by mapping 2D coordinates into density values of voxels in the 3D space.
To the best of our knowledge, this is the first work of a non-adversarial-learning-based model in 3D radiology reconstruction from a single panoramic X-ray image.
arXiv Detail & Related papers (2023-03-21T18:17:27Z) - ToothInpaintor: Tooth Inpainting from Partial 3D Dental Model and 2D
Panoramic Image [35.72913439096702]
In orthodontic treatment, a full tooth model consisting of both the crown and root is indispensable.
In this paper, we propose a neural network, called ToothInpaintor, that takes as input a partial 3D dental model and a 2D panoramic image.
We successfully project an input to the learned latent space via neural optimization to obtain the full tooth model conditioned on the input.
arXiv Detail & Related papers (2022-11-25T18:15:22Z) - An Implicit Parametric Morphable Dental Model [79.29420177904022]
We present the first parametric 3D morphable dental model for both teeth and gum.
It is based on a component-wise representation for each tooth and the gum, together with a learnable latent code for each of such components.
Our reconstruction quality is on par with the most advanced global implicit representations while enabling novel applications.
arXiv Detail & Related papers (2022-11-21T12:23:54Z) - XraySyn: Realistic View Synthesis From a Single Radiograph Through CT
Priors [118.27130593216096]
A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane.
To the best of our knowledge, this is the first work on radiograph view synthesis.
We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.
arXiv Detail & Related papers (2020-12-04T05:08:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.