TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer

• URL: http://arxiv.org/abs/2311.13234v1
• Date: Wed, 22 Nov 2023 08:45:01 GMT
• Title: TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer
• Authors: Huimin Xiong, Kunle Li, Kaiyuan Tan, Yang Feng, Joey Tianyi Zhou, Jin Hao, Haochao Ying, Jian Wu, and Zuozhu Liu
• Abstract summary: Optical Intraoral Scanners (IOSs) are widely used in digital dentistry to provide detailed 3D information of dental crowns and the gingiva. Previous methods are error-prone at complicated boundaries and exhibit unsatisfactory results across patients. We propose TSegFormer which captures both local and global dependencies among different teeth and the gingiva in the IOS point clouds with a multi-task 3D transformer architecture.
• Score: 47.18526074157094
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical Intraoral Scanners (IOS) are widely used in digital dentistry to provide detailed 3D information of dental crowns and the gingiva. Accurate 3D tooth segmentation in IOSs is critical for various dental applications, while previous methods are error-prone at complicated boundaries and exhibit unsatisfactory results across patients. In this paper, we propose TSegFormer which captures both local and global dependencies among different teeth and the gingiva in the IOS point clouds with a multi-task 3D transformer architecture. Moreover, we design a geometry-guided loss based on a novel point curvature to refine boundaries in an end-to-end manner, avoiding time-consuming post-processing to reach clinically applicable segmentation. In addition, we create a dataset with 16,000 IOSs, the largest ever IOS dataset to the best of our knowledge. The experimental results demonstrate that our TSegFormer consistently surpasses existing state-of-the-art baselines. The superiority of TSegFormer is corroborated by extensive analysis, visualizations and real-world clinical applicability tests. Our code is available at https://github.com/huiminxiong/TSegFormer.

Related papers

• A Multi-Stage Framework for 3D Individual Tooth Segmentation in Dental CBCT [7.6057981800052845]
  Cone beam computed tomography (CBCT) is a common way of diagnosing dental diseases. Deep learning based methods have achieved convincing results in medical image processing. We propose a multi-stage framework for 3D tooth related generalization in dental CBCT.
  arXiv  Detail & Related papers  (2024-07-15T04:23:28Z)
• 3D Teeth Reconstruction from Panoramic Radiographs using Neural Implicit Functions [6.169259577480194]
  Occudent is a framework for 3D teeth reconstruction from panoramic radiographs using neural implicit functions. It is trained and validated with actual panoramic radiographs as input, distinct from recent works which used synthesized images.
  arXiv  Detail & Related papers  (2023-11-28T05:06:22Z)
• TFormer: 3D Tooth Segmentation in Mesh Scans with Geometry Guided Transformer [37.47317212620463]
  Optical Intra-oral Scanners (IOS) are widely used in digital dentistry, providing 3-Dimensional (3D) and high-resolution geometrical information of dental crowns and the gingiva. Previous methods are error-prone in complicated tooth-tooth or tooth-gingiva boundaries, and usually exhibit unsatisfactory results across various patients. We propose a novel method based on 3D transformer architectures that is evaluated with large-scale and high-resolution 3D IOS datasets.
  arXiv  Detail & Related papers  (2022-10-29T15:20:54Z)
• Semi-supervised segmentation of tooth from 3D Scanned Dental Arches [5.985943912419412]
  Teeth segmentation is an important topic in dental restorations that is essential for crown generation, diagnosis, and treatment planning. We propose to use spectral clustering as a self-supervisory signal to joint-train neural networks for segmentation of 3D arches. Our experimental results show improvement over the fully supervised state-of-the-art MeshSegNet when using semi-supervised learning.
  arXiv  Detail & Related papers  (2022-08-10T19:56:47Z)
• CTooth: A Fully Annotated 3D Dataset and Benchmark for Tooth Volume Segmentation on Cone Beam Computed Tomography Images [19.79983193894742]
  3D tooth segmentation is a prerequisite for computer-aided dental diagnosis and treatment. Deep learning-based segmentation methods produce convincing results, but it requires a large quantity of ground truth for training. In this paper, we establish a fully annotated cone beam computed tomography dataset CTooth with tooth gold standard.
  arXiv  Detail & Related papers  (2022-06-17T13:48:35Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scans [56.55092443401416]
  emphiMeshSegNet in the first stage of TS-MDL reached an averaged Dice similarity coefficient (DSC) at 0.953pm0.076$, significantly outperforming the original MeshSegNet. PointNet-Reg achieved a mean absolute error (MAE) of $0.623pm0.718, mm$ in distances between the prediction and ground truth for $44$ landmarks, which is superior compared with other networks for landmark detection.
  arXiv  Detail & Related papers  (2021-09-24T13:00:26Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Volumetric Medical Image Segmentation: A 3D Deep Coarse-to-fine Framework and Its Adversarial Examples [74.92488215859991]
  We propose a novel 3D-based coarse-to-fine framework to efficiently tackle these challenges. The proposed 3D-based framework outperforms their 2D counterparts by a large margin since it can leverage the rich spatial information along all three axes. We conduct experiments on three datasets, the NIH pancreas dataset, the JHMI pancreas dataset and the JHMI pathological cyst dataset.
  arXiv  Detail & Related papers  (2020-10-29T15:39:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.