Self-Supervised Learning with Masked Image Modeling for Teeth Numbering, Detection of Dental Restorations, and Instance Segmentation in Dental Panoramic Radiographs

• URL: http://arxiv.org/abs/2210.11404v1
• Date: Thu, 20 Oct 2022 16:50:07 GMT
• Title: Self-Supervised Learning with Masked Image Modeling for Teeth Numbering, Detection of Dental Restorations, and Instance Segmentation in Dental Panoramic Radiographs
• Authors: Amani Almalki and Longin Jan Latecki
• Abstract summary: This study aims to utilize recent self-supervised learning methods like SimMIM and UM-MAE to increase the model efficiency and understanding of the limited number of dental radiographs. To the best of our knowledge, this is the first study that applied self-supervised learning methods to Swin Transformer on dental panoramic radiographs.
• Score: 8.397847537464534
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The computer-assisted radiologic informative report is currently emerging in dental practice to facilitate dental care and reduce time consumption in manual panoramic radiographic interpretation. However, the amount of dental radiographs for training is very limited, particularly from the point of view of deep learning. This study aims to utilize recent self-supervised learning methods like SimMIM and UM-MAE to increase the model efficiency and understanding of the limited number of dental radiographs. We use the Swin Transformer for teeth numbering, detection of dental restorations, and instance segmentation tasks. To the best of our knowledge, this is the first study that applied self-supervised learning methods to Swin Transformer on dental panoramic radiographs. Our results show that the SimMIM method obtained the highest performance of 90.4% and 88.9% on detecting teeth and dental restorations and instance segmentation, respectively, increasing the average precision by 13.4 and 12.8 over the random initialization baseline. Moreover, we augment and correct the existing dataset of panoramic radiographs. The code and the dataset are available at https://github.com/AmaniHAlmalki/DentalMIM.

Related papers

• Detection Transformer for Teeth Detection, Segmentation, and Numbering in Oral Rare Diseases: Focus on Data Augmentation and Inpainting Techniques [0.0]
  In this work, we focused on deep learning image processing in the context of oral rare diseases. We used a dataset consisting of 156 panoramic radiographs from individuals with rare oral diseases and labeled by experts. We trained the Detection Transformer (DETR) neural network for teeth detection, segmentation, and numbering the 52 teeth classes.
  arXiv  Detail & Related papers  (2024-02-06T21:07:09Z)
• Multiclass Segmentation using Teeth Attention Modules for Dental X-ray Images [8.041659727964305]
  We propose a novel teeth segmentation model incorporating an M-Net-like structure with Swin Transformers and TAB. The proposed TAB utilizes a unique attention mechanism that focuses specifically on the complex structures of teeth. The proposed architecture effectively captures local and global contextual information, accurately defining each tooth and its surrounding structures.
  arXiv  Detail & Related papers  (2023-11-07T06:20:34Z)
• Enhanced Masked Image Modeling for Analysis of Dental Panoramic Radiographs [8.397847537464534]
  This study proposes a novel self-distillation (SD) enhanced self-supervised learning on top of the masked image modeling (SimMIM) Transformer. In addition to the prediction loss on masked patches, SD-SimMIM computes the self-distillation loss on the visible patches. We apply SD-SimMIM on dental panoramic X-rays for teeth numbering, detection of dental restorations and orthodontic appliances, and instance segmentation tasks.
  arXiv  Detail & Related papers  (2023-06-18T19:20:38Z)
• Construction of unbiased dental template and parametric dental model for precision digital dentistry [46.459289444783956]
  We develop an unbiased dental template by constructing an accurate dental atlas from CBCT images with guidance of teeth segmentation. A total of 159 CBCT images of real subjects are collected to perform the constructions.
  arXiv  Detail & Related papers  (2023-04-07T09:39:03Z)
• RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representations from X-Ray Images [49.24576562557866]
  We propose a novel method called region-guided masked image modeling (RGMIM) for learning meaningful representations from X-ray images. RGMIM significantly improved performance in small data volumes, such as 5% and 10% of the training set compared to other methods.
  arXiv  Detail & Related papers  (2022-11-01T07:41:03Z)
• CTooth+: A Large-scale Dental Cone Beam Computed Tomography Dataset and Benchmark for Tooth Volume Segmentation [21.474631912695315]
  Deep learning-based tooth segmentation methods have achieved satisfying performances but require a large quantity of tooth data with ground truth. We establish a 3D dental CBCT dataset CTooth+, with 22 fully annotated volumes and 146 unlabeled volumes. This work provides a new benchmark for the tooth volume segmentation task, and the experiment can serve as the baseline for future AI-based dental imaging research and clinical application development.
  arXiv  Detail & Related papers  (2022-08-02T09:13:23Z)
• Development of an algorithm for medical image segmentation of bone tissue in interaction with metallic implants [58.720142291102135]
  This study develops an algorithm for calculating bone growth in contact with metallic implants. Bone and implant tissue were manually segmented in the training data set. In terms of network accuracy, the model reached around 98%.
  arXiv  Detail & Related papers  (2022-04-22T08:17:20Z)
• OdontoAI: A human-in-the-loop labeled data set and an online platform to boost research on dental panoramic radiographs [53.67409169790872]
  This study addresses the construction of a public data set of dental panoramic radiographs. We benefit from the human-in-the-loop (HITL) concept to expedite the labeling procedure. Results demonstrate a 51% labeling time reduction using HITL, saving us more than 390 continuous working hours.
  arXiv  Detail & Related papers  (2022-03-29T18:57:23Z)
• Developing a Novel Approach for Periapical Dental Radiographs Segmentation [1.332560004325655]
  The proposed algorithm is made of two stages. The first stage is pre-processing. The second and main part of this algorithm calculated rotation degree and uses the integral projection method for tooth isolation. Experimental results show that this algorithm is robust and achieves high accuracy.
  arXiv  Detail & Related papers  (2021-11-13T17:25:35Z)
• Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scans [56.55092443401416]
  emphiMeshSegNet in the first stage of TS-MDL reached an averaged Dice similarity coefficient (DSC) at 0.953pm0.076$, significantly outperforming the original MeshSegNet. PointNet-Reg achieved a mean absolute error (MAE) of $0.623pm0.718, mm$ in distances between the prediction and ground truth for $44$ landmarks, which is superior compared with other networks for landmark detection.
  arXiv  Detail & Related papers  (2021-09-24T13:00:26Z)
• Y-Net for Chest X-Ray Preprocessing: Simultaneous Classification of Geometry and Segmentation of Annotations [70.0118756144807]
  This work introduces a general pre-processing step for chest x-ray input into machine learning algorithms. A modified Y-Net architecture based on the VGG11 encoder is used to simultaneously learn geometric orientation and segmentation of radiographs. Results were evaluated by expert clinicians, with acceptable geometry in 95.8% and annotation mask in 96.2%, compared to 27.0% and 34.9% respectively in control images.
  arXiv  Detail & Related papers  (2020-05-08T02:16:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.