CHaRNet: Conditioned Heatmap Regression for Robust Dental Landmark Localization

• URL: http://arxiv.org/abs/2501.13073v4
• Date: Thu, 30 Jan 2025 12:46:40 GMT
• Title: CHaRNet: Conditioned Heatmap Regression for Robust Dental Landmark Localization
• Abstract summary: We introduce CHaRNet, the first fully end-to-end deep learning framework for tooth landmark detection in 3D Intraoral Scans.<n>Unlike traditional two-stage that achieves teeth before detecting landmarks, CHaRNet directly operates on the input point cloud.<n>We evaluate CHaRNet using five point cloud learning algorithms on a clinical dataset of 1,214 annotated 3D models.
• Score: 1.2809296241933283
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Identifying anatomical landmarks in 3D dental models is vital for orthodontic treatment, yet manual placement is complex and time-consuming. Although some machine learning approaches have been proposed for automatic tooth landmark detection in 3D Intraoral Scans (IOS), none provide a fully end-to-end solution that bypasses teeth segmentation, limiting practical applicability. We introduce CHaRNet (Conditioned Heatmap Regression Network), the first fully end-to-end deep learning framework for tooth landmark detection in 3D IOS. Unlike traditional two-stage workflows that segment teeth before detecting landmarks, CHaRNet directly operates on the input point cloud, thus reducing complexity and computational overhead. Our method integrates four modules: (1) a point cloud encoder, (2) a point cloud decoder with a heatmap regression head, (3) a teeth presence classification head, and (4) the novel Conditioned Heatmap Regression (CHaR) module. By leveraging teeth presence classification, the CHaR module dynamically adapts to missing teeth and enhances detection accuracy in complex dental models. We evaluate CHaRNet using five point cloud learning algorithms on a clinical dataset of 1,214 annotated 3D models. Both the dataset and code will be publicly released to address the lack of open datasets in orthodontics and inspire further research. CHaRNet achieves a Mean Euclidean Distance Error (MEDE) of 0.51 mm on typical dental models and 1.28 mm across all dentition types, with corresponding Mean Success Rates (MSR) of 87.06% and 82.40%, respectively. Notably, it exhibits robust performance on irregular geometries, including models with missing teeth. This end-to-end approach streamlines orthodontic workflows, enhances 3D IOS analysis precision, and supports efficient computer-assisted treatment planning.

Related papers

• ITS3D: Inference-Time Scaling for Text-Guided 3D Diffusion Models [88.04431808574581]
  ITS3D is a framework that formulates the task as an optimization problem to identify the most effective Gaussian noise input.<n>We introduce three techniques for improved stability, efficiency, and exploration capability.<n>Experiments demonstrate that ITS3D enhances text-to-3D generation quality.
  arXiv  Detail & Related papers  (2025-11-27T13:46:16Z)
• nnLandmark: A Self-Configuring Method for 3D Medical Landmark Detection [35.41030755599218]
  This work introduces nnLandmark, a self-configuring deep learning framework for 3D medical landmark detection.<n>nnLandmark eliminates the need for manual parameter tuning, offering out-of-the-box usability.<n>It achieves state-of-the-art accuracy across two public datasets, with a radial mean error (MRE) of 1.5 mm on the Mandibular Molar Landmark (MML) dental CT dataset and 1.2 mm for anatomical fiducials on a brain MRI dataset (AFIDs)<n>nnLandmark establishes a reliable baseline for 3D landmark detection, supporting research in anatomical localization and
  arXiv  Detail & Related papers  (2025-04-09T09:53:39Z)
• Instance Segmentation and Teeth Classification in Panoramic X-rays [35.8246552579468]
  Teeth segmentation and recognition are critical in various dental applications and dental diagnosis. This article offers a pipeline of two deep learning models, U-Net and YOLOv8, which results in BB-UNet. We have improved the quality and reliability of teeth segmentation by utilising the YOLOv8 and U-Net capabilities.
  arXiv  Detail & Related papers  (2024-06-06T04:57:29Z)
• TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer [47.18526074157094]
  Optical Intraoral Scanners (IOSs) are widely used in digital dentistry to provide detailed 3D information of dental crowns and the gingiva. Previous methods are error-prone at complicated boundaries and exhibit unsatisfactory results across patients. We propose TSegFormer which captures both local and global dependencies among different teeth and the gingiva in the IOS point clouds with a multi-task 3D transformer architecture.
  arXiv  Detail & Related papers  (2023-11-22T08:45:01Z)
• An Implicit Parametric Morphable Dental Model [79.29420177904022]
  We present the first parametric 3D morphable dental model for both teeth and gum. It is based on a component-wise representation for each tooth and the gum, together with a learnable latent code for each of such components. Our reconstruction quality is on par with the most advanced global implicit representations while enabling novel applications.
  arXiv  Detail & Related papers  (2022-11-21T12:23:54Z)
• CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Clouds [55.44204039410225]
  We present a novel two-stage fully sparse convolutional 3D object detection framework, named CAGroup3D. Our proposed method first generates some high-quality 3D proposals by leveraging the class-aware local group strategy on the object surface voxels. To recover the features of missed voxels due to incorrect voxel-wise segmentation, we build a fully sparse convolutional RoI pooling module.
  arXiv  Detail & Related papers  (2022-10-09T13:38:48Z)
• Semi-supervised segmentation of tooth from 3D Scanned Dental Arches [5.985943912419412]
  Teeth segmentation is an important topic in dental restorations that is essential for crown generation, diagnosis, and treatment planning. We propose to use spectral clustering as a self-supervisory signal to joint-train neural networks for segmentation of 3D arches. Our experimental results show improvement over the fully supervised state-of-the-art MeshSegNet when using semi-supervised learning.
  arXiv  Detail & Related papers  (2022-08-10T19:56:47Z)
• SNAKE: Shape-aware Neural 3D Keypoint Field [62.91169625183118]
  Detecting 3D keypoints from point clouds is important for shape reconstruction. This work investigates the dual question: can shape reconstruction benefit 3D keypoint detection? We propose a novel unsupervised paradigm named SNAKE, which is short for shape-aware neural 3D keypoint field.
  arXiv  Detail & Related papers  (2022-06-03T17:58:43Z)
• DArch: Dental Arch Prior-assisted 3D Tooth Instance Segmentation [42.246505056039894]
  We present a dental arch prior-assisted 3D tooth segmentation method, namely DArch. Our DArch consists of two stages, including tooth centroid detection and tooth instance segmentation. Experimental results on $4,773$ dental models have shown our DArch can accurately segment each tooth of a dental model.
  arXiv  Detail & Related papers  (2022-04-25T18:30:01Z)
• S-R2F2U-Net: A single-stage model for teeth segmentation [3.42658286826597]
  Models are trained and evaluated on a benchmark dataset containing 1500 dental panoramic X-ray images. S-R2F2U-Net achieves 97.31% of accuracy and 93.26% of dice score, showing superiority over the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-04-06T17:07:09Z)
• Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scans [56.55092443401416]
  emphiMeshSegNet in the first stage of TS-MDL reached an averaged Dice similarity coefficient (DSC) at 0.953pm0.076$, significantly outperforming the original MeshSegNet. PointNet-Reg achieved a mean absolute error (MAE) of $0.623pm0.718, mm$ in distances between the prediction and ground truth for $44$ landmarks, which is superior compared with other networks for landmark detection.
  arXiv  Detail & Related papers  (2021-09-24T13:00:26Z)
• Soft Expectation and Deep Maximization for Image Feature Detection [68.8204255655161]
  We propose SEDM, an iterative semi-supervised learning process that flips the question and first looks for repeatable 3D points, then trains a detector to localize them in image space. Our results show that this new model trained using SEDM is able to better localize the underlying 3D points in a scene.
  arXiv  Detail & Related papers  (2021-04-21T00:35:32Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Inception Convolution with Efficient Dilation Search [121.41030859447487]
  Dilation convolution is a critical mutant of standard convolution neural network to control effective receptive fields and handle large scale variance of objects. We propose a new mutant of dilated convolution, namely inception (dilated) convolution where the convolutions have independent dilation among different axes, channels and layers. We explore a practical method for fitting the complex inception convolution to the data, a simple while effective dilation search algorithm(EDO) based on statistical optimization is developed.
  arXiv  Detail & Related papers  (2020-12-25T14:58:35Z)
• Pose-dependent weights and Domain Randomization for fully automatic X-ray to CT Registration [51.280096834264256]
  Fully automatic X-ray to CT registration requires an initial alignment within the capture range of existing intensity-based registrations. This work provides a novel automatic initialization, which enables end to end registration. The mean (+-standard deviation) target registration error in millimetres is 4.1 +- 4.3 for simulated X-rays with a success rate of 92% and 4.2 +- 3.9 for real X-rays with a success rate of 86.8%, where a success is defined as a translation error of less than 30mm.
  arXiv  Detail & Related papers  (2020-11-14T12:50:32Z)
• An Adaptive Enhancement Based Hybrid CNN Model for Digital Dental X-ray Positions Classification [1.0672152844970149]
  A novel solution based on adaptive histogram equalization and convolution neural network (CNN) is proposed. The accuracy and specificity of the test set exceeded 90%, and the AUC reached 0.97.
  arXiv  Detail & Related papers  (2020-05-01T13:55:44Z)
• Individual Tooth Detection and Identification from Dental Panoramic X-Ray Images via Point-wise Localization and Distance Regularization [10.877276642014515]
  The proposed network initially performs center point regression for all the anatomical teeth, which automatically identifies each tooth. Teeth boxes are individually localized using a cascaded neural network on a patch basis. The experimental results demonstrate that the proposed algorithm outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-04-12T04:14:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.