Statistical validation of a deep learning algorithm for dental anomaly detection in intraoral radiographs using paired data

• URL: http://arxiv.org/abs/2402.14022v1
• Date: Thu, 1 Feb 2024 13:46:36 GMT
• Title: Statistical validation of a deep learning algorithm for dental anomaly detection in intraoral radiographs using paired data
• Authors: Pieter Van Leemput, Johannes Keustermans, Wouter Mollemans
• Abstract summary: The study compares the detection performance of dentists using the deep learning algorithm to the prior performance of these dentists evaluating the images. The statistical significance of these results is extensively proven using both McNemar's test and the binomial hypothesis test.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This article describes the clinical validation study setup, statistical analysis and results for a deep learning algorithm which detects dental anomalies in intraoral radiographic images, more specifically caries, apical lesions, root canal treatment defects, marginal defects at crown restorations, periodontal bone loss and calculus. The study compares the detection performance of dentists using the deep learning algorithm to the prior performance of these dentists evaluating the images without algorithmic assistance. Calculating the marginal profit and loss of performance from the annotated paired image data allows for a quantification of the hypothesized change in sensitivity and specificity. The statistical significance of these results is extensively proven using both McNemar's test and the binomial hypothesis test. The average sensitivity increases from $60.7\%$ to $85.9\%$, while the average specificity slightly decreases from $94.5\%$ to $92.7\%$. We prove that the increase of the area under the localization ROC curve (AUC) is significant (from $0.60$ to $0.86$ on average), while the average AUC is bounded by the $95\%$ confidence intervals ${[}0.54, 0.65{]}$ and ${[}0.82, 0.90{]}$. When using the deep learning algorithm for diagnostic guidance, the dentist can be $95\%$ confident that the average true population sensitivity is bounded by the range $79.6\%$ to $91.9\%$. The proposed paired data setup and statistical analysis can be used as a blueprint to thoroughly test the effect of a modality change, like a deep learning based detection and/or segmentation, on radiographic images.

Related papers

• Efficient Data-Sketches and Fine-Tuning for Early Detection of Distributional Drift in Medical Imaging [5.1358645354733765]
  This paper presents an accurate and sensitive approach to detect distributional drift in CT-scan medical images. We developed a robust library model for real-time anomaly detection, allowing for efficient comparison of incoming images. We fine-tuned a vision transformer pre-trained model to extract relevant features using breast cancer images.
  arXiv  Detail & Related papers  (2024-08-15T23:46:37Z)
• Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classification [52.77024349608834]
  To investigate chest radiograph (CXR) classification performance of vision transformers (ViT) and interpretability of attention-based saliency. ViTs were fine-tuned for lung disease classification using four public data sets: CheXpert, Chest X-Ray 14, MIMIC CXR, and VinBigData. ViTs had comparable CXR classification AUCs compared with state-of-the-art CNNs.
  arXiv  Detail & Related papers  (2023-03-03T12:05:41Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)
• A Deep Learning Based Workflow for Detection of Lung Nodules With Chest Radiograph [0.0]
  We built a segmentation model to identify lung areas from CXRs, and sliced them into 16 patches. These labeled patches were then used to train finetune a deep neural network(DNN) model, classifying the patches as positive or negative.
  arXiv  Detail & Related papers  (2021-12-19T16:19:46Z)
• CNN Filter Learning from Drawn Markers for the Detection of Suggestive Signs of COVID-19 in CT Images [58.720142291102135]
  We propose a method that does not require either large annotated datasets or backpropagation to estimate the filters of a convolutional neural network (CNN) For a few CT images, the user draws markers at representative normal and abnormal regions. The method generates a feature extractor composed of a sequence of convolutional layers, whose kernels are specialized in enhancing regions similar to the marked ones.
  arXiv  Detail & Related papers  (2021-11-16T15:03:42Z)
• Controlling False Positive/Negative Rates for Deep-Learning-Based Prostate Cancer Detection on Multiparametric MR images [58.85481248101611]
  We propose a novel PCa detection network that incorporates a lesion-level cost-sensitive loss and an additional slice-level loss based on a lesion-to-slice mapping function. Our experiments based on 290 clinical patients concludes that 1) The lesion-level FNR was effectively reduced from 0.19 to 0.10 and the lesion-level FPR was reduced from 1.03 to 0.66 by changing the lesion-level cost.
  arXiv  Detail & Related papers  (2021-06-04T09:51:27Z)
• High-Resolution Segmentation of Tooth Root Fuzzy Edge Based on Polynomial Curve Fitting with Landmark Detection [14.733417048938518]
  We propose a model for high-resolution segmentation based on curve fitting with landmark detection (HS-PCL) It is based on detecting multiple landmarks evenly distributed on the edge of the tooth root to fit a smooth curve as the segmentation of the tooth root. In our model, a maximum number of the shortest algorithm (MNSDA) is proposed to automatically reduce the negative influence of the wrong landmarks.
  arXiv  Detail & Related papers  (2021-03-07T04:28:09Z)
• Chest x-ray automated triage: a semiologic approach designed for clinical implementation, exploiting different types of labels through a combination of four Deep Learning architectures [83.48996461770017]
  This work presents a Deep Learning method based on the late fusion of different convolutional architectures. We built four training datasets combining images from public chest x-ray datasets and our institutional archive. We trained four different Deep Learning architectures and combined their outputs with a late fusion strategy, obtaining a unified tool.
  arXiv  Detail & Related papers  (2020-12-23T14:38:35Z)
• Y-Net for Chest X-Ray Preprocessing: Simultaneous Classification of Geometry and Segmentation of Annotations [70.0118756144807]
  This work introduces a general pre-processing step for chest x-ray input into machine learning algorithms. A modified Y-Net architecture based on the VGG11 encoder is used to simultaneously learn geometric orientation and segmentation of radiographs. Results were evaluated by expert clinicians, with acceptable geometry in 95.8% and annotation mask in 96.2%, compared to 27.0% and 34.9% respectively in control images.
  arXiv  Detail & Related papers  (2020-05-08T02:16:17Z)
• An Adaptive Enhancement Based Hybrid CNN Model for Digital Dental X-ray Positions Classification [1.0672152844970149]
  A novel solution based on adaptive histogram equalization and convolution neural network (CNN) is proposed. The accuracy and specificity of the test set exceeded 90%, and the AUC reached 0.97.
  arXiv  Detail & Related papers  (2020-05-01T13:55:44Z)
• Individual Tooth Detection and Identification from Dental Panoramic X-Ray Images via Point-wise Localization and Distance Regularization [10.877276642014515]
  The proposed network initially performs center point regression for all the anatomical teeth, which automatically identifies each tooth. Teeth boxes are individually localized using a cascaded neural network on a patch basis. The experimental results demonstrate that the proposed algorithm outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-04-12T04:14:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.