Reconsidering evaluation practices in modular systems: On the propagation of errors in MRI prostate cancer detection

• URL: http://arxiv.org/abs/2309.08381v1
• Date: Fri, 15 Sep 2023 13:15:09 GMT
• Title: Reconsidering evaluation practices in modular systems: On the propagation of errors in MRI prostate cancer detection
• Authors: Erlend Sortland Rolfsnes, Philip Thangngat, Trygve Eftest{\o}l, Tobias Nordstr\"om, Fredrik J\"aderling, Martin Eklund, Alvaro Fernandez-Quilez
• Abstract summary: Artificial intelligence (AI) systems can support radiological assessment by segmenting and classifying lesions in clinically significant (csPCa) and non-clinically significant (ncsPCa) Our results depict the relevance of a holistic evaluation, accounting for all the sub-modules involved in the system.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Magnetic resonance imaging has evolved as a key component for prostate cancer (PCa) detection, substantially increasing the radiologist workload. Artificial intelligence (AI) systems can support radiological assessment by segmenting and classifying lesions in clinically significant (csPCa) and non-clinically significant (ncsPCa). Commonly, AI systems for PCa detection involve an automatic prostate segmentation followed by the lesion detection using the extracted prostate. However, evaluation reports are typically presented in terms of detection under the assumption of the availability of a highly accurate segmentation and an idealistic scenario, omitting the propagation of errors between modules. For that purpose, we evaluate the effect of two different segmentation networks (s1 and s2) with heterogeneous performances in the detection stage and compare it with an idealistic setting (s1:89.90+-2.23 vs 88.97+-3.06 ncsPCa, P<.001, 89.30+-4.07 and 88.12+-2.71 csPCa, P<.001). Our results depict the relevance of a holistic evaluation, accounting for all the sub-modules involved in the system.

Related papers

• Cancer-Net PCa-Seg: Benchmarking Deep Learning Models for Prostate Cancer Segmentation Using Synthetic Correlated Diffusion Imaging [65.83291923029985]
  Prostate cancer (PCa) is the most prevalent cancer among men in the United States, accounting for nearly 300,000 cases, 29% of all diagnoses and 35,000 total deaths in 2024. Traditional screening methods such as prostate-specific antigen (PSA) testing and magnetic resonance imaging (MRI) have been pivotal in diagnosis, but have faced limitations in specificity and generalizability. We employ several state-of-the-art deep learning models, including U-Net, SegResNet, Swin UNETR, Attention U-Net, and LightM-UNet, to segment PCa lesions from a 200 CDI$
  arXiv  Detail & Related papers  (2025-01-15T22:23:41Z)
• Mixed Supervision of Histopathology Improves Prostate Cancer Classification from MRI [0.9395521049323435]
  Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care. We present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population.
  arXiv  Detail & Related papers  (2022-12-13T02:34:57Z)
• ProstAttention-Net: A deep attention model for prostate cancer segmentation by aggressiveness in MRI scans [4.964026843682986]
  We propose a novel end-to-end multi-class network that jointly segments the prostate gland and cancer lesions with Gleason score (GS) group grading. Our model achieves 69.0% $pm$14.5% sensitivity at 2.9 false positive per patient on the whole prostate and 70.8% $pm$14.4% sensitivity at 1.5 false positive when considering the peripheral zone (PZ) only.
  arXiv  Detail & Related papers  (2022-11-23T16:21:21Z)
• Reducing a complex two-sided smartwatch examination for Parkinson's Disease to an efficient one-sided examination preserving machine learning accuracy [63.20765930558542]
  We have recorded participants performing technology-based assessments in a prospective study to research Parkinson's Disease (PD) This study provided the largest PD sample size of two-hand synchronous smartwatch measurements.
  arXiv  Detail & Related papers  (2022-05-11T09:12:59Z)
• Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment [50.89811515036067]
  Gastric endoscopic screening is an effective way to decide appropriate gastric cancer (GC) treatment at an early stage, reducing GC-associated mortality rate. We propose a practical AI system that enables five subclassifications of GC pathology, which can be directly matched to general GC treatment guidance.
  arXiv  Detail & Related papers  (2022-02-17T08:33:52Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based Sparse PCA Network [93.22587316229954]
  We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E) We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
  arXiv  Detail & Related papers  (2021-10-27T19:28:36Z)
• Anatomical and Diagnostic Bayesian Segmentation in Prostate MRI $-$Should Different Clinical Objectives Mandate Different Loss Functions? [0.3149883354098941]
  Probable voxel-level classification of anatomy and malignancy in prostate MRI requires different loss functions for optimal performance. We investigate distribution, region and boundary-based loss functions for both tasks across 200 patient exams from the publicly-available ProstateX dataset.
  arXiv  Detail & Related papers  (2021-10-25T12:44:52Z)
• A clinical validation of VinDr-CXR, an AI system for detecting abnormal chest radiographs [0.0]
  We demonstrate a mechanism for validating an AI-based system for detecting abnormalities on X-ray scans. The system achieves an F1 score - the harmonic average of the recall and the precision - of 0.653 CI 0.635, 0.671) for detecting any abnormalities on chest X-rays.
  arXiv  Detail & Related papers  (2021-04-06T02:53:35Z)
• End-to-end Prostate Cancer Detection in bpMRI via 3D CNNs: Effect of Attention Mechanisms, Clinical Priori and Decoupled False Positive Reduction [0.0]
  We present a novel 3D computer-aided detection and diagnosis (CAD) model for automated localization of clinically significant prostate cancer (csa) in bi-parametric MR imaging (bpMRI) Deep attention mechanisms drive its detection network, targeting multi-resolution, salient structures and highly discriminative feature dimensions. CNN-based models can be trained to detect biopsy-confirmed malignancies in an independent cohort.
  arXiv  Detail & Related papers  (2021-01-08T22:59:30Z)
• Hemogram Data as a Tool for Decision-making in COVID-19 Management: Applications to Resource Scarcity Scenarios [62.997667081978825]
  COVID-19 pandemics has challenged emergency response systems worldwide, with widespread reports of essential services breakdown and collapse of health care structure. This work describes a machine learning model derived from hemogram exam data performed in symptomatic patients. Proposed models can predict COVID-19 qRT-PCR results in symptomatic individuals with high accuracy, sensitivity and specificity.
  arXiv  Detail & Related papers  (2020-05-10T01:45:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.