Multimodal MRI-Ultrasound AI for Prostate Cancer Detection Outperforms Radiologist MRI Interpretation: A Multi-Center Study

• URL: http://arxiv.org/abs/2502.00146v1
• Date: Fri, 31 Jan 2025 20:04:20 GMT
• Title: Multimodal MRI-Ultrasound AI for Prostate Cancer Detection Outperforms Radiologist MRI Interpretation: A Multi-Center Study
• Authors: Hassan Jahanandish, Shengtian Sang, Cynthia Xinran Li, Sulaiman Vesal, Indrani Bhattacharya, Jeong Hoon Lee, Richard Fan, Geoffrey A. Sonna, Mirabela Rusu,
• Abstract summary: Pre-biopsy magnetic resonance imaging (MRI) is increasingly used to target suspicious prostate lesions. MRI-detected lesions must still be mapped to transrectal ultrasound (TRUS) images during biopsy, which results in missing clinically significant prostate cancer (CsPCa) This study systematically evaluates a multimodal AI framework integrating MRI and TRUS image sequences to enhance CsPCa identification.
• Score: 2.493694664727448
• License:
• Abstract: Pre-biopsy magnetic resonance imaging (MRI) is increasingly used to target suspicious prostate lesions. This has led to artificial intelligence (AI) applications improving MRI-based detection of clinically significant prostate cancer (CsPCa). However, MRI-detected lesions must still be mapped to transrectal ultrasound (TRUS) images during biopsy, which results in missing CsPCa. This study systematically evaluates a multimodal AI framework integrating MRI and TRUS image sequences to enhance CsPCa identification. The study included 3110 patients from three cohorts across two institutions who underwent prostate biopsy. The proposed framework, based on the 3D UNet architecture, was evaluated on 1700 test cases, comparing performance to unimodal AI models that use either MRI or TRUS alone. Additionally, the proposed model was compared to radiologists in a cohort of 110 patients. The multimodal AI approach achieved superior sensitivity (80%) and Lesion Dice (42%) compared to unimodal MRI (73%, 30%) and TRUS models (49%, 27%). Compared to radiologists, the multimodal model showed higher specificity (88% vs. 78%) and Lesion Dice (38% vs. 33%), with equivalent sensitivity (79%). Our findings demonstrate the potential of multimodal AI to improve CsPCa lesion targeting during biopsy and treatment planning, surpassing current unimodal models and radiologists; ultimately improving outcomes for prostate cancer patients.

Related papers

• Cancer-Net PCa-Seg: Benchmarking Deep Learning Models for Prostate Cancer Segmentation Using Synthetic Correlated Diffusion Imaging [65.83291923029985]
  Prostate cancer (PCa) is the most prevalent cancer among men in the United States, accounting for nearly 300,000 cases, 29% of all diagnoses and 35,000 total deaths in 2024. Traditional screening methods such as prostate-specific antigen (PSA) testing and magnetic resonance imaging (MRI) have been pivotal in diagnosis, but have faced limitations in specificity and generalizability. We employ several state-of-the-art deep learning models, including U-Net, SegResNet, Swin UNETR, Attention U-Net, and LightM-UNet, to segment PCa lesions from a 200 CDI$
  arXiv  Detail & Related papers  (2025-01-15T22:23:41Z)
• Toward Non-Invasive Diagnosis of Bankart Lesions with Deep Learning [0.0]
  Bankart lesions, or anterior-inferior glenoid labral tears, are diagnostically challenging on standard MRIs. This study develops deep learning (DL) models to detect Bankart lesions on both standard MRIs and MRAs.
  arXiv  Detail & Related papers  (2024-12-09T18:04:27Z)
• Enhancing Trust in Clinically Significant Prostate Cancer Prediction with Multiple Magnetic Resonance Imaging Modalities [61.36288157482697]
  In the United States, prostate cancer is the second leading cause of deaths in males with a predicted 35,250 deaths in 2024. In this paper, we investigate combining multiple MRI modalities to train a deep learning model to enhance trust in the models for clinically significant prostate cancer prediction.
  arXiv  Detail & Related papers  (2024-11-07T12:48:27Z)
• Towards Non-invasive and Personalized Management of Breast Cancer Patients from Multiparametric MRI via A Large Mixture-of-Modality-Experts Model [19.252851972152957]
  We report a mixture-of-modality-experts model (MOME) that integrates multiparametric MRI information within a unified structure. MOME demonstrated accurate and robust identification of breast cancer. It could reduce the need for biopsies in BI-RADS 4 patients with a ratio of 7.3%, classify triple-negative breast cancer with an AUROC of 0.709, and predict pathological complete response to neoadjuvant chemotherapy with an AUROC of 0.694.
  arXiv  Detail & Related papers  (2024-08-08T05:04:13Z)
• Analysis of the BraTS 2023 Intracranial Meningioma Segmentation Challenge [44.586530244472655]
  We describe the design and results from the BraTS 2023 Intracranial Meningioma Challenge. The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas. The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor.
  arXiv  Detail & Related papers  (2024-05-16T03:23:57Z)
• Using Multiparametric MRI with Optimized Synthetic Correlated Diffusion Imaging to Enhance Breast Cancer Pathologic Complete Response Prediction [71.91773485443125]
  Neoadjuvant chemotherapy has recently gained popularity as a promising treatment strategy for breast cancer. The current process to recommend neoadjuvant chemotherapy relies on the subjective evaluation of medical experts. This research investigates the application of optimized CDI$s$ to enhance breast cancer pathologic complete response prediction.
  arXiv  Detail & Related papers  (2024-05-13T15:40:56Z)
• Classification of Radiologically Isolated Syndrome and Clinically Isolated Syndrome with Machine-Learning Techniques [0.0]
  The unanticipated detection by magnetic resonance imaging (MRI) in the brain of asymptomatic subjects of white matter lesions suggestive of multiple sclerosis (MS) has been named radiologically isolated syndrome (RIS) Our objective was to use machine-learning classification methods to identify morphometric measures that help to discriminate patients with RIS from those with CIS.
  arXiv  Detail & Related papers  (2024-01-24T08:49:50Z)
• Diagnosing Bipolar Disorder from 3-D Structural Magnetic Resonance Images Using a Hybrid GAN-CNN Method [0.0]
  This study proposes a hybrid GAN-CNN model to diagnose Bipolar Disorder (BD) from 3-D structural MRI Images (sMRI) Based on the results, this study obtains an accuracy rate of 75.8%, a sensitivity of 60.3%, and a specificity of 82.5%, which are 3-5% higher than prior work.
  arXiv  Detail & Related papers  (2023-10-11T10:17:41Z)
• EMT-NET: Efficient multitask network for computer-aided diagnosis of breast cancer [58.720142291102135]
  We propose an efficient and light-weighted learning architecture to classify and segment breast tumors simultaneously. We incorporate a segmentation task into a tumor classification network, which makes the backbone network learn representations focused on tumor regions. The accuracy, sensitivity, and specificity of tumor classification is 88.6%, 94.1%, and 85.3%, respectively.
  arXiv  Detail & Related papers  (2022-01-13T05:24:40Z)
• Feature Fusion of Raman Chemical Imaging and Digital Histopathology using Machine Learning for Prostate Cancer Detection [0.0]
  This study uses multimodal images formed from stained Digital Histopathology (DP) and unstained Raman Chemical Imaging (RCI) The hypothesis tested was whether multimodal image models can outperform single modality baseline models in terms of diagnostic accuracy.
  arXiv  Detail & Related papers  (2021-01-18T22:11:42Z)
• Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on 2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
  The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing. The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
  arXiv  Detail & Related papers  (2020-05-27T20:44:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.