A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI

• URL: http://arxiv.org/abs/2408.12606v3
• Date: Fri, 04 Apr 2025 19:14:02 GMT
• Title: A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI
• Authors: Luyang Luo, Mingxiang Wu, Mei Li, Yi Xin, Qiong Wang, Varut Vardhanabhuti, Winnie CW Chu, Zhenhui Li, Juan Zhou, Pranav Rajpurkar, Hao Chen,
• Abstract summary: We develop a large mixture-of-modality-experts model (MOME) that integrates multi-parametric MRI information within a unified structure.<n>MOME matches four senior radiologists' performance in identifying breast cancer and outperforms a junior radiologist.
• Score: 19.252851972152957
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Breast Magnetic Resonance Imaging (MRI) demonstrates the highest sensitivity for breast cancer detection among imaging modalities and is standard practice for high-risk women. Interpreting the multi-sequence MRI is time-consuming and prone to subjective variation. We develop a large mixture-of-modality-experts model (MOME) that integrates multiparametric MRI information within a unified structure, leveraging breast MRI scans from 5,205 female patients in China for model development and validation. MOME matches four senior radiologists' performance in identifying breast cancer and outperforms a junior radiologist. The model is able to reduce unnecessary biopsies in Breast Imaging-Reporting and Data System (BI-RADS) 4 patients, classify triple-negative breast cancer, and predict pathological complete response to neoadjuvant chemotherapy. MOME further supports inference with missing modalities and provides decision explanations by highlighting lesions and measuring modality contributions. To summarize, MOME exemplifies an accurate and robust multimodal model for noninvasive, personalized management of breast cancer patients via multiparametric MRI. Code is available at https://github.com/LLYXC/MOME/tree/main.

Related papers

• Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Framework [5.211860566766601]
  The paper focuses on the integration of AI within a Human-Centric workflow to enhance breast cancer diagnostics. We propose a hybrid, multi-scale and multi-view Swin Transformer-based framework (MSMV-Swin) that enhances diagnostic robustness and accuracy.
  arXiv  Detail & Related papers  (2025-03-17T15:48:56Z)
• Enhancing Trust in Clinically Significant Prostate Cancer Prediction with Multiple Magnetic Resonance Imaging Modalities [61.36288157482697]
  In the United States, prostate cancer is the second leading cause of deaths in males with a predicted 35,250 deaths in 2024. In this paper, we investigate combining multiple MRI modalities to train a deep learning model to enhance trust in the models for clinically significant prostate cancer prediction.
  arXiv  Detail & Related papers  (2024-11-07T12:48:27Z)
• Radiomics-guided Multimodal Self-attention Network for Predicting Pathological Complete Response in Breast MRI [3.6852491526879687]
  This study presents a model that predicts pCR in breast cancer patients using dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI) and apparent diffusion coefficient (ADC) maps. Our approach extracts features from both DCE MRI and ADC using an encoder with a self-attention mechanism, leveraging radiomics to guide feature extraction from tumor-related regions.
  arXiv  Detail & Related papers  (2024-06-05T04:49:55Z)
• Improving Breast Cancer Grade Prediction with Multiparametric MRI Created Using Optimized Synthetic Correlated Diffusion Imaging [71.91773485443125]
  Grading plays a vital role in breast cancer treatment planning. The current tumor grading method involves extracting tissue from patients, leading to stress, discomfort, and high medical costs. This paper examines using optimized CDI$s$ to improve breast cancer grade prediction.
  arXiv  Detail & Related papers  (2024-05-13T15:48:26Z)
• Using Multiparametric MRI with Optimized Synthetic Correlated Diffusion Imaging to Enhance Breast Cancer Pathologic Complete Response Prediction [71.91773485443125]
  Neoadjuvant chemotherapy has recently gained popularity as a promising treatment strategy for breast cancer. The current process to recommend neoadjuvant chemotherapy relies on the subjective evaluation of medical experts. This research investigates the application of optimized CDI$s$ to enhance breast cancer pathologic complete response prediction.
  arXiv  Detail & Related papers  (2024-05-13T15:40:56Z)
• Glioblastoma Tumor Segmentation using an Ensemble of Vision Transformers [0.0]
  Glioblastoma is one of the most aggressive and deadliest types of brain cancer. Brain Radiology Aided by Intelligent Neural NETworks (BRAINNET) generates robust tumor segmentation maks.
  arXiv  Detail & Related papers  (2023-11-09T18:55:27Z)
• Leveraging Transformers to Improve Breast Cancer Classification and Risk Assessment with Multi-modal and Longitudinal Data [3.982926115291704]
  Multi-modal Transformer (MMT) is a neural network that utilizes mammography and ultrasound synergistically. MMT tracks temporal tissue changes by comparing current exams to prior imaging. For 5-year risk prediction, MMT attains an AUROC of 0.826, outperforming prior mammography-based risk models.
  arXiv  Detail & Related papers  (2023-11-06T16:01:42Z)
• Cancer-Net BCa-S: Breast Cancer Grade Prediction using Volumetric Deep Radiomic Features from Synthetic Correlated Diffusion Imaging [82.74877848011798]
  The prevalence of breast cancer continues to grow, affecting about 300,000 females in the United States in 2023. The gold-standard Scarff-Bloom-Richardson (SBR) grade has been shown to consistently indicate a patient's response to chemotherapy. In this paper, we study the efficacy of deep learning for breast cancer grading based on synthetic correlated diffusion (CDI$s$) imaging.
  arXiv  Detail & Related papers  (2023-04-12T15:08:34Z)
• A Multi-Institutional Open-Source Benchmark Dataset for Breast Cancer Clinical Decision Support using Synthetic Correlated Diffusion Imaging Data [82.74877848011798]
  Cancer-Net BCa is a multi-institutional open-source benchmark dataset of volumetric CDI$s$ imaging data of breast cancer patients. Cancer-Net BCa is publicly available as a part of a global open-source initiative dedicated to accelerating advancement in machine learning to aid clinicians in the fight against cancer.
  arXiv  Detail & Related papers  (2023-04-12T05:41:44Z)
• RADIFUSION: A multi-radiomics deep learning based breast cancer risk prediction model using sequential mammographic images with image attention and bilateral asymmetry refinement [0.36355629235144304]
  Our study highlights the importance of various deep learning mechanisms, such as image attention radiomic features, gating mechanism, and bilateral asymmetry-based fine-tuning. Our findings suggest that RADIfusion can provide clinicians with a powerful tool for breast cancer risk assessment.
  arXiv  Detail & Related papers  (2023-04-01T08:18:13Z)
• Enhancing Clinical Support for Breast Cancer with Deep Learning Models using Synthetic Correlated Diffusion Imaging [66.63200823918429]
  We investigate enhancing clinical support for breast cancer with deep learning models. We leverage a volumetric convolutional neural network to learn deep radiomic features from a pre-treatment cohort. We find that the proposed approach can achieve better performance for both grade and post-treatment response prediction.
  arXiv  Detail & Related papers  (2022-11-10T03:02:12Z)
• EMT-NET: Efficient multitask network for computer-aided diagnosis of breast cancer [58.720142291102135]
  We propose an efficient and light-weighted learning architecture to classify and segment breast tumors simultaneously. We incorporate a segmentation task into a tumor classification network, which makes the backbone network learn representations focused on tumor regions. The accuracy, sensitivity, and specificity of tumor classification is 88.6%, 94.1%, and 85.3%, respectively.
  arXiv  Detail & Related papers  (2022-01-13T05:24:40Z)
• Implementation of Convolutional Neural Network Architecture on 3D Multiparametric Magnetic Resonance Imaging for Prostate Cancer Diagnosis [0.0]
  We propose a novel deep learning approach for automatic classification of prostate lesions in magnetic resonance images. Our framework achieved the classification performance with the area under a Receiver Operating Characteristic curve value of 0.87. Our proposed framework reflects the potential of assisting medical image interpretation in prostate cancer and reducing unnecessary biopsies.
  arXiv  Detail & Related papers  (2021-12-29T16:47:52Z)
• Learned super resolution ultrasound for improved breast lesion characterization [52.77024349608834]
  Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level. In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges. By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
  arXiv  Detail & Related papers  (2021-07-12T09:04:20Z)
• Deep-LIBRA: Artificial intelligence method for robust quantification of breast density with independent validation in breast cancer risk assessment [2.0369879867185143]
  Current federal legislation mandates reporting of breast density for all women undergoing breast screening. We introduce an artificial intelligence (AI) method to estimate breast percentage density (PD) from digital mammograms.
  arXiv  Detail & Related papers  (2020-11-13T15:21:17Z)
• CorrSigNet: Learning CORRelated Prostate Cancer SIGnatures from Radiology and Pathology Images for Improved Computer Aided Diagnosis [1.63324350193061]
  We propose CorrSigNet, an automated two-step model that localizes prostate cancer on MRI. First, the model learns MRI signatures of cancer that are correlated with corresponding histopathology features. Second, the model uses the learned correlated MRI features to train a Convolutional Neural Network to localize prostate cancer.
  arXiv  Detail & Related papers  (2020-07-31T23:44:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.