RADIFUSION: A multi-radiomics deep learning based breast cancer risk prediction model using sequential mammographic images with image attention and bilateral asymmetry refinement

• URL: http://arxiv.org/abs/2304.00257v2
• Date: Fri, 2 Jun 2023 07:13:44 GMT
• Title: RADIFUSION: A multi-radiomics deep learning based breast cancer risk prediction model using sequential mammographic images with image attention and bilateral asymmetry refinement
• Authors: Hong Hui Yeoh, Andrea Liew, Rapha\"el Phan, Fredrik Strand, Kartini Rahmat, Tuong Linh Nguyen, John L. Hopper, Maxine Tan
• Abstract summary: Our study highlights the importance of various deep learning mechanisms, such as image attention radiomic features, gating mechanism, and bilateral asymmetry-based fine-tuning. Our findings suggest that RADIfusion can provide clinicians with a powerful tool for breast cancer risk assessment.
• Score: 0.36355629235144304
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Breast cancer is a significant public health concern and early detection is critical for triaging high risk patients. Sequential screening mammograms can provide important spatiotemporal information about changes in breast tissue over time. In this study, we propose a deep learning architecture called RADIFUSION that utilizes sequential mammograms and incorporates a linear image attention mechanism, radiomic features, a new gating mechanism to combine different mammographic views, and bilateral asymmetry-based finetuning for breast cancer risk assessment. We evaluate our model on a screening dataset called Cohort of Screen-Aged Women (CSAW) dataset. Based on results obtained on the independent testing set consisting of 1,749 women, our approach achieved superior performance compared to other state-of-the-art models with area under the receiver operating characteristic curves (AUCs) of 0.905, 0.872 and 0.866 in the three respective metrics of 1-year AUC, 2-year AUC and > 2-year AUC. Our study highlights the importance of incorporating various deep learning mechanisms, such as image attention, radiomic features, gating mechanism, and bilateral asymmetry-based fine-tuning, to improve the accuracy of breast cancer risk assessment. We also demonstrate that our model's performance was enhanced by leveraging spatiotemporal information from sequential mammograms. Our findings suggest that RADIFUSION can provide clinicians with a powerful tool for breast cancer risk assessment.

Related papers

• TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs [49.69047720285225]
  We propose a novel topological approach that explicitly extracts multi-scale topological structures to better approximate breast parenchymal structures. We empirically validate emphTopoTxR using the VICTRE phantom breast dataset. Our qualitative and quantitative analyses suggest differential topological behavior of breast tissue in treatment-na"ive imaging.
  arXiv  Detail & Related papers  (2024-11-05T19:35:10Z)
• Mammo-Clustering:A Weakly Supervised Multi-view Global-Local Context Clustering Network for Detection and Classification in Mammography [13.581151516877238]
  We propose a weakly supervised multi-view mammography early screening model for breast cancer based on context clustering. Our model shows potential in reducing the burden on doctors and increasing the feasibility of breast cancer screening for women in underdeveloped regions.
  arXiv  Detail & Related papers  (2024-09-23T10:17:13Z)
• Towards Non-invasive and Personalized Management of Breast Cancer Patients from Multiparametric MRI via A Large Mixture-of-Modality-Experts Model [19.252851972152957]
  We report a mixture-of-modality-experts model (MOME) that integrates multiparametric MRI information within a unified structure. MOME demonstrated accurate and robust identification of breast cancer. It could reduce the need for biopsies in BI-RADS 4 patients with a ratio of 7.3%, classify triple-negative breast cancer with an AUROC of 0.709, and predict pathological complete response to neoadjuvant chemotherapy with an AUROC of 0.694.
  arXiv  Detail & Related papers  (2024-08-08T05:04:13Z)
• Radiomics-guided Multimodal Self-attention Network for Predicting Pathological Complete Response in Breast MRI [3.6852491526879687]
  This study presents a model that predicts pCR in breast cancer patients using dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI) and apparent diffusion coefficient (ADC) maps. Our approach extracts features from both DCE MRI and ADC using an encoder with a self-attention mechanism, leveraging radiomics to guide feature extraction from tumor-related regions.
  arXiv  Detail & Related papers  (2024-06-05T04:49:55Z)
• Improving Breast Cancer Grade Prediction with Multiparametric MRI Created Using Optimized Synthetic Correlated Diffusion Imaging [71.91773485443125]
  Grading plays a vital role in breast cancer treatment planning. The current tumor grading method involves extracting tissue from patients, leading to stress, discomfort, and high medical costs. This paper examines using optimized CDI$s$ to improve breast cancer grade prediction.
  arXiv  Detail & Related papers  (2024-05-13T15:48:26Z)
• Longitudinal Mammogram Risk Prediction [6.28887425442237]
  We extend a state-of-the-art machine learning model to ingest an arbitrary number of longitudinal mammograms and predict future breast cancer risk. Our results show that longer histories (e.g., up to four prior annual mammograms) can significantly boost the accuracy of predicting future breast cancer risk.
  arXiv  Detail & Related papers  (2024-04-29T19:52:09Z)
• Leveraging Transformers to Improve Breast Cancer Classification and Risk Assessment with Multi-modal and Longitudinal Data [3.982926115291704]
  Multi-modal Transformer (MMT) is a neural network that utilizes mammography and ultrasound synergistically. MMT tracks temporal tissue changes by comparing current exams to prior imaging. For 5-year risk prediction, MMT attains an AUROC of 0.826, outperforming prior mammography-based risk models.
  arXiv  Detail & Related papers  (2023-11-06T16:01:42Z)
• Post-Hoc Explainability of BI-RADS Descriptors in a Multi-task Framework for Breast Cancer Detection and Segmentation [48.08423125835335]
  MT-BI-RADS is a novel explainable deep learning approach for tumor detection in Breast Ultrasound (BUS) images. It offers three levels of explanations to enable radiologists to comprehend the decision-making process in predicting tumor malignancy.
  arXiv  Detail & Related papers  (2023-08-27T22:07:42Z)
• Enhancing Clinical Support for Breast Cancer with Deep Learning Models using Synthetic Correlated Diffusion Imaging [66.63200823918429]
  We investigate enhancing clinical support for breast cancer with deep learning models. We leverage a volumetric convolutional neural network to learn deep radiomic features from a pre-treatment cohort. We find that the proposed approach can achieve better performance for both grade and post-treatment response prediction.
  arXiv  Detail & Related papers  (2022-11-10T03:02:12Z)
• High-resolution synthesis of high-density breast mammograms: Application to improved fairness in deep learning based mass detection [48.88813637974911]
  Computer-aided detection systems based on deep learning have shown good performance in breast cancer detection. High-density breasts show poorer detection performance since dense tissues can mask or even simulate masses. This study aims to improve the mass detection performance in high-density breasts using synthetic high-density full-field digital mammograms.
  arXiv  Detail & Related papers  (2022-09-20T15:57:12Z)
• Breast Cancer Induced Bone Osteolysis Prediction Using Temporal Variational Auto-Encoders [65.95959936242993]
  We develop a deep learning framework that can accurately predict and visualize the progression of osteolytic bone lesions. It will assist in planning and evaluating treatment strategies to prevent skeletal related events (SREs) in breast cancer patients.
  arXiv  Detail & Related papers  (2022-03-20T21:00:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.