Predicting Neoadjuvant Chemotherapy Response in Triple-Negative Breast Cancer Using Pre-Treatment Histopathologic Images

• URL: http://arxiv.org/abs/2505.14730v2
• Date: Sat, 26 Jul 2025 02:07:24 GMT
• Title: Predicting Neoadjuvant Chemotherapy Response in Triple-Negative Breast Cancer Using Pre-Treatment Histopathologic Images
• Abstract summary: Triple-negative breast cancer (TNBC) remains a major clinical challenge due to its aggressive behavior and lack of targeted therapies.<n>We present an attention-based multiple instance learning framework designed to predict pathologic complete response (pCR) directly from pre-treatment hematoxylin and eosin (H&E)-stained biopsy slides.
• Score: 2.23127246021293
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Triple-negative breast cancer (TNBC) remains a major clinical challenge due to its aggressive behavior and lack of targeted therapies. Accurate early prediction of response to neoadjuvant chemotherapy (NACT) is essential for guiding personalized treatment strategies and improving patient outcomes. In this study, we present an attention-based multiple instance learning (MIL) framework designed to predict pathologic complete response (pCR) directly from pre-treatment hematoxylin and eosin (H&E)-stained biopsy slides. The model was trained on a retrospective in-house cohort of 174 TNBC patients and externally validated on an independent cohort (n = 30). It achieved a mean area under the curve (AUC) of 0.85 during five-fold cross-validation and 0.78 on external testing, demonstrating robust predictive performance and generalizability. To enhance model interpretability, attention maps were spatially co-registered with multiplex immuno-histochemistry (mIHC) data stained for PD-L1, CD8+ T cells, and CD163+ macrophages. The attention regions exhibited moderate spatial overlap with immune-enriched areas, with mean Intersection over Union (IoU) scores of 0.47 for PD-L1, 0.45 for CD8+ T cells, and 0.46 for CD163+ macrophages. The presence of these biomarkers in high-attention regions supports their biological relevance to NACT response in TNBC. This not only improves model interpretability but may also inform future efforts to identify clinically actionable histological biomarkers directly from H&E-stained biopsy slides, further supporting the utility of this approach for accurate NACT response prediction and advancing precision oncology in TNBC.

Related papers

• Data-Efficient Multimodal Alignment for Histopathology-based Molecular Prediction [3.229566379058554]
  We show that training a lightweight alignment module atop frozen histopathology and RNA-Seq foundation models enables open-vocabulary molecular prompting.<n>We achieve a 25-fold improvement in retrieval over baseline methods.<n>We validate clinical utility on the POSEIDON clinical trial.
  arXiv  Detail & Related papers  (2026-06-29T08:24:53Z)
• Cross-Attention Multimodal Learning for Predicting Response to Neoadjuvant Imatinib in Gastrointestinal Stromal Tumors: A Multicenter Retrospective Study [0.17595857197891288]
  Response to neoadjuvant imatinib in gastrointestinal stromal tumors (GISTs) is highly variable and cannot be reliably predicted.<n>This study developed and evaluated an explainable multimodal learning framework integrating computed tomography (CT) imaging and clinical variables.
  arXiv  Detail & Related papers  (2026-06-24T08:53:18Z)
• A Pathology Foundation Model for Gastric Cancer with Real-World Validation [47.19073124722865]
  We present GRACE, a Gastric-specific foundation model for Real-world Assessment and Clinical dEcision support.<n> GRACE was developed from multicenter gastric pathology datasets totaling 48,364 primarily HE-stained whole-slide images from 37,493 patients.<n>When calibrated to maintain non-inferior performance to senior pathologists, the AI-assisted workflow could triage 60.7% of atrophy and 82.7% of intestinal metaplasia cases.
  arXiv  Detail & Related papers  (2026-06-03T12:18:06Z)
• A Breast Vision Pathology Foundation Model for Real-world Clinical Utility [65.57568187389113]
  We present bfBRAVE, a breast-adaptive pathology foundation model developed and evaluated using a total resource of 101,638 breast wholeslide images.<n>BRAVE supported practical roles in the clinical workflow, including safe exclusion of low-risk cases from routine AI-assisted second-review rescue of initially missed positives and prioritization of cases for further assessment.
  arXiv  Detail & Related papers  (2026-05-06T07:44:39Z)
• Linking spatial biology and clinical histology via Haiku [35.723756132708026]
  We present Haiku, a tri-modal contrastive learning model trained on multiplexed immunofluorescence (mIF)<n>It comprises 26.7 million spatial patches from 3,218 tissue sections across 1,606 patients spanning 11 organ types.
  arXiv  Detail & Related papers  (2026-04-30T18:53:32Z)
• Cerebra: A Multidisciplinary AI Board for Multimodal Dementia Characterization and Risk Assessment [56.62016795093786]
  Cerebra is an interactive multi-agent AI team that coordinates specialized agents for EHR, clinical notes, and medical imaging analysis.<n>It supports privacy-preserving deployment by operating on structured representations and remains robust when modalities are incomplete.<n>Cerebra significantly improved expert performance, increasing accuracy by 17.5 percentage points in prospective dementia risk estimation.
  arXiv  Detail & Related papers  (2026-03-23T05:46:45Z)
• Investigating the Impact of Histopathological Foundation Models on Regressive Prediction of Homologous Recombination Deficiency [52.50039435394964]
  We systematically evaluate foundation models for regression-based tasks.<n>We extract patch-level features from whole slide images (WSI) using five state-of-the-art foundation models.<n>Models are trained to predict continuous HRD scores based on these extracted features across breast, endometrial, and lung cancer cohorts.
  arXiv  Detail & Related papers  (2026-01-29T14:06:50Z)
• Breast Cancer Recurrence Risk Prediction Based on Multiple Instance Learning [0.0]
  This study investigates the potential of computational pathology to stratify patients using deep learning on routine Hematoxylin and Eosin stained whole-slide images (WSIs)<n>We developed and compared three Multiple Instance Learning frameworks -- CLAM-SB, ABMIL, and ConvNeXt-MIL-XGBoost -- on an in-house dataset of 210 patient cases.<n>In a 5-fold cross-validation, the modified CLAM-SB model demonstrated the strongest performance, achieving a mean Area Under the Curve (AUC) of 0.836 and a classification accuracy of 76.2%.
  arXiv  Detail & Related papers  (2025-12-21T13:46:50Z)
• A Disease-Centric Vision-Language Foundation Model for Precision Oncology in Kidney Cancer [54.58205672910646]
  RenalCLIP is a visual-language foundation model for characterization, diagnosis and prognosis of renal mass.<n>It achieved better performance and superior generalizability across 10 core tasks spanning the full clinical workflow of kidney cancer.
  arXiv  Detail & Related papers  (2025-08-22T17:48:19Z)
• Predicting Targeted Therapy Resistance in Non-Small Cell Lung Cancer Using Multimodal Machine Learning [0.5116003548817487]
  Lung cancer is the primary cause of cancer death globally, with non-small cell lung cancer (NSCLC) emerging as its most prevalent subtype.<n>Osimertinib, a third-generation EGFR-tyrosine kinase inhibitor (TKI), has demonstrated remarkable efficacy in the treatment of NSCLC patients.<n>Despite its established efficacy, drug resistance poses a significant challenge for patients to fully benefit from osimertinib.
  arXiv  Detail & Related papers  (2025-03-31T14:47:02Z)
• CRTRE: Causal Rule Generation with Target Trial Emulation Framework [47.2836994469923]
  We introduce a novel method called causal rule generation with target trial emulation framework (CRTRE) CRTRE applies randomize trial design principles to estimate the causal effect of association rules. We then incorporate such association rules for the downstream applications such as prediction of disease onsets.
  arXiv  Detail & Related papers  (2024-11-10T02:40:06Z)
• TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs [49.69047720285225]
  We propose a novel topological approach that explicitly extracts multi-scale topological structures to better approximate breast parenchymal structures. We empirically validate emphTopoTxR using the VICTRE phantom breast dataset. Our qualitative and quantitative analyses suggest differential topological behavior of breast tissue in treatment-na"ive imaging.
  arXiv  Detail & Related papers  (2024-11-05T19:35:10Z)
• Benchmarking Histopathology Foundation Models for Ovarian Cancer Bevacizumab Treatment Response Prediction from Whole Slide Images [1.4999444543328293]
  We leverage the latest histopathology foundation models trained on large-scale whole slide image (WSI) to extract ovarian tumor tissue features for predicting bevacizumab response. Our survival models are able to stratify high- and low-risk cases with statistical significance.
  arXiv  Detail & Related papers  (2024-07-30T07:15:39Z)
• Histopathology Based AI Model Predicts Anti-Angiogenic Therapy Response in Renal Cancer Clinical Trial [0.6087644423424302]
  We present a novel deep learning (DL) approach to predict the Angioscore from ubiquitous histopathology slides. Our model produces a visual vascular network which is the basis of the model's prediction. Our approach offers insights into angiogenesis biology and AA treatment response.
  arXiv  Detail & Related papers  (2024-05-28T16:21:20Z)
• Using Multiparametric MRI with Optimized Synthetic Correlated Diffusion Imaging to Enhance Breast Cancer Pathologic Complete Response Prediction [71.91773485443125]
  Neoadjuvant chemotherapy has recently gained popularity as a promising treatment strategy for breast cancer. The current process to recommend neoadjuvant chemotherapy relies on the subjective evaluation of medical experts. This research investigates the application of optimized CDI$s$ to enhance breast cancer pathologic complete response prediction.
  arXiv  Detail & Related papers  (2024-05-13T15:40:56Z)
• Using Pre-training and Interaction Modeling for ancestry-specific disease prediction in UK Biobank [69.90493129893112]
  Recent genome-wide association studies (GWAS) have uncovered the genetic basis of complex traits, but show an under-representation of non-European descent individuals. Here, we assess whether we can improve disease prediction across diverse ancestries using multiomic data.
  arXiv  Detail & Related papers  (2024-04-26T16:39:50Z)
• Developing a Novel Image Marker to Predict the Clinical Outcome of Neoadjuvant Chemotherapy (NACT) for Ovarian Cancer Patients [1.7623658472574557]
  Neoadjuvant chemotherapy (NACT) is one kind of treatment for advanced stage ovarian cancer patients. Partial responses to NACT may lead to suboptimal debulking surgery, which will result in adverse prognosis. We developed a novel image marker to achieve high accuracy prognosis prediction of NACT at an early stage.
  arXiv  Detail & Related papers  (2023-09-13T16:59:50Z)
• Recurrence-Free Survival Prediction for Anal Squamous Cell Carcinoma Chemoradiotherapy using Planning CT-based Radiomics Model [5.485361086613949]
  Approximately 30% of non-metastatic anal squamous cell carcinoma (A SCC) patients will experience recurrence after chemotherapy (CRT) We developed a model leveraging information extracted from radiation pretreatment planning CT to predict recurrence-free survival (RFS) in A SCC patients after CRT.
  arXiv  Detail & Related papers  (2023-09-05T20:22:26Z)
• hist2RNA: An efficient deep learning architecture to predict gene expression from breast cancer histopathology images [11.822321981275232]
  Deep learning algorithms can effectively extract morphological patterns in digital histopathology images to predict molecular phenotypes quickly and cost-effectively. We propose a new, computationally efficient approach called hist2RNA inspired by bulk RNA-sequencing techniques to predict the expression of 138 genes.
  arXiv  Detail & Related papers  (2023-04-10T10:54:32Z)
• Enhancing Clinical Support for Breast Cancer with Deep Learning Models using Synthetic Correlated Diffusion Imaging [66.63200823918429]
  We investigate enhancing clinical support for breast cancer with deep learning models. We leverage a volumetric convolutional neural network to learn deep radiomic features from a pre-treatment cohort. We find that the proposed approach can achieve better performance for both grade and post-treatment response prediction.
  arXiv  Detail & Related papers  (2022-11-10T03:02:12Z)
• Exploiting segmentation labels and representation learning to forecast therapy response of PDAC patients [60.78505216352878]
  We propose a hybrid deep neural network pipeline to predict tumour response to initial chemotherapy. We leverage a combination of representation transfer from segmentation to classification, as well as localisation and representation learning. Our approach yields a remarkably data-efficient method able to predict treatment response with a ROC-AUC of 63.7% using only 477 datasets in total.
  arXiv  Detail & Related papers  (2022-11-08T11:50:31Z)
• Comparison of Machine Learning Classifiers to Predict Patient Survival and Genetics of GBM: Towards a Standardized Model for Clinical Implementation [44.02622933605018]
  Radiomic models have been shown to outperform clinical data for outcome prediction in glioblastoma (GBM) We aimed to compare nine machine learning classifiers to predict overall survival (OS), isocitrate dehydrogenase (IDH) mutation, O-6-methylguanine-DNA-methyltransferase (MGMT) promoter methylation, epidermal growth factor receptor (EGFR) VII amplification and Ki-67 expression in GBM patients. xGB obtained maximum accuracy for OS (74.5%), AB for IDH mutation (88%), MGMT methylation (71,7%), Ki-67 expression (86,6%), and EGFR amplification (81,
  arXiv  Detail & Related papers  (2021-02-10T15:10:37Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)
• Deep learning-based prediction of response to HER2-targeted neoadjuvant chemotherapy from pre-treatment dynamic breast MRI: A multi-institutional validation study [0.5149010213385097]
  Predicting response to neoadjuvant therapy is a vexing challenge in breast cancer. Deep learning could provide an effective and reliable tool to guide targeted therapy in breast cancer.
  arXiv  Detail & Related papers  (2020-01-22T17:54:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.