CIMIL-CRC: a clinically-informed multiple instance learning framework
for patient-level colorectal cancer molecular subtypes classification from
H\&E stained images
- URL: http://arxiv.org/abs/2401.16131v1
- Date: Mon, 29 Jan 2024 12:56:11 GMT
- Title: CIMIL-CRC: a clinically-informed multiple instance learning framework
for patient-level colorectal cancer molecular subtypes classification from
H\&E stained images
- Authors: Hadar Hezi, Matan Gelber, Alexander Balabanov, Yosef E. Maruvka, Moti
Freiman
- Abstract summary: We introduce CIMIL-CRC', a framework that solves the MSI/MSS MIL problem by efficiently combining a pre-trained feature extraction model with principal component analysis (PCA) to aggregate information from all patches.
We assessed our CIMIL-CRC method using the average area under the curve (AUC) from a 5-fold cross-validation experimental setup for model development on the TCGA-CRC-DX cohort.
- Score: 45.32169712547367
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Treatment approaches for colorectal cancer (CRC) are highly dependent on the
molecular subtype, as immunotherapy has shown efficacy in cases with
microsatellite instability (MSI) but is ineffective for the microsatellite
stable (MSS) subtype. There is promising potential in utilizing deep neural
networks (DNNs) to automate the differentiation of CRC subtypes by analyzing
Hematoxylin and Eosin (H\&E) stained whole-slide images (WSIs). Due to the
extensive size of WSIs, Multiple Instance Learning (MIL) techniques are
typically explored. However, existing MIL methods focus on identifying the most
representative image patches for classification, which may result in the loss
of critical information. Additionally, these methods often overlook clinically
relevant information, like the tendency for MSI class tumors to predominantly
occur on the proximal (right side) colon. We introduce `CIMIL-CRC', a DNN
framework that: 1) solves the MSI/MSS MIL problem by efficiently combining a
pre-trained feature extraction model with principal component analysis (PCA) to
aggregate information from all patches, and 2) integrates clinical priors,
particularly the tumor location within the colon, into the model to enhance
patient-level classification accuracy. We assessed our CIMIL-CRC method using
the average area under the curve (AUC) from a 5-fold cross-validation
experimental setup for model development on the TCGA-CRC-DX cohort, contrasting
it with a baseline patch-level classification, MIL-only approach, and
Clinically-informed patch-level classification approach. Our CIMIL-CRC
outperformed all methods (AUROC: $0.92\pm0.002$ (95\% CI 0.91-0.92), vs.
$0.79\pm0.02$ (95\% CI 0.76-0.82), $0.86\pm0.01$ (95\% CI 0.85-0.88), and
$0.87\pm0.01$ (95\% CI 0.86-0.88), respectively). The improvement was
statistically significant.
Related papers
- Improving Fairness of Automated Chest X-ray Diagnosis by Contrastive
Learning [19.948079693716075]
Our proposed AI model utilizes supervised contrastive learning to minimize bias in CXR diagnosis.
We evaluated the methods on two datasets: the Medical Imaging and Data Resource Center (MIDRC) dataset with 77,887 CXR images and the NIH Chest X-ray dataset with 112,120 CXR images.
arXiv Detail & Related papers (2024-01-25T20:03:57Z) - Automated Assessment of Critical View of Safety in Laparoscopic
Cholecystectomy [51.240181118593114]
Cholecystectomy (gallbladder removal) is one of the most common procedures in the US, with more than 1.2M procedures annually.
LC is associated with an increase in bile duct injuries (BDIs), resulting in significant morbidity and mortality.
In this paper, we develop deep-learning techniques to automate the assessment of critical view of safety (CVS) in LCs.
arXiv Detail & Related papers (2023-09-13T22:01:36Z) - CAMIL: Context-Aware Multiple Instance Learning for Cancer Detection and
Subtyping in Whole Slide Images [0.0]
We propose the Context-Aware Multiple Instance Learning (CAMIL) architecture for cancer diagnosis.
CAMIL incorporates neighbor-constrained attention to consider dependencies among tiles within a Whole Slide Images (WSI) and integrates contextual constraints as prior knowledge into the MIL model.
We evaluate CAMIL on subtyping non-small cell lung cancer (TCGA-NSCLC) and detecting lymph node metastasis, achieving test AUCs of 0.959% and 0.975%, respectively.
arXiv Detail & Related papers (2023-05-09T10:06:37Z) - Exploring the Interplay Between Colorectal Cancer Subtypes Genomic
Variants and Cellular Morphology: A Deep-Learning Approach [4.374837991804085]
We trained CNN models for CRC subtype classification that account for potential correlation between genomic variations within CRC subtypes and their corresponding cellular morphology patterns.
We assessed the interplay between CRC subtypes' genomic variations and cellular morphology patterns by evaluating the CRC subtype classification accuracy of the different models.
arXiv Detail & Related papers (2023-03-26T12:13:29Z) - Attention-based Saliency Maps Improve Interpretability of Pneumothorax
Classification [52.77024349608834]
To investigate chest radiograph (CXR) classification performance of vision transformers (ViT) and interpretability of attention-based saliency.
ViTs were fine-tuned for lung disease classification using four public data sets: CheXpert, Chest X-Ray 14, MIMIC CXR, and VinBigData.
ViTs had comparable CXR classification AUCs compared with state-of-the-art CNNs.
arXiv Detail & Related papers (2023-03-03T12:05:41Z) - Efficient subtyping of ovarian cancer histopathology whole slide images
using active sampling in multiple instance learning [2.038893829552157]
Discriminative Region Active Sampling for Multiple Instance Learning (DRAS-MIL) is a computationally efficient slide classification method using attention scores to focus sampling on highly discriminative regions.
We show that DRAS-MIL can achieve similar classification performance to exhaustive slide analysis, with a 3-fold cross-validated AUC of 0.8679.
Our approach uses at most 18% as much memory as the standard approach, while taking 33% of the time when evaluating on a GPU and only 14% on a CPU alone.
arXiv Detail & Related papers (2023-02-17T13:28:06Z) - Improving Classification Model Performance on Chest X-Rays through Lung
Segmentation [63.45024974079371]
We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations.
Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
arXiv Detail & Related papers (2022-02-22T15:24:06Z) - Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based
Sparse PCA Network [93.22587316229954]
We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E)
We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
arXiv Detail & Related papers (2021-10-27T19:28:36Z) - Multi-Scale Input Strategies for Medulloblastoma Tumor Classification
using Deep Transfer Learning [59.30734371401316]
Medulloblastoma is the most common malignant brain cancer among children.
CNN has shown promising results for MB subtype classification.
We study the impact of tile size and input strategy.
arXiv Detail & Related papers (2021-09-14T09:42:37Z) - TransMIL: Transformer based Correlated Multiple Instance Learning for
Whole Slide Image Classication [38.58585442160062]
Multiple instance learning (MIL) is a powerful tool to solve the weakly supervised classification in whole slide image (WSI) based pathology diagnosis.
We proposed a new framework, called correlated MIL, and provided a proof for convergence.
We conducted various experiments for three different computational pathology problems and achieved better performance and faster convergence compared with state-of-the-art methods.
arXiv Detail & Related papers (2021-06-02T02:57:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.