Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide images

• URL: http://arxiv.org/abs/2301.07700v2
• Date: Mon, 11 Dec 2023 21:58:25 GMT
• Title: Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide images
• Authors: Ziyu Su, Mostafa Rezapour, Usama Sajjad, Metin Nafi Gurcan, Muhammad Khalid Khan Niazi
• Abstract summary: We propose salient instance inference MIL (SiiMIL), a weakly-supervised MIL model for WSI classification. Our experiments imply that SiiMIL can accurately identify tumor instances, which could only take up less than 1% of a WSI.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multiple instance learning (MIL) models have achieved remarkable success in analyzing whole slide images (WSIs) for disease classification problems. However, with regard to gigapixel WSI classification problems, current MIL models are often incapable of differentiating a WSI with extremely small tumor lesions. This minute tumor-to-normal area ratio in a MIL bag inhibits the attention mechanism from properly weighting the areas corresponding to minor tumor lesions. To overcome this challenge, we propose salient instance inference MIL (SiiMIL), a weakly-supervised MIL model for WSI classification. Our method initially learns representations of normal WSIs, and it then compares the normal WSIs representations with all the input patches to infer the salient instances of the input WSI. Finally, it employs attention-based MIL to perform the slide-level classification based on the selected patches of the WSI. Our experiments imply that SiiMIL can accurately identify tumor instances, which could only take up less than 1% of a WSI, so that the ratio of tumor to normal instances within a bag can increase by two to four times. It is worth mentioning that it performs equally well for large tumor lesions. As a result, SiiMIL achieves a significant improvement in performance over the state-of-the-art MIL methods.

Related papers

• MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models [58.39336492765728]
  pathological diagnosis, the gold standard for cancer diagnosis, has achieved superior performance by combining the Transformer with the multiple instance learning (MIL) framework using whole slide images (WSIs) We propose a MamMIL framework for WSI classification by cooperating the selective structured state space model (i.e., Mamba) with MIL for the first time. Specifically, to solve the problem that Mamba can only conduct unidirectional one-dimensional (1D) sequence modeling, we innovatively introduce a bidirectional state space model and a 2D context-aware block.
  arXiv  Detail & Related papers  (2024-03-08T09:02:13Z)
• Compact and De-biased Negative Instance Embedding for Multi-Instance Learning on Whole-Slide Image Classification [3.2721526745176144]
  We introduce a semi-supervision signal to de-bias the inter-slide variability and to capture the common factors of variation within normal patches. We evaluate our method on two public WSI datasets including Camelyon-16 and TCGA lung cancer.
  arXiv  Detail & Related papers  (2024-02-16T11:28:50Z)
• Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit Tests [59.623267208433255]
  Multiple Instance Learning (MIL) is a sub-domain of classification problems with positive and negative labels and a "bag" of inputs. In this work, we examine five of the most prominent deep-MIL models and find that none of them respects the standard MIL assumption. We identify and demonstrate this problem via a proposed "algorithmic unit test", where we create synthetic datasets that can be solved by a MIL respecting model.
  arXiv  Detail & Related papers  (2023-10-27T03:05:11Z)
• Cross-attention-based saliency inference for predicting cancer metastasis on whole slide images [3.7282630026096597]
  Cross-attention-based salient instance inference MIL (CASiiMIL) is proposed to identify breast cancer lymph node micro-metastasis on whole slide images. We introduce a negative representation learning algorithm to facilitate the learning of saliency-informed attention weights for improved sensitivity on tumor WSIs. The proposed model outperforms the state-of-the-art MIL methods on two popular tumor metastasis detection datasets.
  arXiv  Detail & Related papers  (2023-09-18T00:56:19Z)
• Multiple Instance Learning Framework with Masked Hard Instance Mining for Whole Slide Image Classification [11.996318969699296]
  Masked hard instance mining (MHIM-MIL) is presented. MHIM-MIL uses a Siamese structure (Teacher-Student) with a consistency constraint to explore potential hard instances. Experimental results on the CAMELYON-16 and TCGA Lung Cancer datasets demonstrate that MHIM-MIL outperforms other latest methods in terms of performance and training cost.
  arXiv  Detail & Related papers  (2023-07-28T01:40:04Z)
• Active Learning Enhances Classification of Histopathology Whole Slide Images with Attention-based Multiple Instance Learning [48.02011627390706]
  We train an attention-based MIL and calculate a confidence metric for every image in the dataset to select the most uncertain WSIs for expert annotation. With a novel attention guiding loss, this leads to an accuracy boost of the trained models with few regions annotated for each class. It may in the future serve as an important contribution to train MIL models in the clinically relevant context of cancer classification in histopathology.
  arXiv  Detail & Related papers  (2023-03-02T15:18:58Z)
• AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of Giga-pixel Images [53.29794593104923]
  We present a novel concept of shared-context processing for whole slide histopathology images. AMIGO uses the celluar graph within the tissue to provide a single representation for a patient. We show that our model is strongly robust to missing information to an extent that it can achieve the same performance with as low as 20% of the data.
  arXiv  Detail & Related papers  (2023-03-01T23:37:45Z)
• Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics [63.76637479503006]
  Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. This paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes. Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability.
  arXiv  Detail & Related papers  (2022-11-29T23:47:56Z)
• DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classification [18.11776334311096]
  Multiple instance learning (MIL) has been increasingly used in the classification of histopathology whole slide images (WSIs) We propose to virtually enlarge the number of bags by introducing the concept of pseudo-bags. We also contribute to deriving the instance probability under the framework of attention-based MIL, and utilize the derivation to help construct and analyze the proposed framework.
  arXiv  Detail & Related papers  (2022-03-22T22:33:42Z)
• Multi-Scale Input Strategies for Medulloblastoma Tumor Classification using Deep Transfer Learning [59.30734371401316]
  Medulloblastoma is the most common malignant brain cancer among children. CNN has shown promising results for MB subtype classification. We study the impact of tile size and input strategy.
  arXiv  Detail & Related papers  (2021-09-14T09:42:37Z)
• Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learning [16.84711797934138]
  We address the challenging problem of whole slide image (WSI) classification. WSI classification can be cast as a multiple instance learning (MIL) problem when only slide-level labels are available. We propose a MIL-based method for WSI classification and tumor detection that does not require localized annotations.
  arXiv  Detail & Related papers  (2020-11-17T20:51:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.