Overcoming the limitations of patch-based learning to detect cancer in whole slide images

• URL: http://arxiv.org/abs/2012.00617v1
• Date: Tue, 1 Dec 2020 16:37:18 GMT
• Title: Overcoming the limitations of patch-based learning to detect cancer in whole slide images
• Authors: Ozan Ciga, Tony Xu, Sharon Nofech-Mozes, Shawna Noy, Fang-I Lu, Anne L. Martel
• Abstract summary: Whole slide images (WSIs) pose unique challenges when training deep learning models. We outline the differences between patch or slide-level classification versus methods that need to localize or segment cancer accurately across the whole slide. We propose a negative data sampling strategy, which drastically reduces the false positive rate and improves each metric pertinent to our problem.
• Score: 0.15658704610960567
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Whole slide images (WSIs) pose unique challenges when training deep learning models. They are very large which makes it necessary to break each image down into smaller patches for analysis, image features have to be extracted at multiple scales in order to capture both detail and context, and extreme class imbalances may exist. Significant progress has been made in the analysis of these images, thanks largely due to the availability of public annotated datasets. We postulate, however, that even if a method scores well on a challenge task, this success may not translate to good performance in a more clinically relevant workflow. Many datasets consist of image patches which may suffer from data curation bias; other datasets are only labelled at the whole slide level and the lack of annotations across an image may mask erroneous local predictions so long as the final decision is correct. In this paper, we outline the differences between patch or slide-level classification versus methods that need to localize or segment cancer accurately across the whole slide, and we experimentally verify that best practices differ in both cases. We apply a binary cancer detection network on post neoadjuvant therapy breast cancer WSIs to find the tumor bed outlining the extent of cancer, a task which requires sensitivity and precision across the whole slide. We extensively study multiple design choices and their effects on the outcome, including architectures and augmentations. Furthermore, we propose a negative data sampling strategy, which drastically reduces the false positive rate (7% on slide level) and improves each metric pertinent to our problem, with a 15% reduction in the error of tumor extent.

Related papers

• Efficient Classification of Histopathology Images [5.749787074942512]
  We use images with annotated tumor regions to identify a set of tumor patches and a set of benign patches in a cancerous slide. This creates an important problem during patch-level classification, where the majority of patches from an image labeled as 'cancerous' are actually tumor-free.
  arXiv  Detail & Related papers  (2024-09-08T17:41:04Z)
• Active Learning Enhances Classification of Histopathology Whole Slide Images with Attention-based Multiple Instance Learning [48.02011627390706]
  We train an attention-based MIL and calculate a confidence metric for every image in the dataset to select the most uncertain WSIs for expert annotation. With a novel attention guiding loss, this leads to an accuracy boost of the trained models with few regions annotated for each class. It may in the future serve as an important contribution to train MIL models in the clinically relevant context of cancer classification in histopathology.
  arXiv  Detail & Related papers  (2023-03-02T15:18:58Z)
• Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics [63.76637479503006]
  Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. This paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes. Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability.
  arXiv  Detail & Related papers  (2022-11-29T23:47:56Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• PCA: Semi-supervised Segmentation with Patch Confidence Adversarial Training [52.895952593202054]
  We propose a new semi-supervised adversarial method called Patch Confidence Adrial Training (PCA) for medical image segmentation. PCA learns the pixel structure and context information in each patch to get enough gradient feedback, which aids the discriminator in convergent to an optimal state. Our method outperforms the state-of-the-art semi-supervised methods, which demonstrates its effectiveness for medical image segmentation.
  arXiv  Detail & Related papers  (2022-07-24T07:45:47Z)
• Mixed Supervision Learning for Whole Slide Image Classification [88.31842052998319]
  We propose a mixed supervision learning framework for super high-resolution images. During the patch training stage, this framework can make use of coarse image-level labels to refine self-supervised learning. A comprehensive strategy is proposed to suppress pixel-level false positives and false negatives.
  arXiv  Detail & Related papers  (2021-07-02T09:46:06Z)
• Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification [0.22312377591335414]
  Whole-slide-images typically have to be divided into smaller patches which are then analyzed individually using machine learning-based approaches. We propose to subdivide the image into coherent regions prior to classification by grouping visually similar adjacent image pixels into larger segments, i.e. superpixels. The algorithm has been developed and validated on a dataset of 159 hand-annotated whole-slide-images of colon resections and its performance has been compared to a standard patch-based approach.
  arXiv  Detail & Related papers  (2021-06-30T08:34:06Z)
• Weakly-supervised High-resolution Segmentation of Mammography Images for Breast Cancer Diagnosis [17.936019428281586]
  In cancer diagnosis, interpretability can be achieved by localizing the region of the input image responsible for the output. We introduce a novel neural network architecture to perform weakly-supervised segmentation of high-resolution images. We apply this model to breast cancer diagnosis with screening mammography, and validate it on a large clinically-realistic dataset.
  arXiv  Detail & Related papers  (2021-06-13T17:25:21Z)
• An End-to-End Breast Tumour Classification Model Using Context-Based Patch Modelling- A BiLSTM Approach for Image Classification [19.594639581421422]
  We have tried to integrate this relationship along with feature-based correlation among the extracted patches from the particular tumorous region. We trained and tested our model on two datasets, microscopy images and WSI tumour regions. We found out that BiLSTMs with CNN features have performed much better in modelling patches into an end-to-end Image classification network.
  arXiv  Detail & Related papers  (2021-06-05T10:43:58Z)
• Multimodal brain tumor classification [4.984601297028256]
  This work investigates a deep learning method combining whole slide images and magnetic resonance images to classify tumors. In particular, our solution comprises a powerful, generic and modular architecture for whole slide image classification. Experiments are prospectively conducted on the 2020 Computational Precision Medicine challenge.
  arXiv  Detail & Related papers  (2020-09-03T11:41:50Z)
• Multi-label Thoracic Disease Image Classification with Cross-Attention Networks [65.37531731899837]
  We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images. We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
  arXiv  Detail & Related papers  (2020-07-21T14:37:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.