A Generalized Deep Learning Framework for Whole-Slide Image Segmentation
and Analysis
- URL: http://arxiv.org/abs/2001.00258v2
- Date: Wed, 18 Nov 2020 08:29:35 GMT
- Title: A Generalized Deep Learning Framework for Whole-Slide Image Segmentation
and Analysis
- Authors: Mahendra Khened, Avinash Kori, Haran Rajkumar, Balaji Srinivasan,
Ganapathy Krishnamurthi
- Abstract summary: Histopathology tissue analysis is considered the gold standard in cancer diagnosis and prognosis.
Deep learning-based techniques have provided state of the art results in a wide variety of image analysis tasks.
We propose a deep learning-based framework for histopathology image analysis.
- Score: 0.20065923589074736
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Histopathology tissue analysis is considered the gold standard in cancer
diagnosis and prognosis. Given the large size of these images and the increase
in the number of potential cancer cases, an automated solution as an aid to
histopathologists is highly desirable. In the recent past, deep learning-based
techniques have provided state of the art results in a wide variety of image
analysis tasks, including analysis of digitized slides. However, the size of
images and variability in histopathology tasks makes it a challenge to develop
an integrated framework for histopathology image analysis. We propose a deep
learning-based framework for histopathology tissue analysis. We demonstrate the
generalizability of our framework, including training and inference, on several
open-source datasets, which include CAMELYON (breast cancer metastases),
DigestPath (colon cancer), and PAIP (liver cancer) datasets. We discuss
multiple types of uncertainties pertaining to data and model, namely aleatoric
and epistemic, respectively. Simultaneously, we demonstrate our model
generalization across different data distribution by evaluating some samples on
TCGA data. On CAMELYON16 test data (n=139) for the task of lesion detection,
the FROC score achieved was 0.86 and in the CAMELYON17 test-data (n=500) for
the task of pN-staging the Cohen's kappa score achieved was 0.9090 (third in
the open leaderboard). On DigestPath test data (n=212) for the task of tumor
segmentation, a Dice score of 0.782 was achieved (fourth in the challenge). On
PAIP test data (n=40) for the task of viable tumor segmentation, a Jaccard
Index of 0.75 (third in the challenge) was achieved, and for viable tumor
burden, a score of 0.633 was achieved (second in the challenge). Our entire
framework and related documentation are freely available at GitHub and PyPi.
Related papers
- Towards a Benchmark for Colorectal Cancer Segmentation in Endorectal Ultrasound Videos: Dataset and Model Development [59.74920439478643]
In this paper, we collect and annotated the first benchmark dataset that covers diverse ERUS scenarios.
Our ERUS-10K dataset comprises 77 videos and 10,000 high-resolution annotated frames.
We introduce a benchmark model for colorectal cancer segmentation, named the Adaptive Sparse-context TRansformer (ASTR)
arXiv Detail & Related papers (2024-08-19T15:04:42Z) - TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images [62.53931644063323]
In this study we extended the capabilities of TotalSegmentator to MR images.
We trained an nnU-Net segmentation algorithm on this dataset and calculated similarity coefficients (Dice) to evaluate the model's performance.
The model significantly outperformed two other publicly available segmentation models (Dice score 0.824 versus 0.762; p0.001 and 0.762 versus 0.542; p)
arXiv Detail & Related papers (2024-05-29T20:15:54Z) - WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Images [5.960501267687475]
We investigate how to generate pathology reports given whole slide images.
We curated the largest WSI-text dataset (PathText)
On the model end, we propose the multiple instance generative model (MI-Gen)
arXiv Detail & Related papers (2023-11-27T05:05:41Z) - Multi-task learning for tissue segmentation and tumor detection in
colorectal cancer histology slides [0.9176056742068814]
We propose a U-Net based multi-task model combined with channel-wise and image-statistics-based color augmentations.
Our approach achieved a multi-task Dice score of.8655 (Arm 1) and.8515 (Arm 2) for tissue segmentation and AUROC of.9725 (Arm 1) and 0.9750 (Arm 2) for tumor detection on the challenge validation set.
arXiv Detail & Related papers (2023-04-06T14:26:41Z) - Histopathological Imaging Classification of Breast Tissue for Cancer
Diagnosis Support Using Deep Learning Models [0.0]
Hematoxylin and Eosin are considered the gold standard for cancer diagnoses.
Based on the idea of dividing the pathologic image (WSI) into multiple patches, we used the window [512,512] sliding from left to right and sliding from top to bottom, each sliding step overlapping by 50% to augmented data on a dataset of 400 images.
The EffficientNet model is a recently developed model that uniformly scales the width, depth, and resolution of the network with a set of fixed scaling factors that are well suited for training images with high resolution.
arXiv Detail & Related papers (2022-07-03T13:56:44Z) - WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic
Segmentation for Lung Adenocarcinoma [51.50991881342181]
This challenge includes 10,091 patch-level annotations and over 130 million labeled pixels.
First place team achieved mIoU of 0.8413 (tumor: 0.8389, stroma: 0.7931, normal: 0.8919)
arXiv Detail & Related papers (2022-04-13T15:27:05Z) - Wide & Deep neural network model for patch aggregation in CNN-based
prostate cancer detection systems [51.19354417900591]
Prostate cancer (PCa) is one of the leading causes of death among men, with almost 1.41 million new cases and around 375,000 deaths in 2020.
To perform an automatic diagnosis, prostate tissue samples are first digitized into gigapixel-resolution whole-slide images.
Small subimages called patches are extracted and predicted, obtaining a patch-level classification.
arXiv Detail & Related papers (2021-05-20T18:13:58Z) - Chest x-ray automated triage: a semiologic approach designed for
clinical implementation, exploiting different types of labels through a
combination of four Deep Learning architectures [83.48996461770017]
This work presents a Deep Learning method based on the late fusion of different convolutional architectures.
We built four training datasets combining images from public chest x-ray datasets and our institutional archive.
We trained four different Deep Learning architectures and combined their outputs with a late fusion strategy, obtaining a unified tool.
arXiv Detail & Related papers (2020-12-23T14:38:35Z) - Representation Learning of Histopathology Images using Graph Neural
Networks [12.427740549056288]
We propose a two-stage framework for WSI representation learning.
We sample relevant patches using a color-based method and use graph neural networks to learn relations among sampled patches to aggregate the image information into a single vector representation.
We demonstrate the performance of our approach for discriminating two sub-types of lung cancers, Lung Adenocarcinoma (LUAD) & Lung Squamous Cell Carcinoma (LUSC)
arXiv Detail & Related papers (2020-04-16T00:09:20Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.