Selecting Regions of Interest in Large Multi-Scale Images for Cancer
Pathology
- URL: http://arxiv.org/abs/2007.01866v1
- Date: Fri, 3 Jul 2020 15:27:41 GMT
- Title: Selecting Regions of Interest in Large Multi-Scale Images for Cancer
Pathology
- Authors: Rui Aguiar, Jon Braatz
- Abstract summary: High resolution scans of microscopy slides offer enough information for a cancer pathologist to come to a conclusion regarding cancer presence, subtype, and severity based on measurements of features within the slide image at multiple scales and resolutions.
We explore approaches based on Reinforcement Learning and Beam Search to learn to progressively zoom into the WSI to detect Regions of Interest (ROIs) in liver pathology slides containing one of two types of liver cancer, namely Hepatocellular Carcinoma (HCC) and Cholangiocarcinoma (CC)
These ROIs can then be presented directly to the pathologist to aid in measurement and diagnosis or be used
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recent breakthroughs in object detection and image classification using
Convolutional Neural Networks (CNNs) are revolutionizing the state of the art
in medical imaging, and microscopy in particular presents abundant
opportunities for computer vision algorithms to assist medical professionals in
diagnosis of diseases ranging from malaria to cancer. High resolution scans of
microscopy slides called Whole Slide Images (WSIs) offer enough information for
a cancer pathologist to come to a conclusion regarding cancer presence,
subtype, and severity based on measurements of features within the slide image
at multiple scales and resolutions. WSIs' extremely high resolutions and
feature scales ranging from gross anatomical structures down to cell nuclei
preclude the use of standard CNN models for object detection and
classification, which have typically been designed for images with dimensions
in the hundreds of pixels and with objects on the order of the size of the
image itself. We explore parallel approaches based on Reinforcement Learning
and Beam Search to learn to progressively zoom into the WSI to detect Regions
of Interest (ROIs) in liver pathology slides containing one of two types of
liver cancer, namely Hepatocellular Carcinoma (HCC) and Cholangiocarcinoma
(CC). These ROIs can then be presented directly to the pathologist to aid in
measurement and diagnosis or be used for automated classification of tumor
subtype.
Related papers
- Super-resolution of biomedical volumes with 2D supervision [84.5255884646906]
Masked slice diffusion for super-resolution exploits the inherent equivalence in the data-generating distribution across all spatial dimensions of biological specimens.
We focus on the application of SliceR to stimulated histology (SRH), characterized by its rapid acquisition of high-resolution 2D images but slow and costly optical z-sectioning.
arXiv Detail & Related papers (2024-04-15T02:41:55Z) - Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - CAMIL: Context-Aware Multiple Instance Learning for Cancer Detection and
Subtyping in Whole Slide Images [0.0]
We propose the Context-Aware Multiple Instance Learning (CAMIL) architecture for cancer diagnosis.
CAMIL incorporates neighbor-constrained attention to consider dependencies among tiles within a Whole Slide Images (WSI) and integrates contextual constraints as prior knowledge into the MIL model.
We evaluate CAMIL on subtyping non-small cell lung cancer (TCGA-NSCLC) and detecting lymph node metastasis, achieving test AUCs of 0.959% and 0.975%, respectively.
arXiv Detail & Related papers (2023-05-09T10:06:37Z) - MultiNet with Transformers: A Model for Cancer Diagnosis Using Images [8.686667049158476]
We provide unique deep neural network designs for multiclass classification of medical images.
We incorporated transformers into a multiclass framework to take advantage of data-gathering capability and perform more accurate classifications.
arXiv Detail & Related papers (2023-01-21T20:53:57Z) - Generative Residual Attention Network for Disease Detection [51.60842580044539]
We present a novel approach for disease generation in X-rays using a conditional generative adversarial learning.
We generate a corresponding radiology image in a target domain while preserving the identity of the patient.
We then use the generated X-ray image in the target domain to augment our training to improve the detection performance.
arXiv Detail & Related papers (2021-10-25T14:15:57Z) - Learned super resolution ultrasound for improved breast lesion
characterization [52.77024349608834]
Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level.
In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges.
By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
arXiv Detail & Related papers (2021-07-12T09:04:20Z) - Multiscale Detection of Cancerous Tissue in High Resolution Slide Scans [0.0]
We present an algorithm for multi-scale tumor (chimeric cell) detection in high resolution slide scans.
Our approach modifies the effective receptive field at different layers in a CNN so that objects with a broad range of varying scales can be detected in a single forward pass.
arXiv Detail & Related papers (2020-10-01T18:56:46Z) - Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo
Hyperspectral Tumor Type Classification [49.32653090178743]
We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning.
Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
arXiv Detail & Related papers (2020-07-02T12:00:53Z) - Spatio-spectral deep learning methods for in-vivo hyperspectral
laryngeal cancer detection [49.32653090178743]
Early detection of head and neck tumors is crucial for patient survival.
Hyperspectral imaging (HSI) can be used for non-invasive detection of head and neck tumors.
We present multiple deep learning techniques for in-vivo laryngeal cancer detection based on HSI.
arXiv Detail & Related papers (2020-04-21T17:07:18Z) - Breast Cancer Histopathology Image Classification and Localization using
Multiple Instance Learning [2.4178424543973267]
Computer-aided pathology to analyze microscopic histopathology images for diagnosis can bring the cost and delays of diagnosis down.
Deep learning in histopathology has attracted attention over the last decade of achieving state-of-the-art performance in classification and localization tasks.
We present classification and localization results on two publicly available BreakHIS and BACH dataset.
arXiv Detail & Related papers (2020-02-16T10:29:16Z) - Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype
Classification with Unannotated Histopathological Images [16.02231907106384]
We develop a new CNN-based cancer subtype classification method by effectively combining multiple-instance, domain adversarial, and multi-scale learning frameworks.
The classification performance was significantly better than the standard CNN or other conventional methods, and the accuracy compared favorably with that of standard pathologists.
arXiv Detail & Related papers (2020-01-06T14:09:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.