HistoStarGAN: A Unified Approach to Stain Normalisation, Stain Transfer
and Stain Invariant Segmentation in Renal Histopathology
- URL: http://arxiv.org/abs/2210.09798v1
- Date: Tue, 18 Oct 2022 12:22:26 GMT
- Title: HistoStarGAN: A Unified Approach to Stain Normalisation, Stain Transfer
and Stain Invariant Segmentation in Renal Histopathology
- Authors: Jelica Vasiljevi\'c, Friedrich Feuerhake, C\'edric Wemmert, Thomas
Lampert
- Abstract summary: HistoStarGAN is a unified framework that performs stain transfer between multiple stainings.
It can serve as a synthetic data generator, which paves the way for the use of fully annotated synthetic image data.
- Score: 0.5505634045241288
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Virtual stain transfer is a promising area of research in Computational
Pathology, which has a great potential to alleviate important limitations when
applying deeplearningbased solutions such as lack of annotations and
sensitivity to a domain shift. However, in the literature, the majority of
virtual staining approaches are trained for a specific staining or stain
combination, and their extension to unseen stainings requires the acquisition
of additional data and training. In this paper, we propose HistoStarGAN, a
unified framework that performs stain transfer between multiple stainings,
stain normalisation and stain invariant segmentation, all in one inference of
the model. We demonstrate the generalisation abilities of the proposed solution
to perform diverse stain transfer and accurate stain invariant segmentation
over numerous unseen stainings, which is the first such demonstration in the
field. Moreover, the pre-trained HistoStar-GAN model can serve as a synthetic
data generator, which paves the way for the use of fully annotated synthetic
image data to improve the training of deep learning-based algorithms. To
illustrate the capabilities of our approach, as well as the potential risks in
the microscopy domain, inspired by applications in natural images, we generated
KidneyArtPathology, a fully annotated artificial image dataset for renal
pathology.
Related papers
- Unsupervised Latent Stain Adaptation for Computational Pathology [2.483372684394528]
Stain adaptation aims to reduce the generalization error between different stains by training a model on source stains that generalizes to target stains.
We propose a joint training between artificially labeled and unlabeled data including all available stained images called Unsupervised Latent Stain Adaptation (ULSA)
Our method uses stain translation to enrich labeled source images with synthetic target images in order to increase the supervised signals.
arXiv Detail & Related papers (2024-06-27T11:08:42Z) - Synthetic optical coherence tomography angiographs for detailed retinal
vessel segmentation without human annotations [12.571349114534597]
We present a lightweight simulation of the retinal vascular network based on space colonization for faster and more realistic OCTA synthesis.
We demonstrate the superior segmentation performance of our approach in extensive quantitative and qualitative experiments on three public datasets.
arXiv Detail & Related papers (2023-06-19T14:01:47Z) - Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
We propose a domain transfer approach based on conditional invertible neural networks (cINNs)
Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood.
Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
arXiv Detail & Related papers (2023-03-17T18:00:27Z) - Rethinking Semi-Supervised Medical Image Segmentation: A
Variance-Reduction Perspective [51.70661197256033]
We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation.
We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks.
We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
arXiv Detail & Related papers (2023-02-03T13:50:25Z) - Stain-invariant self supervised learning for histopathology image
analysis [74.98663573628743]
We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer.
Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
arXiv Detail & Related papers (2022-11-14T18:16:36Z) - Stain-Adaptive Self-Supervised Learning for Histopathology Image
Analysis [3.8073142980733]
We propose a novel Stain-Adaptive Self-Supervised Learning(SASSL) method for histopathology image analysis.
Our SASSL integrates a domain-adversarial training module into the SSL framework to learn distinctive features that are robust to both various transformations and stain variations.
Experimental results demonstrate that the proposed method can robustly improve the feature extraction ability of the model.
arXiv Detail & Related papers (2022-08-08T09:54:46Z) - RandStainNA: Learning Stain-Agnostic Features from Histology Slides by
Bridging Stain Augmentation and Normalization [45.81689497433507]
Two proposals, namely stain normalization (SN) and stain augmentation (SA), have been spotlighted to reduce the generalization error.
To address the problems, we unify SN and SA with a novel RandStainNA scheme.
The RandStainNA constrains variable stain styles in a practicable range to train a stain agnostic deep learning model.
arXiv Detail & Related papers (2022-06-25T16:43:59Z) - Stain based contrastive co-training for histopathological image analysis [61.87751502143719]
We propose a novel semi-supervised learning approach for classification of histovolution images.
We employ strong supervision with patch-level annotations combined with a novel co-training loss to create a semi-supervised learning framework.
We evaluate our approach in clear cell renal cell and prostate carcinomas, and demonstrate improvement over state-of-the-art semi-supervised learning methods.
arXiv Detail & Related papers (2022-06-24T22:25:31Z) - Data-driven generation of plausible tissue geometries for realistic
photoacoustic image synthesis [53.65837038435433]
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties.
We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate"
We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
arXiv Detail & Related papers (2021-03-29T11:30:18Z) - Towards Histopathological Stain Invariance by Unsupervised Domain
Augmentation using Generative Adversarial Networks [0.7340845393655052]
We propose an unsupervised augmentation approach based on adversarial image-to-image translation.
By training the network on one commonly used staining modality and applying it to images that include corresponding, but differently stained, tissue structures, the presented method demonstrates significant improvements.
arXiv Detail & Related papers (2020-12-22T23:32:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.