Improving Unsupervised Stain-To-Stain Translation using Self-Supervision and Meta-Learning

• URL: http://arxiv.org/abs/2112.08837v1
• Date: Thu, 16 Dec 2021 12:42:40 GMT
• Title: Improving Unsupervised Stain-To-Stain Translation using Self-Supervision and Meta-Learning
• Authors: Nassim Bouteldja, Barbara Mara Klinkhammer, Tarek Schlaich, Peter Boor, Dorit Merhof
• Abstract summary: Unsupervised domain adaptation based on image-to-image translation is gaining importance in digital pathology. We tackle the variation of different histological stains by unsupervised stain-to-stain translation. We use CycleGANs for stain-to-stain translation in kidney histopathology.
• Score: 4.32671477389424
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In digital pathology, many image analysis tasks are challenged by the need for large and time-consuming manual data annotations to cope with various sources of variability in the image domain. Unsupervised domain adaptation based on image-to-image translation is gaining importance in this field by addressing variabilities without the manual overhead. Here, we tackle the variation of different histological stains by unsupervised stain-to-stain translation to enable a stain-independent applicability of a deep learning segmentation model. We use CycleGANs for stain-to-stain translation in kidney histopathology, and propose two novel approaches to improve translational effectivity. First, we integrate a prior segmentation network into the CycleGAN for a self-supervised, application-oriented optimization of translation through semantic guidance, and second, we incorporate extra channels to the translation output to implicitly separate artificial meta-information otherwise encoded for tackling underdetermined reconstructions. The latter showed partially superior performances to the unmodified CycleGAN, but the former performed best in all stains providing instance-level Dice scores ranging between 78% and 92% for most kidney structures, such as glomeruli, tubules, and veins. However, CycleGANs showed only limited performance in the translation of other structures, e.g. arteries. Our study also found somewhat lower performance for all structures in all stains when compared to segmentation in the original stain. Our study suggests that with current unsupervised technologies, it seems unlikely to produce generally applicable fake stains.

Related papers

• Unsupervised Latent Stain Adaptation for Computational Pathology [2.483372684394528]
  Stain adaptation aims to reduce the generalization error between different stains by training a model on source stains that generalizes to target stains. We propose a joint training between artificially labeled and unlabeled data including all available stained images called Unsupervised Latent Stain Adaptation (ULSA) Our method uses stain translation to enrich labeled source images with synthetic target images in order to increase the supervised signals.
  arXiv  Detail & Related papers  (2024-06-27T11:08:42Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• Stain Isolation-based Guidance for Improved Stain Translation [0.5249805590164902]
  CycleGAN is state of the art for the stain translation of histopathology images. It often suffers from the presence of cycle-consistent but non structure-preserving errors. We propose an alternative approach to the set of methods which, relying on segmentation consistency, enable the preservation of pathology structures.
  arXiv  Detail & Related papers  (2022-06-28T13:33:48Z)
• MultiPathGAN: Structure Preserving Stain Normalization using Unsupervised Multi-domain Adversarial Network with Perception Loss [10.043946236248392]
  Histopathology relies on the analysis of microscopic tissue images to diagnose disease. We introduce an unsupervised adversarial network to translate (and hence normalize) whole slide images across multiple data acquisition domains.
  arXiv  Detail & Related papers  (2022-04-20T20:48:17Z)
• Unsupervised Image-to-Image Translation with Generative Prior [103.54337984566877]
  Unsupervised image-to-image translation aims to learn the translation between two visual domains without paired data. We present a novel framework, Generative Prior-guided UN Image-to-image Translation (GP-UNIT), to improve the overall quality and applicability of the translation algorithm.
  arXiv  Detail & Related papers  (2022-04-07T17:59:23Z)
• Improving Multilingual Translation by Representation and Gradient Regularization [82.42760103045083]
  We propose a joint approach to regularize NMT models at both representation-level and gradient-level. Our results demonstrate that our approach is highly effective in both reducing off-target translation occurrences and improving zero-shot translation performance.
  arXiv  Detail & Related papers  (2021-09-10T10:52:21Z)
• Modelling Latent Translations for Cross-Lingual Transfer [47.61502999819699]
  We propose a new technique that integrates both steps of the traditional pipeline (translation and classification) into a single model. We evaluate our novel latent translation-based model on a series of multilingual NLU tasks. We report gains for both zero-shot and few-shot learning setups, up to 2.7 accuracy points on average.
  arXiv  Detail & Related papers  (2021-07-23T17:11:27Z)
• Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions Segmentation [79.58311369297635]
  We propose a new weakly-supervised lesions transfer framework, which can explore transferable domain-invariant knowledge across different datasets. A Wasserstein quantified transferability framework is developed to highlight widerange transferable contextual dependencies. A novel self-supervised pseudo label generator is designed to equally provide confident pseudo pixel labels for both hard-to-transfer and easy-to-transfer target samples.
  arXiv  Detail & Related papers  (2020-12-08T02:26:03Z)
• Flow-based Deformation Guidance for Unpaired Multi-Contrast MRI Image-to-Image Translation [7.8333615755210175]
  In this paper, we introduce a novel approach to unpaired image-to-image translation based on the invertible architecture. We utilize the temporal information between consecutive slices to provide more constraints to the optimization for transforming one domain to another in unpaired medical images.
  arXiv  Detail & Related papers  (2020-12-03T09:10:22Z)
• Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation [22.51574923085135]
  Augmented Cyclic Consistency Regularization (A CCR) is a novel regularization method for unpaired I2I translation. Our method outperforms the consistency regularized GAN (CR-GAN) in real-world translations.
  arXiv  Detail & Related papers  (2020-02-29T06:20:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.