Stain Style Transfer of Histopathology Images Via Structure-Preserved
Generative Learning
- URL: http://arxiv.org/abs/2007.12578v1
- Date: Fri, 24 Jul 2020 15:30:19 GMT
- Title: Stain Style Transfer of Histopathology Images Via Structure-Preserved
Generative Learning
- Authors: Hanwen Liang, Konstantinos N. Plataniotis, Xingyu Li
- Abstract summary: This study proposes two stain style transfer models, SSIM-GAN and DSCSI-GAN, based on the generative adversarial networks.
By cooperating structural preservation metrics and feedback of an auxiliary diagnosis net in learning, medical-relevant information is preserved in color-normalized images.
- Score: 31.254432319814864
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Computational histopathology image diagnosis becomes increasingly popular and
important, where images are segmented or classified for disease diagnosis by
computers. While pathologists do not struggle with color variations in slides,
computational solutions usually suffer from this critical issue. To address the
issue of color variations in histopathology images, this study proposes two
stain style transfer models, SSIM-GAN and DSCSI-GAN, based on the generative
adversarial networks. By cooperating structural preservation metrics and
feedback of an auxiliary diagnosis net in learning, medical-relevant
information presented by image texture, structure, and chroma-contrast features
is preserved in color-normalized images. Particularly, the smart treat of
chromatic image content in our DSCSI-GAN model helps to achieve noticeable
normalization improvement in image regions where stains mix due to histological
substances co-localization. Extensive experimentation on public histopathology
image sets indicates that our methods outperform prior arts in terms of
generating more stain-consistent images, better preserving histological
information in images, and obtaining significantly higher learning efficiency.
Our python implementation is published on
https://github.com/hanwen0529/DSCSI-GAN.
Related papers
- Learned representation-guided diffusion models for large-image generation [58.192263311786824]
We introduce a novel approach that trains diffusion models conditioned on embeddings from self-supervised learning (SSL)
Our diffusion models successfully project these features back to high-quality histopathology and remote sensing images.
Augmenting real data by generating variations of real images improves downstream accuracy for patch-level and larger, image-scale classification tasks.
arXiv Detail & Related papers (2023-12-12T14:45:45Z) - Performance of GAN-based augmentation for deep learning COVID-19 image
classification [57.1795052451257]
The biggest challenge in the application of deep learning to the medical domain is the availability of training data.
Data augmentation is a typical methodology used in machine learning when confronted with a limited data set.
In this work, a StyleGAN2-ADA model of Generative Adversarial Networks is trained on the limited COVID-19 chest X-ray image set.
arXiv Detail & Related papers (2023-04-18T15:39:58Z) - Stain-Adaptive Self-Supervised Learning for Histopathology Image
Analysis [3.8073142980733]
We propose a novel Stain-Adaptive Self-Supervised Learning(SASSL) method for histopathology image analysis.
Our SASSL integrates a domain-adversarial training module into the SSL framework to learn distinctive features that are robust to both various transformations and stain variations.
Experimental results demonstrate that the proposed method can robustly improve the feature extraction ability of the model.
arXiv Detail & Related papers (2022-08-08T09:54:46Z) - Texture Characterization of Histopathologic Images Using Ecological
Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate.
It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
arXiv Detail & Related papers (2022-02-27T02:19:09Z) - H&E-adversarial network: a convolutional neural network to learn
stain-invariant features through Hematoxylin & Eosin regression [1.7371375427784381]
This paper presents a novel method to train convolutional neural networks (CNNs) that better generalize on data including several colour variations.
The method, called H&E-adversarial CNN, exploits H&E matrix information to learn stain-invariant features during the training.
arXiv Detail & Related papers (2022-01-17T10:34:23Z) - Colorectal Polyp Classification from White-light Colonoscopy Images via
Domain Alignment [57.419727894848485]
A computer-aided diagnosis system is required to assist accurate diagnosis from colonoscopy images.
Most previous studies at-tempt to develop models for polyp differentiation using Narrow-Band Imaging (NBI) or other enhanced images.
We propose a novel framework based on a teacher-student architecture for the accurate colorectal polyp classification.
arXiv Detail & Related papers (2021-08-05T09:31:46Z) - Structure-Preserving Multi-Domain Stain Color Augmentation using
Style-Transfer with Disentangled Representations [0.9051352746190446]
HistAuGAN can simulate a wide variety of realistic histology stain colors, thus making neural networks stain-invariant when applied during training.
Based on a generative adversarial network (GAN) for image-to-image translation, our model disentangles the content of the image, i.e., the morphological tissue structure, from the stain color attributes.
It can be trained on multiple domains and, therefore, learns to cover different stain colors as well as other domain-specific variations introduced in the slide preparation and imaging process.
arXiv Detail & Related papers (2021-07-26T17:52:39Z) - Learning domain-agnostic visual representation for computational
pathology using medically-irrelevant style transfer augmentation [4.538771844947821]
STRAP (Style TRansfer Augmentation for histoPathology) is a form of data augmentation based on random style transfer from artistic paintings.
Style transfer replaces the low-level texture content of images with the uninformative style of randomly selected artistic paintings.
We demonstrate that STRAP leads to state-of-the-art performance, particularly in the presence of domain shifts.
arXiv Detail & Related papers (2021-02-02T18:50:16Z) - Bridging the gap between Natural and Medical Images through Deep
Colorization [15.585095421320922]
Transfer learning from natural image collections is a standard practice that attempts to tackle shape, texture and color discrepancies.
In this work, we propose to disentangle those challenges and design a dedicated network module that focuses on color adaptation.
We combine learning from scratch of the color module with transfer learning of different classification backbones, obtaining an end-to-end, easy-to-train architecture for diagnostic image recognition.
arXiv Detail & Related papers (2020-05-21T12:03:14Z) - Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and
Convolutional Neural Networks [68.96150598294072]
Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights.
It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness.
In recent years, there has been a significant effort to automate the diagnosis using deep learning.
This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN)
Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
arXiv Detail & Related papers (2020-04-03T14:07:41Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.