Deep learning-based bias transfer for overcoming laboratory differences
of microscopic images
- URL: http://arxiv.org/abs/2105.11765v1
- Date: Tue, 25 May 2021 09:02:30 GMT
- Title: Deep learning-based bias transfer for overcoming laboratory differences
of microscopic images
- Authors: Ann-Katrin Thebille and Esther Dietrich and Martin Klaus and Lukas
Gernhold and Maximilian Lennartz and Christoph Kuppe and Rafael Kramann and
Tobias B. Huber and Guido Sauter and Victor G. Puelles and Marina Zimmermann
and Stefan Bonn
- Abstract summary: We evaluate, compare, and improve existing generative model architectures to overcome domain shifts for immunofluorescence (IF) and Hematoxylin and Eosin (H&E) stained microscopy images.
Adapting the bias of the samples significantly improved the pixel-level segmentation for human kidney glomeruli and podocytes and improved the classification accuracy for human prostate biopsies by up to 14%.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The automated analysis of medical images is currently limited by technical
and biological noise and bias. The same source tissue can be represented by
vastly different images if the image acquisition or processing protocols vary.
For an image analysis pipeline, it is crucial to compensate such biases to
avoid misinterpretations. Here, we evaluate, compare, and improve existing
generative model architectures to overcome domain shifts for immunofluorescence
(IF) and Hematoxylin and Eosin (H&E) stained microscopy images. To determine
the performance of the generative models, the original and transformed images
were segmented or classified by deep neural networks that were trained only on
images of the target bias. In the scope of our analysis, U-Net cycleGANs
trained with an additional identity and an MS-SSIM-based loss and Fixed-Point
GANs trained with an additional structure loss led to the best results for the
IF and H&E stained samples, respectively. Adapting the bias of the samples
significantly improved the pixel-level segmentation for human kidney glomeruli
and podocytes and improved the classification accuracy for human prostate
biopsies by up to 14%.
Related papers
- On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - BioGAN: An unpaired GAN-based image to image translation model for
microbiological images [1.6427658855248812]
We develop an unpaired GAN-based (Generative Adversarial Network) image to image translation model for microbiological images.
We propose a novel design for a GAN model, BioGAN, by utilizing Adversarial and Perceptual loss in order to transform high level features of laboratory-taken images into field images.
arXiv Detail & Related papers (2023-06-09T19:30:49Z) - Optimizations of Autoencoders for Analysis and Classification of
Microscopic In Situ Hybridization Images [68.8204255655161]
We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression.
The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
arXiv Detail & Related papers (2023-04-19T13:45:28Z) - Realistic Data Enrichment for Robust Image Segmentation in
Histopathology [2.248423960136122]
We propose a new approach, based on diffusion models, which can enrich an imbalanced dataset with plausible examples from underrepresented groups.
Our method can simply expand limited clinical datasets making them suitable to train machine learning pipelines.
arXiv Detail & Related papers (2023-04-19T09:52:50Z) - Magnification Invariant Medical Image Analysis: A Comparison of
Convolutional Networks, Vision Transformers, and Token Mixers [2.3859625728972484]
Convolution Neural Networks (CNNs) are widely used in medical image analysis.
Their performance degrade when the magnification of testing images differ from the training images.
This study aims to evaluate the robustness of various deep learning architectures.
arXiv Detail & Related papers (2023-02-22T16:44:41Z) - Retinal Image Restoration and Vessel Segmentation using Modified
Cycle-CBAM and CBAM-UNet [0.7868449549351486]
A cycle-consistent generative adversarial network (CycleGAN) with a convolution block attention module (CBAM) is used for retinal image restoration.
A modified UNet is used for retinal vessel segmentation for the restored retinal images.
The proposed method can significantly reduce the degradation effects caused by out-of-focus blurring, color distortion, low, high, and uneven illumination.
arXiv Detail & Related papers (2022-09-09T10:47:20Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z) - StyPath: Style-Transfer Data Augmentation For Robust Histology Image
Classification [6.690876060631452]
We propose a novel pipeline to build robust deep neural networks for AMR classification based on StyPath.
Each image was generated in 1.84 + 0.03 seconds using a single GTX V TITAN and pytorch.
Our results imply that our style-transfer augmentation technique improves histological classification performance.
arXiv Detail & Related papers (2020-07-09T18:02:49Z) - Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis.
We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors.
Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
arXiv Detail & Related papers (2020-05-12T08:01:16Z) - Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and
Convolutional Neural Networks [68.96150598294072]
Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights.
It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness.
In recent years, there has been a significant effort to automate the diagnosis using deep learning.
This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN)
Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
arXiv Detail & Related papers (2020-04-03T14:07:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.