GANs for Medical Image Synthesis: An Empirical Study
- URL: http://arxiv.org/abs/2105.05318v1
- Date: Tue, 11 May 2021 19:21:39 GMT
- Title: GANs for Medical Image Synthesis: An Empirical Study
- Authors: Youssef Skandarani, Pierre-Marc Jodoin, Alain Lalande
- Abstract summary: Generative Adversarial Networks (GANs) have become increasingly powerful, generating mind-blowing photorealistic images.
In this paper, we perform a multi-GAN and multi-application study to gauge the benefits of GANs in medical imaging.
- Score: 12.36854197042851
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Generative Adversarial Networks (GANs) have become increasingly powerful,
generating mind-blowing photorealistic images that mimic the content of
datasets they were trained to replicate. One recurrent theme in medical imaging
is whether GANs can also be effective at generating workable medical data as
they are for generating realistic RGB images. In this paper, we perform a
multi-GAN and multi-application study to gauge the benefits of GANs in medical
imaging. We tested various GAN architectures from basic DCGAN to more
sophisticated style-based GANs on three medical imaging modalities and organs
namely : cardiac cine-MRI, liver CT and RGB retina images. GANs were trained on
well-known and widely utilized datasets from which their FID score were
computed to measure the visual acuity of their generated images. We further
tested their usefulness by measuring the segmentation accuracy of a U-Net
trained on these generated images.
Results reveal that GANs are far from being equal as some are ill-suited for
medical imaging applications while others are much better off. The
top-performing GANs are capable of generating realistic-looking medical images
by FID standards that can fool trained experts in a visual Turing test and
comply to some metrics. However, segmentation results suggests that no GAN is
capable of reproducing the full richness of a medical datasets.
Related papers
- Medical Imaging Complexity and its Effects on GAN Performance [1.776717121506676]
Medical image synthesis via generative adversarial networks (GANs) emerged as a powerful method for synthetically generating photo-realistic images.
We experimentally establish benchmarks that measure the relationship between a sample dataset size and the fidelity of the generated images.
We conduct experiments with two state-of-the-art GANs, StyleGAN 3 and SPADE-GAN, trained on multiple medical imaging datasets with variable sample sizes.
arXiv Detail & Related papers (2024-10-23T15:28:25Z) - Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model [0.0]
This work investigates the use of Deep Convolutional Generative Adversarial Networks (DCGAN) for producing high-fidelity and realistic MRI image slices.
While the discriminator network discerns between created and real slices, the generator network learns to synthesise realistic MRI image slices.
The generator refines its capacity to generate slices that closely mimic real MRI data through an adversarial training approach.
arXiv Detail & Related papers (2024-04-11T05:06:51Z) - Radiology Report Generation Using Transformers Conditioned with
Non-imaging Data [55.17268696112258]
This paper proposes a novel multi-modal transformer network that integrates chest x-ray (CXR) images and associated patient demographic information.
The proposed network uses a convolutional neural network to extract visual features from CXRs and a transformer-based encoder-decoder network that combines the visual features with semantic text embeddings of patient demographic information.
arXiv Detail & Related papers (2023-11-18T14:52:26Z) - Preservation of High Frequency Content for Deep Learning-Based Medical
Image Classification [74.84221280249876]
An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists.
We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
arXiv Detail & Related papers (2022-05-08T15:29:54Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Application of DatasetGAN in medical imaging: preliminary studies [10.260087683496431]
Generative adversarial networks (GANs) have been widely investigated for many potential applications in medical imaging.
datasetGAN is a recently proposed framework based on modern GANs that can synthesize high-quality segmented images.
There are no published studies focusing on its applications to medical imaging.
arXiv Detail & Related papers (2022-02-27T22:03:20Z) - Pathology-Aware Generative Adversarial Networks for Medical Image
Augmentation [0.22843885788439805]
Generative Adversarial Networks (GANs) can generate realistic but novel samples, and thus effectively cover the real image distribution.
This thesis contains four GAN projects aiming to present such novel applications' clinical relevance in collaboration with physicians.
arXiv Detail & Related papers (2021-06-03T15:08:14Z) - Generative Adversarial U-Net for Domain-free Medical Image Augmentation [49.72048151146307]
The shortage of annotated medical images is one of the biggest challenges in the field of medical image computing.
In this paper, we develop a novel generative method named generative adversarial U-Net.
Our newly designed model is domain-free and generalizable to various medical images.
arXiv Detail & Related papers (2021-01-12T23:02:26Z) - SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on
Medical Images [47.35184075381965]
We present a data augmentation method for generating synthetic medical images using cycle-consistency Generative Adversarial Networks (GANs)
The proposed GANs-based model can generate a tumor image from a normal image, and in turn, it can also generate a normal image from a tumor image.
We train the classification model using real images with classic data augmentation methods and classification models using synthetic images.
arXiv Detail & Related papers (2020-11-15T14:01:24Z) - On the effectiveness of GAN generated cardiac MRIs for segmentation [12.59275199633534]
We propose a Variational Autoencoder (VAE) trained to learn the latent representations of cardiac shapes.
On the other side is a GAN that uses "SPatially-Adaptive (DE)Normalization" modules to generate realistic MR images tailored to a given anatomical map.
We show that segmentation with CNNs trained with our synthetic annotated images gets competitive results compared to traditional techniques.
arXiv Detail & Related papers (2020-05-18T18:48:38Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.