Evaluating the Quality and Diversity of DCGAN-based Generatively
Synthesized Diabetic Retinopathy Imagery
- URL: http://arxiv.org/abs/2208.05593v3
- Date: Wed, 30 Aug 2023 12:39:29 GMT
- Title: Evaluating the Quality and Diversity of DCGAN-based Generatively
Synthesized Diabetic Retinopathy Imagery
- Authors: Cristina-Madalina Dragan, Muhammad Muneeb Saad, Mubashir Husain
Rehmani, and Ruairi O'Reilly
- Abstract summary: Publicly available diabetic retinopathy (DR) datasets are imbalanced, containing limited numbers of images with DR.
The imbalance can be addressed using Geneversarative Adrial Networks (GANs) to augment the datasets with synthetic images.
To evaluate the quality and diversity of synthetic images, several evaluation metrics, such as Multi-Scale Structural Similarity Index (MS-SSIM), Cosine Distance (CD), and Fr't Inception Distance (FID) are used.
- Score: 0.07499722271664144
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Publicly available diabetic retinopathy (DR) datasets are imbalanced,
containing limited numbers of images with DR. This imbalance contributes to
overfitting when training machine learning classifiers. The impact of this
imbalance is exacerbated as the severity of the DR stage increases, affecting
the classifiers' diagnostic capacity. The imbalance can be addressed using
Generative Adversarial Networks (GANs) to augment the datasets with synthetic
images. Generating synthetic images is advantageous if high-quality and
diversified images are produced. To evaluate the quality and diversity of
synthetic images, several evaluation metrics, such as Multi-Scale Structural
Similarity Index (MS-SSIM), Cosine Distance (CD), and Fr\'echet Inception
Distance (FID) are used. Understanding the effectiveness of each metric in
evaluating the quality and diversity of GAN-based synthetic images is critical
to select images for augmentation. To date, there has been limited analysis of
the appropriateness of these metrics in the context of biomedical imagery. This
work contributes an empirical assessment of these evaluation metrics as applied
to synthetic Proliferative DR imagery generated by a Deep Convolutional GAN
(DCGAN). Furthermore, the metrics' capacity to indicate the quality and
diversity of synthetic images and a correlation with classifier performance is
undertaken. This enables a quantitative selection of synthetic imagery and an
informed augmentation strategy. Results indicate that FID is suitable for
evaluating the quality, while MS-SSIM and CD are suitable for evaluating the
diversity of synthetic imagery. Furthermore, the superior performance of
Convolutional Neural Network (CNN) and EfficientNet classifiers, as indicated
by the F1 and AUC scores, for the augmented datasets demonstrates the efficacy
of synthetic imagery to augment the imbalanced dataset.
Related papers
- Introducing SDICE: An Index for Assessing Diversity of Synthetic Medical Datasets [3.9539878659683363]
We propose the SDICE index, which is based on the characterization of similarity distributions induced by a contrastive encoder.
Given a synthetic dataset and a reference dataset of real images, the SDICE index measures the distance between the similarity score distributions of original and synthetic images.
Experiments conducted on the MIMIC-chest X-ray and ImageNet datasets demonstrate the effectiveness of SDICE index.
arXiv Detail & Related papers (2024-09-28T18:47:17Z) - Non-Reference Quality Assessment for Medical Imaging: Application to Synthetic Brain MRIs [0.0]
This study introduces a novel deep learning-based non-reference approach to assess brain MRI quality by training a 3D ResNet.
The network is designed to estimate quality across six distinct artifacts commonly encountered in MRI scans.
Results demonstrate superior performance in accurately estimating distortions and reflecting image quality from multiple perspectives.
arXiv Detail & Related papers (2024-07-20T22:05:30Z) - Assessing Intra-class Diversity and Quality of Synthetically Generated
Images in a Biomedical and Non-biomedical Setting [0.6308539010172307]
Generative Adversarial Networks (GANs) are increasingly being relied upon for data augmentation tasks.
The diversity and quality of synthetic images are evaluated using different sample sizes.
Results demonstrate that the metrics scores for diversity and quality vary significantly across biomedical-to-biomedical and biomedical-to-non-biomedical imaging modalities.
arXiv Detail & Related papers (2023-07-23T16:39:18Z) - K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality
Assessment [71.27193056354741]
The problem of how to assess cross-modality medical image synthesis has been largely unexplored.
We propose a new metric K-CROSS to spur progress on this challenging problem.
K-CROSS uses a pre-trained multi-modality segmentation network to predict the lesion location.
arXiv Detail & Related papers (2023-07-10T01:26:48Z) - This Intestine Does Not Exist: Multiscale Residual Variational
Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation [7.430724826764835]
A novel Variational Autoencoder architecture is proposed, namely "This Intestine Does not Exist" (TIDE)
The proposed architecture comprises multiscale feature extraction convolutional blocks and residual connections, which enable the generation of high-quality and diverse datasets.
Contrary to the current approaches, which are oriented towards the augmentation of the available datasets, this study demonstrates that using TIDE, real WCE datasets can be fully substituted.
arXiv Detail & Related papers (2023-02-04T11:49:38Z) - A Self-attention Guided Multi-scale Gradient GAN for Diversified X-ray
Image Synthesis [0.6308539010172307]
Generative Adversarial Networks (GANs) are utilized to address the data limitation problem via the generation of synthetic images.
Training challenges such as mode collapse, non-convergence, and instability degrade a GAN's performance in synthesizing diversified and high-quality images.
This work proposes an attention-guided multi-scale gradient GAN architecture to model the relationship between long-range dependencies of biomedical image features.
arXiv Detail & Related papers (2022-10-09T13:17:17Z) - SIAN: Style-Guided Instance-Adaptive Normalization for Multi-Organ
Histopathology Image Synthesis [63.845552349914186]
We propose a style-guided instance-adaptive normalization (SIAN) to synthesize realistic color distributions and textures for different organs.
The four phases work together and are integrated into a generative network to embed image semantics, style, and instance-level boundaries.
arXiv Detail & Related papers (2022-09-02T16:45:46Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Diffusion-Weighted Magnetic Resonance Brain Images Generation with
Generative Adversarial Networks and Variational Autoencoders: A Comparison
Study [55.78588835407174]
We show that high quality, diverse and realistic-looking diffusion-weighted magnetic resonance images can be synthesized using deep generative models.
We present two networks, the Introspective Variational Autoencoder and the Style-Based GAN, that qualify for data augmentation in the medical field.
arXiv Detail & Related papers (2020-06-24T18:00:01Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.