A Novel Measure to Evaluate Generative Adversarial Networks Based on Direct Analysis of Generated Images

• URL: http://arxiv.org/abs/2002.12345v4
• Date: Wed, 7 Apr 2021 05:18:25 GMT
• Title: A Novel Measure to Evaluate Generative Adversarial Networks Based on Direct Analysis of Generated Images
• Authors: Shuyue Guan, Murray Loew
• Abstract summary: The Generative Adversarial Network (GAN) is a state-of-the-art technique in the field of deep learning. Here, we consider a fundamental way to evaluate GANs by directly analyzing the images they generate.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The Generative Adversarial Network (GAN) is a state-of-the-art technique in the field of deep learning. A number of recent papers address the theory and applications of GANs in various fields of image processing. Fewer studies, however, have directly evaluated GAN outputs. Those that have been conducted focused on using classification performance, e.g., Inception Score (IS) and statistical metrics, e.g., Fr\'echet Inception Distance (FID). Here, we consider a fundamental way to evaluate GANs by directly analyzing the images they generate, instead of using them as inputs to other classifiers. We characterize the performance of a GAN as an image generator according to three aspects: 1) Creativity: non-duplication of the real images. 2) Inheritance: generated images should have the same style, which retains key features of the real images. 3) Diversity: generated images are different from each other. A GAN should not generate a few different images repeatedly. Based on the three aspects of ideal GANs, we have designed the Likeness Score (LS) to evaluate GAN performance, and have applied it to evaluate several typical GANs. We compared our proposed measure with two commonly used GAN evaluation methods: IS and FID, and four additional measures. Furthermore, we discuss how these evaluations could help us deepen our understanding of GANs and improve their performance.

Related papers

• Revisiting the Evaluation of Image Synthesis with GANs [55.72247435112475]
  This study presents an empirical investigation into the evaluation of synthesis performance, with generative adversarial networks (GANs) as a representative of generative models. In particular, we make in-depth analyses of various factors, including how to represent a data point in the representation space, how to calculate a fair distance using selected samples, and how many instances to use from each set.
  arXiv  Detail & Related papers  (2023-04-04T17:54:32Z)
• Generative Adversarial Networks for Image Super-Resolution: A Survey [101.39605080291783]
  Single image super-resolution (SISR) has played an important role in the field of image processing. Recent generative adversarial networks (GANs) can achieve excellent results on low-resolution images with small samples. In this paper, we conduct a comparative study of GANs from different perspectives.
  arXiv  Detail & Related papers  (2022-04-28T16:35:04Z)
• Generalized Visual Quality Assessment of GAN-Generated Face Images [79.47386781978531]
  We study the subjective and objective quality towards generalized quality assessment of GAN-generated face images (GFIs) We develop a quality assessment model that is able to deliver accurate quality predictions for GFIs from both available and unseen GAN algorithms.
  arXiv  Detail & Related papers  (2022-01-28T07:54:49Z)
• A Method for Evaluating Deep Generative Models of Images via Assessing the Reproduction of High-order Spatial Context [9.00018232117916]
  Generative adversarial networks (GANs) are one kind of DGM which are widely employed. In this work, we demonstrate several objective tests of images output by two popular GAN architectures. We designed several context models (SCMs) of distinct image features that can be recovered after generation by a trained GAN.
  arXiv  Detail & Related papers  (2021-11-24T15:58:10Z)
• Compound Frechet Inception Distance for Quality Assessment of GAN Created Images [7.628527132779575]
  One notable application of GANs is developing fake human faces, also known as "deep fakes" Measuring the quality of the generated images is inherently subjective but attempts to objectify quality using standardized metrics have been made. We propose to improve the robustness of the evaluation process by integrating lower-level features to cover a wider array of visual defects.
  arXiv  Detail & Related papers  (2021-06-16T06:53:27Z)
• IMAGINE: Image Synthesis by Image-Guided Model Inversion [79.4691654458141]
  We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images. We leverage the knowledge of image semantics from a pre-trained classifier to achieve plausible generations. IMAGINE enables the synthesis procedure to simultaneously 1) enforce semantic specificity constraints during the synthesis, 2) produce realistic images without generator training, and 3) give users intuitive control over the generation process.
  arXiv  Detail & Related papers  (2021-04-13T02:00:24Z)
• Guiding GANs: How to control non-conditional pre-trained GANs for conditional image generation [69.10717733870575]
  We present a novel method for guiding generic non-conditional GANs to behave as conditional GANs. Our approach adds into the mix an encoder network to generate the high-dimensional random input that are fed to the generator network of a non-conditional GAN.
  arXiv  Detail & Related papers  (2021-01-04T14:03:32Z)
• GIQA: Generated Image Quality Assessment [36.01759301994946]
  Generative adversarial networks (GANs) have achieved impressive results today, but not all generated images are perfect. We propose Generated Image Quality Assessment (GIQA), which quantitatively evaluates the quality of each generated image.
  arXiv  Detail & Related papers  (2020-03-19T17:56:08Z)
• A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications [154.4832792036163]
  Generative adversarial networks (GANs) are a hot research topic recently. GANs have been widely studied since 2014, and a large number of algorithms have been proposed. This paper provides a review on various GANs methods from the perspectives of algorithms, theory, and applications.
  arXiv  Detail & Related papers  (2020-01-20T01:52:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.