Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art

• URL: http://arxiv.org/abs/2308.16316v1
• Date: Wed, 30 Aug 2023 20:46:45 GMT
• Title: Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art
• Authors: Tanujit Chakraborty, Ujjwal Reddy K S, Shraddha M. Naik, Madhurima Panja, Bayapureddy Manvitha
• Abstract summary: Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains. In February 2018, GAN secured the leading spot on the Top Ten Global Breakthrough Technologies List'' This survey aims to provide a general overview of GANs, summarizing the latent architecture, validation metrics, and application areas of the most widely recognized variants.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of a discriminative network and a generative network engaged in a Minimax game, GANs have revolutionized the field of generative modeling. In February 2018, GAN secured the leading spot on the ``Top Ten Global Breakthrough Technologies List'' issued by the Massachusetts Science and Technology Review. Over the years, numerous advancements have been proposed, leading to a rich array of GAN variants, such as conditional GAN, Wasserstein GAN, CycleGAN, and StyleGAN, among many others. This survey aims to provide a general overview of GANs, summarizing the latent architecture, validation metrics, and application areas of the most widely recognized variants. We also delve into recent theoretical developments, exploring the profound connection between the adversarial principle underlying GAN and Jensen-Shannon divergence, while discussing the optimality characteristics of the GAN framework. The efficiency of GAN variants and their model architectures will be evaluated along with training obstacles as well as training solutions. In addition, a detailed discussion will be provided, examining the integration of GANs with newly developed deep learning frameworks such as Transformers, Physics-Informed Neural Networks, Large Language models, and Diffusion models. Finally, we reveal several issues as well as future research outlines in this field.

Related papers

• On the Convergence of (Stochastic) Gradient Descent for Kolmogorov--Arnold Networks [56.78271181959529]
  Kolmogorov--Arnold Networks (KANs) have gained significant attention in the deep learning community. Empirical investigations demonstrate that KANs optimized via gradient descent (SGD) are capable of achieving near-zero training loss.
  arXiv  Detail & Related papers  (2024-10-10T15:34:10Z)
• U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation [48.40120035775506]
  Kolmogorov-Arnold Networks (KANs) reshape the neural network learning via the stack of non-linear learnable activation functions. We investigate, modify and re-design the established U-Net pipeline by integrating the dedicated KAN layers on the tokenized intermediate representation, termed U-KAN. We further delved into the potential of U-KAN as an alternative U-Net noise predictor in diffusion models, demonstrating its applicability in generating task-oriented model architectures.
  arXiv  Detail & Related papers  (2024-06-05T04:13:03Z)
• Generative Adversarial Networks for Image Super-Resolution: A Survey [101.39605080291783]
  Single image super-resolution (SISR) has played an important role in the field of image processing. Recent generative adversarial networks (GANs) can achieve excellent results on low-resolution images with small samples. In this paper, we conduct a comparative study of GANs from different perspectives.
  arXiv  Detail & Related papers  (2022-04-28T16:35:04Z)
• Generative Adversarial Networks (GANs) in Networking: A Comprehensive Survey & Evaluation [5.196831100533835]
  Generative Adversarial Networks (GANs) constitute an extensively researched machine learning sub-field. GANs are typically used to generate or transform synthetic images. In this paper, we demonstrate how this branch of machine learning can benefit multiple aspects of computer and communication networks.
  arXiv  Detail & Related papers  (2021-05-10T08:28:36Z)
• MineGAN++: Mining Generative Models for Efficient Knowledge Transfer to Limited Data Domains [77.46963293257912]
  We propose a novel knowledge transfer method for generative models based on mining the knowledge that is most beneficial to a specific target domain. This is done using a miner network that identifies which part of the generative distribution of each pretrained GAN outputs samples closest to the target domain. We show that the proposed method, called MineGAN, effectively transfers knowledge to domains with few target images, outperforming existing methods.
  arXiv  Detail & Related papers  (2021-04-28T13:10:56Z)
• Generative Adversarial Network: Some Analytical Perspectives [4.933916728941277]
  generative adversarial networks (GANs) have attracted tremendous amount of attention. Different variations of GANs models have been developed and tailored to different applications in practice. Issues regarding the performance and training of GANs have been noticed and investigated from various theoretical perspectives.
  arXiv  Detail & Related papers  (2021-04-25T17:12:32Z)
• Polynomial Networks in Deep Classifiers [55.90321402256631]
  We cast the study of deep neural networks under a unifying framework. Our framework provides insights on the inductive biases of each model. The efficacy of the proposed models is evaluated on standard image and audio classification benchmarks.
  arXiv  Detail & Related papers  (2021-04-16T06:41:20Z)
• Generative Adversarial Networks (GANs): An Overview of Theoretical Model, Evaluation Metrics, and Recent Developments [9.023847175654602]
  Generative Adversarial Network (GAN) is an effective method to produce samples of large-scale data distribution. GANs provide an appropriate way to learn deep representations without widespread use of labeled training data. In GANs, the generative model is estimated via a competitive process where the generator and discriminator networks are trained simultaneously.
  arXiv  Detail & Related papers  (2020-05-27T05:56:53Z)
• Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions [15.839877885431806]
  Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. There exists major challenges in training of GANs, i.e., mode collapse, non-convergence and instability.
  arXiv  Detail & Related papers  (2020-04-30T19:26:46Z)
• A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications [154.4832792036163]
  Generative adversarial networks (GANs) are a hot research topic recently. GANs have been widely studied since 2014, and a large number of algorithms have been proposed. This paper provides a review on various GANs methods from the perspectives of algorithms, theory, and applications.
  arXiv  Detail & Related papers  (2020-01-20T01:52:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.