A Survey on Generative Adversarial Networks: Variants, Applications, and Training

• URL: http://arxiv.org/abs/2006.05132v1
• Date: Tue, 9 Jun 2020 09:04:41 GMT
• Title: A Survey on Generative Adversarial Networks: Variants, Applications, and Training
• Authors: Abdul Jabbar, Xi Li, and Bourahla Omar
• Abstract summary: Generative Adversarial Networks (GAN) have gained considerable attention in the field of unsupervised learning. Despite GAN's excellent success, there are still obstacles to stable training. Herein, we survey several training solutions proposed by different researchers to stabilize GAN training.
• Score: 9.299132423767992
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The Generative Models have gained considerable attention in the field of unsupervised learning via a new and practical framework called Generative Adversarial Networks (GAN) due to its outstanding data generation capability. Many models of GAN have proposed, and several practical applications emerged in various domains of computer vision and machine learning. Despite GAN's excellent success, there are still obstacles to stable training. The problems are due to Nash-equilibrium, internal covariate shift, mode collapse, vanishing gradient, and lack of proper evaluation metrics. Therefore, stable training is a crucial issue in different applications for the success of GAN. Herein, we survey several training solutions proposed by different researchers to stabilize GAN training. We survey, (I) the original GAN model and its modified classical versions, (II) detail analysis of various GAN applications in different domains, (III) detail study about the various GAN training obstacles as well as training solutions. Finally, we discuss several new issues as well as research outlines to the topic.

Related papers

• A Survey on 3D Skeleton Based Person Re-Identification: Approaches, Designs, Challenges, and Future Directions [71.99165135905827]
  Person re-identification via 3D skeletons is an important emerging research area that triggers great interest in the pattern recognition community. With distinctive advantages for many application scenarios, a great diversity of 3D skeleton based person re-identification methods have been proposed in recent years. This paper provides a systematic survey on current SRID approaches, model designs, challenges, and future directions.
  arXiv  Detail & Related papers  (2024-01-27T04:52:24Z)
• Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art [0.0]
  Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains. In February 2018, GAN secured the leading spot on the Top Ten Global Breakthrough Technologies List'' This survey aims to provide a general overview of GANs, summarizing the latent architecture, validation metrics, and application areas of the most widely recognized variants.
  arXiv  Detail & Related papers  (2023-08-30T20:46:45Z)
• PASTA: Pretrained Action-State Transformer Agents [10.654719072766495]
  Self-supervised learning has brought about a revolutionary paradigm shift in various computing domains. Recent approaches involve pre-training transformer models on vast amounts of unlabeled data. In reinforcement learning, researchers have recently adapted these approaches, developing models pre-trained on expert trajectories.
  arXiv  Detail & Related papers  (2023-07-20T15:09:06Z)
• Foundation Models for Decision Making: Problems, Methods, and Opportunities [124.79381732197649]
  Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. New paradigms are emerging for training foundation models to interact with other agents and perform long-term reasoning. Research at the intersection of foundation models and decision making holds tremendous promise for creating powerful new systems.
  arXiv  Detail & Related papers  (2023-03-07T18:44:07Z)
• Attention Diversification for Domain Generalization [92.02038576148774]
  Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. When applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. We propose a novel Attention Diversification framework, in which Intra-Model and Inter-Model Attention Diversification Regularization are collaborated.
  arXiv  Detail & Related papers  (2022-10-09T09:15:21Z)
• Generative Adversarial Network: Some Analytical Perspectives [4.933916728941277]
  generative adversarial networks (GANs) have attracted tremendous amount of attention. Different variations of GANs models have been developed and tailored to different applications in practice. Issues regarding the performance and training of GANs have been noticed and investigated from various theoretical perspectives.
  arXiv  Detail & Related papers  (2021-04-25T17:12:32Z)
• Discovering Diverse Solutions in Deep Reinforcement Learning [84.45686627019408]
  Reinforcement learning algorithms are typically limited to learning a single solution of a specified task. We propose an RL method that can learn infinitely many solutions by training a policy conditioned on a continuous or discrete low-dimensional latent variable.
  arXiv  Detail & Related papers  (2021-03-12T04:54:31Z)
• Training Generative Adversarial Networks in One Stage [58.983325666852856]
  We introduce a general training scheme that enables training GANs efficiently in only one stage. We show that the proposed method is readily applicable to other adversarial-training scenarios, such as data-free knowledge distillation.
  arXiv  Detail & Related papers  (2021-02-28T09:03:39Z)
• Improving GAN Training with Probability Ratio Clipping and Sample Reweighting [145.5106274085799]
  generative adversarial networks (GANs) often suffer from inferior performance due to unstable training. We propose a new variational GAN training framework which enjoys superior training stability. By plugging the training approach in diverse state-of-the-art GAN architectures, we obtain significantly improved performance over a range of tasks.
  arXiv  Detail & Related papers  (2020-06-12T01:39:48Z)
• Regularization Methods for Generative Adversarial Networks: An Overview of Recent Studies [3.829070379776576]
  Generative Adversarial Network (GAN) has been extensively studied and used for various tasks. Regularization methods have been proposed to make the training of GAN stable.
  arXiv  Detail & Related papers  (2020-05-19T01:59:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.