Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis

• URL: http://arxiv.org/abs/2109.02081v2
• Date: Mon, 21 Aug 2023 14:36:56 GMT
• Title: Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis
• Authors: Tong Sha, Wei Zhang, Tong Shen, Zhoujun Li, Tao Mei
• Abstract summary: We first summarize the scope of person generation, then systematically review recent progress and technical trends in deep person generation. More than two hundred papers are covered for a thorough overview, and the milestone works are highlighted to witness the major technical breakthrough. We hope this survey could shed some light on the future prospects of deep person generation, and provide a helpful foundation for full applications towards digital human.
• Score: 55.72674354651122
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep person generation has attracted extensive research attention due to its wide applications in virtual agents, video conferencing, online shopping and art/movie production. With the advancement of deep learning, visual appearances (face, pose, cloth) of a person image can be easily generated or manipulated on demand. In this survey, we first summarize the scope of person generation, and then systematically review recent progress and technical trends in deep person generation, covering three major tasks: talking-head generation (face), pose-guided person generation (pose) and garment-oriented person generation (cloth). More than two hundred papers are covered for a thorough overview, and the milestone works are highlighted to witness the major technical breakthrough. Based on these fundamental tasks, a number of applications are investigated, e.g., virtual fitting, digital human, generative data augmentation. We hope this survey could shed some light on the future prospects of deep person generation, and provide a helpful foundation for full applications towards digital human.

Related papers

• A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights [8.192172339127657]
  Human video generation aims to synthesize 2D human body video sequences with generative models given control conditions such as text, audio, and pose. Recent advancements in generative models have laid a solid foundation for the growing interest in this area. Despite the significant progress, the task of human video generation remains challenging due to the consistency of characters, the complexity of human motion, and difficulties in their relationship with the environment.
  arXiv  Detail & Related papers  (2024-07-11T12:09:05Z)
• Deepfake Generation and Detection: A Benchmark and Survey [134.19054491600832]
  Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions. This survey comprehensively reviews the latest developments in deepfake generation and detection. We focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing.
  arXiv  Detail & Related papers  (2024-03-26T17:12:34Z)
• Data Augmentation in Human-Centric Vision [54.97327269866757]
  This survey presents a comprehensive analysis of data augmentation techniques in human-centric vision tasks. It delves into a wide range of research areas including person ReID, human parsing, human pose estimation, and pedestrian detection. Our work categorizes data augmentation methods into two main types: data generation and data perturbation.
  arXiv  Detail & Related papers  (2024-03-13T16:05:18Z)
• Advances in 3D Generation: A Survey [54.95024616672868]
  The field of 3D content generation is developing rapidly, enabling the creation of increasingly high-quality and diverse 3D models. Specifically, we introduce the 3D representations that serve as the backbone for 3D generation. We provide a comprehensive overview of the rapidly growing literature on generation methods, categorized by the type of algorithmic paradigms.
  arXiv  Detail & Related papers  (2024-01-31T13:06:48Z)
• Human Motion Generation: A Survey [67.38982546213371]
  Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Most research within this field focuses on generating human motions based on conditional signals, such as text, audio, and scene contexts. We present a comprehensive literature review of human motion generation, which is the first of its kind in this field.
  arXiv  Detail & Related papers  (2023-07-20T14:15:20Z)
• Deep Learning Technique for Human Parsing: A Survey and Outlook [5.236995853909988]
  In this survey, we comprehensively review three core sub-tasks: single human parsing, multiple human parsing, and video human parsing. We put forward a transformer-based human parsing framework, providing a high-performance baseline for follow-up research. We point out a set of under-investigated open issues in this field and suggest new directions for future study.
  arXiv  Detail & Related papers  (2023-01-01T12:39:57Z)
• StyleGAN-Human: A Data-Centric Odyssey of Human Generation [96.7080874757475]
  This work takes a data-centric perspective and investigates multiple critical aspects in "data engineering" We collect and annotate a large-scale human image dataset with over 230K samples capturing diverse poses and textures. We rigorously investigate three essential factors in data engineering for StyleGAN-based human generation, namely data size, data distribution, and data alignment.
  arXiv  Detail & Related papers  (2022-04-25T17:55:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.