A Survey on Applications of Digital Human Avatars toward Virtual Co-presence

• URL: http://arxiv.org/abs/2201.04168v1
• Date: Tue, 11 Jan 2022 19:38:44 GMT
• Title: A Survey on Applications of Digital Human Avatars toward Virtual Co-presence
• Authors: Matthew Korban, Xin Li
• Abstract summary: We evaluate the evolution of technologies for creating Virtual Co-presence environments. We compare various groups and strategies based on their applications, contributions, and limitations.
• Score: 8.528174019990352
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper investigates different approaches to build and use digital human avatars toward interactive Virtual Co-presence (VCP) environments. We evaluate the evolution of technologies for creating VCP environments and how the advancement in Artificial Intelligence (AI) and Computer Graphics affect the quality of VCP environments. We categorize different methods in the literature based on their applications and methodology and compare various groups and strategies based on their applications, contributions, and limitations. We also have a brief discussion about the approaches that other forms of human representation, rather than digital human avatars, have been utilized in VCP environments. Our goal is to fill the gap in the research domain where there is a lack of literature review investigating different approaches for creating avatar-based VCP environments. We hope this study will be useful for future research involving human representation in VCP or Virtual Reality (VR) environments. To the best of our knowledge, it is the first survey research that investigates avatar-based VCP environments. Specifically, the categorization methodology suggested in this paper for avatar-based methods is new.

Related papers

• Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving [7.588679613436823]
  We present a first and innovative approach to evaluating what we term the behavioural gap, a concept that captures the disparity in a participant's conduct when engaging in a VR experiment compared to an equivalent real-world situation. In the experiment, the pedestrian attempts to cross the road in the presence of different driving styles and an external Human-Machine Interface (eHMI) Results show that participants are more cautious and curious in VR, affecting their speed and decisions, and that VR interfaces significantly influence their actions.
  arXiv  Detail & Related papers  (2024-07-04T17:20:17Z)
• On the Emergence of Symmetrical Reality [51.21203247240322]
  We introduce the symmetrical reality framework, which offers a unified representation encompassing various forms of physical-virtual amalgamations. We propose an instance of an AI-driven active assistance service that illustrates the potential applications of symmetrical reality.
  arXiv  Detail & Related papers  (2024-01-26T16:09:39Z)
• Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models [59.611697856666304]
  Human-object interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. We propose three prompts with VLM to generate human-centric visual cues within an image from multiple perspectives of humans. We develop a transformer-based multimodal fusion module with multitower architecture to integrate visual cue features into the instance and interaction decoders.
  arXiv  Detail & Related papers  (2023-11-26T09:11:32Z)
• Semantic-Preserved Point-based Human Avatar [15.017308063001366]
  We present the first point-based human avatar model that embodies the entirety of digital humans. We propose a novel method to transfer semantic information from the SMPL-X model to the points, which enables to better understand human body movements.
  arXiv  Detail & Related papers  (2023-11-20T08:56:51Z)
• A No-Reference Quality Assessment Method for Digital Human Head [56.17852258306602]
  We develop a novel no-reference (NR) method based on Transformer to deal with digital human quality assessment (DHQA) Specifically, the front 2D projections of the digital humans are rendered as inputs and the vision transformer (ViT) is employed for the feature extraction. Then we design a multi-task module to jointly classify the distortion types and predict the perceptual quality levels of digital humans.
  arXiv  Detail & Related papers  (2023-10-25T16:01:05Z)
• Inclusion in Virtual Reality Technology: A Scoping Review [0.3626013617212666]
  We provide a scoping analysis of existing virtual reality research literature about inclusion. We categorize the literature based on target group into ability, gender, and age, followed by those that study community-based design of VR experiences. In the latter group, we focus mainly on Indigenous Peoples as a clearer and more important example.
  arXiv  Detail & Related papers  (2023-10-23T18:55:48Z)
• Sonic Interactions in Virtual Environments: the Egocentric Audio Perspective of the Digital Twin [6.639956135839834]
  This chapter aims to transform studies related to sonic interactions in virtual environments into a research field equipped with the egocentric perspective of the auditory digital twin. The guardian of such locus of agency is the auditory digital twin that fosters intra-actions between humans and technology.
  arXiv  Detail & Related papers  (2022-04-21T07:18:16Z)
• A survey on applications of augmented, mixed and virtual reality for nature and environment [114.4879749449579]
  Augmented reality (AR), virtual reality (VR) and mixed reality (MR) are technologies of great potential due to the engaging and enriching experiences they are capable of providing. However, the possibilities that AR, VR and MR offer in the area of environmental applications are not yet widely explored. We present the outcome of a survey meant to discover and classify existing AR/VR/MR applications that can benefit the environment or increase awareness on environmental issues.
  arXiv  Detail & Related papers  (2020-08-27T09:59:27Z)
• RoboTHOR: An Open Simulation-to-Real Embodied AI Platform [56.50243383294621]
  We introduce RoboTHOR to democratize research in interactive and embodied visual AI. We show there exists a significant gap between the performance of models trained in simulation when they are tested in both simulations and their carefully constructed physical analogs.
  arXiv  Detail & Related papers  (2020-04-14T20:52:49Z)
• An Exploration of Embodied Visual Exploration [97.21890864063872]
  Embodied computer vision considers perception for robots in novel, unstructured environments. We present a taxonomy for existing visual exploration algorithms and create a standard framework for benchmarking them. We then perform a thorough empirical study of the four state-of-the-art paradigms using the proposed framework.
  arXiv  Detail & Related papers  (2020-01-07T17:40:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.