WOC: A Handy Webcam-based 3D Online Chatroom
- URL: http://arxiv.org/abs/2209.00776v1
- Date: Fri, 2 Sep 2022 01:34:14 GMT
- Title: WOC: A Handy Webcam-based 3D Online Chatroom
- Authors: Chuanhang Yan, Yu Sun, Qian Bao, Jinhui Pang, Wu Liu, Tao Mei
- Abstract summary: WOC is a webcam-based 3D virtual online chatroom for multi-person interaction.
It captures the 3D motion of users and drives their individual 3D virtual avatars in real-time.
- Score: 62.43306257598143
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We develop WOC, a webcam-based 3D virtual online chatroom for multi-person
interaction, which captures the 3D motion of users and drives their individual
3D virtual avatars in real-time. Compared to the existing wearable
equipment-based solution, WOC offers convenient and low-cost 3D motion capture
with a single camera. To promote the immersive chat experience, WOC provides
high-fidelity virtual avatar manipulation, which also supports the user-defined
characters. With the distributed data flow service, the system delivers highly
synchronized motion and voice for all users. Deployed on the website and no
installation required, users can freely experience the virtual online chat at
https://yanch.cloud.
Related papers
- POSE: Pose estimation Of virtual Sync Exhibit system [0.0]
The motivation is that we find it inconvenient to use joysticks and sensors when playing with fitness rings.
In order to replace joysticks and reduce costs, we developed a platform that can control virtual avatars through pose estimation to identify the movements of real people.
arXiv Detail & Related papers (2024-10-20T09:34:15Z) - AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning [9.989693906734535]
AVIN-Chat allows users to have face-to-face conversations with 3D avatars in real-time.
The proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state.
arXiv Detail & Related papers (2024-08-15T22:45:53Z) - EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams [59.77837807004765]
This paper introduces a new problem, i.e., 3D human motion capture from an egocentric monocular event camera with a fisheye lens.
Event streams have high temporal resolution and provide reliable cues for 3D human motion capture under high-speed human motions and rapidly changing illumination.
Our EE3D demonstrates robustness and superior 3D accuracy compared to existing solutions while supporting real-time 3D pose update rates of 140Hz.
arXiv Detail & Related papers (2024-04-12T17:59:47Z) - Memory-based Adapters for Online 3D Scene Perception [71.71645534899905]
Conventional 3D scene perception methods are offline, i.e., take an already reconstructed 3D scene geometry as input.
We propose an adapter-based plug-and-play module for the backbone of 3D scene perception model.
Our adapters can be easily inserted into mainstream offline architectures of different tasks and significantly boost their performance on online tasks.
arXiv Detail & Related papers (2024-03-11T17:57:41Z) - Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis [88.17520303867099]
One-shot 3D talking portrait generation aims to reconstruct a 3D avatar from an unseen image, and then animate it with a reference video or audio.
We present Real3D-Potrait, a framework that improves the one-shot 3D reconstruction power with a large image-to-plane model.
Experiments show that Real3D-Portrait generalizes well to unseen identities and generates more realistic talking portrait videos.
arXiv Detail & Related papers (2024-01-16T17:04:30Z) - Virtual Avatar Stream: a cost-down approach to the Metaverse experience [0.0]
This project aims to provide an accessible entry point to the immersive Metaverse experience by leveraging web technologies.
The platform developed allows users to engage with rendered avatars using only a web browser, microphone, and webcam.
arXiv Detail & Related papers (2023-04-04T01:34:23Z) - VirtualCube: An Immersive 3D Video Communication System [22.603545138780287]
The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies.
The key ingredient is VirtualCube, an abstract representation of a real-world cubicle instrumented with RGBD cameras for capturing the 3D geometry and texture of a user.
arXiv Detail & Related papers (2021-12-13T15:34:08Z) - Human POSEitioning System (HPS): 3D Human Pose Estimation and
Self-localization in Large Scenes from Body-Mounted Sensors [71.29186299435423]
We introduce (HPS) Human POSEitioning System, a method to recover the full 3D pose of a human registered with a 3D scan of the surrounding environment.
We show that our optimization-based integration exploits the benefits of the two, resulting in pose accuracy free of drift.
HPS could be used for VR/AR applications where humans interact with the scene without requiring direct line of sight with an external camera.
arXiv Detail & Related papers (2021-03-31T17:58:31Z) - Unmasking Communication Partners: A Low-Cost AI Solution for Digitally
Removing Head-Mounted Displays in VR-Based Telepresence [62.997667081978825]
Face-to-face conversation in Virtual Reality (VR) is a challenge when participants wear head-mounted displays (HMD)
Past research has shown that high-fidelity face reconstruction with personal avatars in VR is possible under laboratory conditions with high-cost hardware.
We propose one of the first low-cost systems for this task which uses only open source, free software and affordable hardware.
arXiv Detail & Related papers (2020-11-06T23:17:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.