Virtual Avatar Stream: a cost-down approach to the Metaverse experience
- URL: http://arxiv.org/abs/2304.01443v1
- Date: Tue, 4 Apr 2023 01:34:23 GMT
- Title: Virtual Avatar Stream: a cost-down approach to the Metaverse experience
- Authors: Joseph Chang
- Abstract summary: This project aims to provide an accessible entry point to the immersive Metaverse experience by leveraging web technologies.
The platform developed allows users to engage with rendered avatars using only a web browser, microphone, and webcam.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The Metaverse through VR headsets is a rapidly growing concept, but the high
cost of entry currently limits access for many users. This project aims to
provide an accessible entry point to the immersive Metaverse experience by
leveraging web technologies. The platform developed allows users to engage with
rendered avatars using only a web browser, microphone, and webcam. By employing
the WebGL and MediaPipe face tracking AI model from Google, the application
generates real-time 3D face meshes for users. It uses a client-to-client
streaming cluster to establish a connection, and clients negotiate SRTP
protocol through WebRTC for direct data streaming. Additionally, the project
addresses backend challenges through an architecture that is serverless,
distributive, auto-scaling, highly resilient, and secure. The platform offers a
scalable, hardware-free solution for users to experience a near-immersive
Metaverse, with the potential for future integration with game server clusters.
This project provides an important step toward a more inclusive Metaverse
accessible to a wider audience.
Related papers
- An Open, Cross-Platform, Web-Based Metaverse Using WebXR and A-Frame [0.0]
This work proposes a WebXR-based cross-platform architecture for developing spatial web apps.
It lives up to Tim Berners-Lee's vision of the World Wide Web as an open platform that transcends geographical and technical boundaries.
arXiv Detail & Related papers (2024-08-24T08:47:09Z) - Vision-based Semantic Communications for Metaverse Services: A Contest
Theoretic Approach [66.10465001046762]
In Metaverse, avatars must be updated and rendered to reflect users' behaviour.
We propose a semantic communication framework to model the interactions between users and MSPs.
We use the semantic communication technique to reduce the amount of data to be transmitted.
arXiv Detail & Related papers (2023-08-15T07:56:33Z) - Virtual Reality in Metaverse over Wireless Networks with User-centered
Deep Reinforcement Learning [8.513938423514636]
We introduce a multi-user VR computation offloading over wireless communication scenario.
In addition, we devised a novel user-centered deep reinforcement learning approach to find a near-optimal solution.
arXiv Detail & Related papers (2023-03-08T03:10:41Z) - User-centric Heterogeneous-action Deep Reinforcement Learning for
Virtual Reality in the Metaverse over Wireless Networks [8.513938423514636]
In this paper, we consider a system consisting of a Metaverse server and multiple VR users.
In our multi-user VR scenario for the Metaverse, users have different characteristics and demands for Frames Per Second (FPS)
Our proposed user-centric DRL algorithm is called User-centric Critic with Heterogenous Actors (UCHA)
arXiv Detail & Related papers (2023-02-03T00:12:12Z) - WOC: A Handy Webcam-based 3D Online Chatroom [62.43306257598143]
WOC is a webcam-based 3D virtual online chatroom for multi-person interaction.
It captures the 3D motion of users and drives their individual 3D virtual avatars in real-time.
arXiv Detail & Related papers (2022-09-02T01:34:14Z) - A Full Dive into Realizing the Edge-enabled Metaverse: Visions, Enabling
Technologies,and Challenges [93.06849621984684]
"The successor to the mobile Internet", the Metaverse has grown in popularity.
lite versions of the Metaverse exist today, but they are far from realizing the full vision of an immersive, embodied, and interoperable Metaverse.
Without addressing the issues of implementation from the communication and networking, the Metaverse is difficult to succeed the Internet.
We discuss the computation challenges and cloud-edge-end computation framework-driven solutions to realize the Metaverse on resource-constrained edge devices.
arXiv Detail & Related papers (2022-03-10T16:48:51Z) - A Multi-user Oriented Live Free-viewpoint Video Streaming System Based
On View Interpolation [15.575219833681635]
We introduce a CNN-based view algorithm to synthesis dense virtual views in real time.
We also build an end-to-end live free-viewpoint system with a multi-user oriented streaming strategy.
arXiv Detail & Related papers (2021-12-20T15:17:57Z) - Wireless Edge-Empowered Metaverse: A Learning-Based Incentive Mechanism
for Virtual Reality [102.4151387131726]
We propose a learning-based Incentive Mechanism framework for VR services in the Metaverse.
First, we propose the quality of perception as the metric for VR users in the virtual world.
Second, for quick trading of VR services between VR users (i.e., buyers) and VR SPs (i.e., sellers), we design a double Dutch auction mechanism.
Third, for auction communication reduction, we design a deep reinforcement learning-based auctioneer to accelerate this auction process.
arXiv Detail & Related papers (2021-11-07T13:02:52Z) - SoMin.ai: Personality-Driven Content Generation Platform [60.49416044866648]
We showcase the World's first personality-driven marketing content generation platform, called SoMin.ai.
The platform combines deep multi-view personality profiling framework and style generative adversarial networks.
It can be used for the enhancement of the social networking user experience as well as for content marketing routines.
arXiv Detail & Related papers (2020-11-30T08:33:39Z) - Unmasking Communication Partners: A Low-Cost AI Solution for Digitally
Removing Head-Mounted Displays in VR-Based Telepresence [62.997667081978825]
Face-to-face conversation in Virtual Reality (VR) is a challenge when participants wear head-mounted displays (HMD)
Past research has shown that high-fidelity face reconstruction with personal avatars in VR is possible under laboratory conditions with high-cost hardware.
We propose one of the first low-cost systems for this task which uses only open source, free software and affordable hardware.
arXiv Detail & Related papers (2020-11-06T23:17:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.