Virtual Reality in Metaverse over Wireless Networks with User-centered Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2303.04349v1
• Date: Wed, 8 Mar 2023 03:10:41 GMT
• Title: Virtual Reality in Metaverse over Wireless Networks with User-centered Deep Reinforcement Learning
• Authors: Wenhan Yu, Terence Jie Chua, Jun Zhao
• Abstract summary: We introduce a multi-user VR computation offloading over wireless communication scenario. In addition, we devised a novel user-centered deep reinforcement learning approach to find a near-optimal solution.
• Score: 8.513938423514636
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The Metaverse and its promises are fast becoming reality as maturing technologies are empowering the different facets. One of the highlights of the Metaverse is that it offers the possibility for highly immersive and interactive socialization. Virtual reality (VR) technologies are the backbone for the virtual universe within the Metaverse as they enable a hyper-realistic and immersive experience, and especially so in the context of socialization. As the virtual world 3D scenes to be rendered are of high resolution and frame rate, these scenes will be offloaded to an edge server for computation. Besides, the metaverse is user-center by design, and human users are always the core. In this work, we introduce a multi-user VR computation offloading over wireless communication scenario. In addition, we devised a novel user-centered deep reinforcement learning approach to find a near-optimal solution. Extensive experiments demonstrate that our approach can lead to remarkable results under various requirements and constraints.

Related papers

• V-IRL: Grounding Virtual Intelligence in Real Life [65.87750250364411]
  V-IRL is a platform that enables agents to interact with the real world in a virtual yet realistic environment. Our platform serves as a playground for developing agents that can accomplish various practical tasks.
  arXiv  Detail & Related papers  (2024-02-05T18:59:36Z)
• VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality [39.53150683721031]
  Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction. The components of our Virtual Reality system are designed for high efficiency and effectiveness.
  arXiv  Detail & Related papers  (2024-01-30T01:28:36Z)
• Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach [10.47302625959368]
  An interactive and immersive socialization experience is one of the promises of the Metaverse. The computation required for a smooth, seamless and immersive socialization experience in the Metaverse is overbearing. This paper introduces a novel Quality-of-Service (QoS) model for the accumulated experience in multi-user socialization on a multichannel wireless network.
  arXiv  Detail & Related papers  (2023-12-11T10:49:47Z)
• Metaverse: A Vision, Architectural Elements, and Future Directions for Scalable and Realtime Virtual Worlds [24.381786472997355]
  The Metaverse has the prospective to extend the physical world using virtual and augmented reality. It has the potential to impact people in the way they interact on social media, collaborate in their work, perform marketing and business, teach, learn, and even access personalized healthcare. This paper presents the temporal evolution of Metaverse definitions and captures its evolving requirements.
  arXiv  Detail & Related papers  (2023-08-21T08:23:10Z)
• Beyond Reality: The Pivotal Role of Generative AI in the Metaverse [98.1561456565877]
  This paper offers a comprehensive exploration of how generative AI technologies are shaping the Metaverse. We delve into the applications of text generation models like ChatGPT and GPT-3, which are enhancing conversational interfaces with AI-generated characters. We also examine the potential of 3D model generation technologies like Point-E and Lumirithmic in creating realistic virtual objects.
  arXiv  Detail & Related papers  (2023-07-28T05:44:20Z)
• Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear [65.33183123368804]
  Sonicverse is a multisensory simulation platform with integrated audio-visual simulation. It enables embodied AI tasks that need audio-visual perception. An agent trained in Sonicverse can successfully perform audio-visual navigation in real-world environments.
  arXiv  Detail & Related papers  (2023-06-01T17:24:01Z)
• User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks [8.513938423514636]
  In this paper, we consider a system consisting of a Metaverse server and multiple VR users. In our multi-user VR scenario for the Metaverse, users have different characteristics and demands for Frames Per Second (FPS) Our proposed user-centric DRL algorithm is called User-centric Critic with Heterogenous Actors (UCHA)
  arXiv  Detail & Related papers  (2023-02-03T00:12:12Z)
• Force-Aware Interface via Electromyography for Natural VR/AR Interaction [69.1332992637271]
  We design a learning-based neural interface for natural and intuitive force inputs in VR/AR. We show that our interface can decode finger-wise forces in real-time with 3.3% mean error, and generalize to new users with little calibration. We envision our findings to push forward research towards more realistic physicality in future VR/AR.
  arXiv  Detail & Related papers  (2022-10-03T20:51:25Z)
• A Full Dive into Realizing the Edge-enabled Metaverse: Visions, Enabling Technologies,and Challenges [93.06849621984684]
  "The successor to the mobile Internet", the Metaverse has grown in popularity. lite versions of the Metaverse exist today, but they are far from realizing the full vision of an immersive, embodied, and interoperable Metaverse. Without addressing the issues of implementation from the communication and networking, the Metaverse is difficult to succeed the Internet. We discuss the computation challenges and cloud-edge-end computation framework-driven solutions to realize the Metaverse on resource-constrained edge devices.
  arXiv  Detail & Related papers  (2022-03-10T16:48:51Z)
• Artificial Intelligence for the Metaverse: A Survey [66.57225253532748]
  We first deliver a preliminary of AI, including machine learning algorithms and deep learning architectures, and its role in the metaverse. We then convey a comprehensive investigation of AI-based methods concerning six technical aspects that have potentials for the metaverse. Several AI-aided applications, such as healthcare, manufacturing, smart cities, and gaming, are studied to be deployed in the virtual worlds.
  arXiv  Detail & Related papers  (2022-02-15T03:34:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.