Maximizing the Promptness of Metaverse Systems using Edge Computing by Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2506.02657v1
• Date: Tue, 03 Jun 2025 09:10:31 GMT
• Title: Maximizing the Promptness of Metaverse Systems using Edge Computing by Deep Reinforcement Learning
• Authors: Tam Ninh Thi-Thanh, Trinh Van Chien, Hung Tran, Nguyen Hoai Son, Van Nhan Vo,
• Abstract summary: This paper introduces the advantages of deep reinforcement learning (DRL) in assisting Metaverse system-based Digital Twin.<n>In this system, we assume that it includes several Metaverse User devices collecting data from the real world to transfer it into the virtual world.<n>Our proposed DRL algorithm is suitable for offloading tasks to ensure the promptness of DT in a dynamic environment.
• Score: 7.405872670079697
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Metaverse and Digital Twin (DT) have attracted much academic and industrial attraction to approach the future digital world. This paper introduces the advantages of deep reinforcement learning (DRL) in assisting Metaverse system-based Digital Twin. In this system, we assume that it includes several Metaverse User devices collecting data from the real world to transfer it into the virtual world, a Metaverse Virtual Access Point (MVAP) undertaking the processing of data, and an edge computing server that receives the offloading data from the MVAP. The proposed model works under a dynamic environment with various parameters changing over time. The experiment results show that our proposed DRL algorithm is suitable for offloading tasks to ensure the promptness of DT in a dynamic environment.

Related papers

• Scalable Offline Reinforcement Learning for Mean Field Games [6.8267158622784745]
  Off-MMD is a novel mean-field RL algorithm that approximates equilibrium policies in mean-field games using purely offline data. Our algorithm scales to complex environments and demonstrates strong performance on benchmark tasks like crowd exploration or navigation.
  arXiv  Detail & Related papers  (2024-10-23T14:16:34Z)
• Constructing and Evaluating Digital Twins: An Intelligent Framework for DT Development [11.40908718824589]
  Development of Digital Twins (DTs) represents a transformative advance for simulating and optimizing complex systems in a controlled digital space. This paper introduces an intelligent framework for the construction and evaluation of DTs, specifically designed to enhance the accuracy and utility of DTs in testing algorithmic performance. We propose a novel construction methodology that integrates deep learning-based policy gradient techniques to dynamically tune the DT parameters, ensuring high fidelity in the digital replication of physical systems.
  arXiv  Detail & Related papers  (2024-06-19T01:45:18Z)
• MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild [81.32127423981426]
  Multimodal emotion recognition based on audio and video data is important for real-world applications. Recent methods have focused on exploiting advances of self-supervised learning (SSL) for pre-training of strong multimodal encoders. We propose a different perspective on the problem and investigate the advancement of multimodal DFER performance by adapting SSL-pre-trained disjoint unimodal encoders.
  arXiv  Detail & Related papers  (2024-04-13T13:39:26Z)
• Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing [46.65030115953947]
  We propose a framework consisting of a digital twin and reinforcement learning agents. Specifically, we propose to use the historical data and the neural networks to build a digital twin model to simulate the state variation law of the real environment. We also extend the framework to offline reinforcement learning, where solutions can be used to obtain intelligent decisions based solely on historical data.
  arXiv  Detail & Related papers  (2023-11-28T15:25:14Z)
• Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset [5.424654352786403]
  6DoF pose estimation with mobile devices is the foundation for applications in robotics, augmented reality, and digital twin localization. We present a transformer-based 6DoF pose estimation approach called DTTDNet, featuring a novel geometric feature filtering module and a Chamfer distance loss for training. Our approach exhibits superior robustness to varying levels of measurement noise, setting a new benchmark for the robustness to noise measurements.
  arXiv  Detail & Related papers  (2023-09-24T07:06:45Z)
• Efficient Task Offloading Algorithm for Digital Twin in Edge/Cloud Computing Environment [14.14935102383516]
  Digital Twin (DT) is envisioned to empower various areas as a bridge between physical objects and the digital world. Mobile Cloud Computing (MCC) and Mobile Edge Computing (MEC) have become two of the key factors to achieve real-time feedback. We propose a new DT system model considering a heterogeneous MEC/MCC environment.
  arXiv  Detail & Related papers  (2023-07-12T03:31:34Z)
• Training Deep Surrogate Models with Large Scale Online Learning [48.7576911714538]
  Deep learning algorithms have emerged as a viable alternative for obtaining fast solutions for PDEs. Models are usually trained on synthetic data generated by solvers, stored on disk and read back for training. It proposes an open source online training framework for deep surrogate models.
  arXiv  Detail & Related papers  (2023-06-28T12:02:27Z)
• Model-Based Reinforcement Learning with Multi-Task Offline Pretraining [59.82457030180094]
  We present a model-based RL method that learns to transfer potentially useful dynamics and action demonstrations from offline data to a novel task. The main idea is to use the world models not only as simulators for behavior learning but also as tools to measure the task relevance. We demonstrate the advantages of our approach compared with the state-of-the-art methods in Meta-World and DeepMind Control Suite.
  arXiv  Detail & Related papers  (2023-06-06T02:24:41Z)
• Towards Scale Consistent Monocular Visual Odometry by Learning from the Virtual World [83.36195426897768]
  We propose VRVO, a novel framework for retrieving the absolute scale from virtual data. We first train a scale-aware disparity network using both monocular real images and stereo virtual data. The resulting scale-consistent disparities are then integrated with a direct VO system.
  arXiv  Detail & Related papers  (2022-03-11T01:51:54Z)
• Dynamic Network-Assisted D2D-Aided Coded Distributed Learning [59.29409589861241]
  We propose a novel device-to-device (D2D)-aided coded federated learning method (D2D-CFL) for load balancing across devices. We derive an optimal compression rate for achieving minimum processing time and establish its connection with the convergence time. Our proposed method is beneficial for real-time collaborative applications, where the users continuously generate training data.
  arXiv  Detail & Related papers  (2021-11-26T18:44:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.