Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming

• URL: http://arxiv.org/abs/2506.10004v1
• Date: Thu, 27 Mar 2025 15:28:53 GMT
• Title: Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming
• Authors: Haopeng Wang, Haiwei Dong, Abdulmotaleb El Saddik,
• Abstract summary: Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption.<n>This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms.
• Score: 4.217982035156334
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.

Related papers

• Evaluating Social Acceptance of eXtended Reality (XR) Agent Technology: A User Study (Extended Version) [37.69303106863453]
  We present the findings of a user study that evaluated the social acceptance of eXtended Reality (XR) agent technology.<n>This system involves user interaction with a virtual avatar, enabled by a modular toolkit.
  arXiv  Detail & Related papers  (2025-07-22T13:14:05Z)
• Recent Advances and Future Directions in Extended Reality (XR): Exploring AI-Powered Spatial Intelligence [0.0]
  Extended Reality (XR), encompassing Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR), is a transformative technology bridging the physical and virtual world.<n>This review examines XR's evolution through foundational framework - hardware ranging from monitors to sensors and software ranging from visual tasks to user interface.<n>For future directions, attention should be given to the integration of multi-modal AI and IoT-driven digital twins to enable adaptive XR systems.
  arXiv  Detail & Related papers  (2025-04-22T15:11:55Z)
• Explainable XR: Understanding User Behaviors of XR Environments using LLM-assisted Analytics Framework [24.02808692450192]
  We present Explainable XR, an end-to-end framework for analyzing user behavior in diverse XR environments.<n> Explainable XR addresses challenges in handling cross-virtuality - AR, VR, MR - transitions, multi-user collaborative application scenarios.
  arXiv  Detail & Related papers  (2025-01-23T15:55:07Z)
• XRZoo: A Large-Scale and Versatile Dataset of Extended Reality (XR) Applications [36.285311508797825]
  XRZoo contains 12,528 free XR applications, spanning nine app stores, across all XR techniques (i.e., AR, MR, and VR) and use cases.<n>We aim to foster reproducible XR software engineering and security research, enable cross-disciplinary investigations, and also support the development of advanced XR systems.
  arXiv  Detail & Related papers  (2024-12-09T18:49:27Z)
• Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learning [5.476136494434766]
  We propose CXRL, a framework motivated by the potential of reinforcement learning (RL) Our framework includes jointly optimizing learnable adaptive condition embeddings (ACE) and the image generator. Our CXRL generates pathologically realistic CXRs, establishing a new standard for generating CXRs.
  arXiv  Detail & Related papers  (2024-03-11T08:43:57Z)
• AV-RIR: Audio-Visual Room Impulse Response Estimation [49.469389715876915]
  Accurate estimation of Room Impulse Response (RIR) is important for speech processing and AR/VR applications. We propose AV-RIR, a novel multi-modal multi-task learning approach to accurately estimate the RIR from a given reverberant speech signal and visual cues of its corresponding environment.
  arXiv  Detail & Related papers  (2023-11-30T22:58:30Z)
• Joint Sensing, Communication, and AI: A Trifecta for Resilient THz User Experiences [118.91584633024907]
  A novel joint sensing, communication, and artificial intelligence (AI) framework is proposed so as to optimize extended reality (XR) experiences over terahertz (THz) wireless systems.
  arXiv  Detail & Related papers  (2023-04-29T00:39:50Z)
• Masked Transformer for Neighhourhood-aware Click-Through Rate Prediction [74.52904110197004]
  We propose Neighbor-Interaction based CTR prediction, which put this task into a Heterogeneous Information Network (HIN) setting. In order to enhance the representation of the local neighbourhood, we consider four types of topological interaction among the nodes. We conduct comprehensive experiments on two real world datasets and the experimental results show that our proposed method outperforms state-of-the-art CTR models significantly.
  arXiv  Detail & Related papers  (2022-01-25T12:44:23Z)
• Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets Deep Reinforcement Learning [76.46530937296066]
  This paper investigates the problem of providing ultra-reliable and energy-efficient virtual reality (VR) experiences for wireless mobile users. To ensure reliable ultra-high-definition (UHD) video frame delivery to mobile users, a coordinated multipoint (CoMP) transmission technique and millimeter wave (mmWave) communications are exploited.
  arXiv  Detail & Related papers  (2021-06-03T08:35:10Z)
• BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond [75.62146968824682]
  Video super-resolution (VSR) approaches tend to have more components than the image counterparts. We show a succinct pipeline, BasicVSR, that achieves appealing improvements in terms of speed and restoration quality.
  arXiv  Detail & Related papers  (2020-12-03T18:56:14Z)
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data [69.37597254841052]
  We propose a novel cross-modal deep-learning framework called X-ModalNet. X-ModalNet generalizes well, owing to propagating labels on an updatable graph constructed by high-level features on the top of the network. We evaluate X-ModalNet on two multi-modal remote sensing datasets (HSI-MSI and HSI-SAR) and achieve a significant improvement in comparison with several state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-06-24T15:29:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.