Generative AI for Immersive Communication: The Next Frontier in Internet-of-Senses Through 6G

• URL: http://arxiv.org/abs/2404.01713v2
• Date: Tue, 13 Aug 2024 12:58:13 GMT
• Title: Generative AI for Immersive Communication: The Next Frontier in Internet-of-Senses Through 6G
• Authors: Nassim Sehad, Lina Bariah, Wassim Hamidouche, Hamed Hellaoui, Riku Jäntti, Mérouane Debbah,
• Abstract summary: The Internet of Senses (IoS) seeks to provide multi-sensory experiences, acknowledging that in our physical reality, our perception extends far beyond just sight and sound. This article explores the existing technologies driving immersive multi-sensory media, delving into their capabilities and potential applications.
• Score: 37.09299562399439
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Over the past two decades, the Internet-of-Things (IoT) has become a transformative concept, and as we approach 2030, a new paradigm known as the Internet of Senses (IoS) is emerging. Unlike conventional Virtual Reality (VR), IoS seeks to provide multi-sensory experiences, acknowledging that in our physical reality, our perception extends far beyond just sight and sound; it encompasses a range of senses. This article explores the existing technologies driving immersive multi-sensory media, delving into their capabilities and potential applications. This exploration includes a comparative analysis between conventional immersive media streaming and a proposed use case that leverages semantic communication empowered by generative Artificial Intelligence (AI). The focal point of this analysis is the substantial reduction in bandwidth consumption by 99.93% in the proposed scheme. Through this comparison, we aim to underscore the practical applications of generative AI for immersive media. Concurrently addressing major challenges in this field, such as temporal synchronization of multiple media, ensuring high throughput, minimizing the End-to-End (E2E) latency, and robustness to low bandwidth while outlining future trajectories.

Related papers

• Artificial General Intelligence (AGI)-Native Wireless Systems: A Journey Beyond 6G [58.440115433585824]
  Building future wireless systems that support services like digital twins (DTs) is challenging to achieve through advances to conventional technologies like meta-surfaces. While artificial intelligence (AI)-native networks promise to overcome some limitations of wireless technologies, developments still rely on AI tools like neural networks. This paper revisits the concept of AI-native wireless systems, equipping them with the common sense necessary to transform them into artificial general intelligence (AGI)-native systems.
  arXiv  Detail & Related papers  (2024-04-29T04:51:05Z)
• Spatial Channel State Information Prediction with Generative AI: Towards Holographic Communication and Digital Radio Twin [23.09171064957228]
  6G promises to deliver faster and more reliable wireless connections via cutting-edge radio technologies. Traditional management methods are mainly reactive, usually based on feedback from users to adapt to the dynamic wireless channel. Advances in hardware and neural networks make it possible to predict such spatial-CSI using precise environmental information. We propose a new framework, digital radio twin, which takes advantages from both the digital world and deterministic control over radio waves.
  arXiv  Detail & Related papers  (2024-01-16T00:29:05Z)
• Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/s [53.91923493664551]
  This work introduces a hardware-accelerated integrated optoelectronic platform for multidimensional video understanding in real-time. The technology platform combines artificial intelligence hardware, processing information optically, with state-of-the-art machine vision networks. Such performance surpasses the speed of the closest technologies with similar spectral resolution by three to four orders of magnitude.
  arXiv  Detail & Related papers  (2023-12-17T07:51:38Z)
• Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach [10.47302625959368]
  An interactive and immersive socialization experience is one of the promises of the Metaverse. The computation required for a smooth, seamless and immersive socialization experience in the Metaverse is overbearing. This paper introduces a novel Quality-of-Service (QoS) model for the accumulated experience in multi-user socialization on a multichannel wireless network.
  arXiv  Detail & Related papers  (2023-12-11T10:49:47Z)
• Edge AI for Internet of Energy: Challenges and Perspectives [5.267662071764103]
  The digital landscape of the Internet of Energy (IoE) is on the brink of a revolutionary transformation with the integration of edge Artificial Intelligence (AI) This comprehensive review elucidates the promise and potential that edge AI holds for reshaping the IoE ecosystem.
  arXiv  Detail & Related papers  (2023-11-28T15:01:56Z)
• MultiIoT: Benchmarking Machine Learning for the Internet of Things [70.74131118309967]
  The next generation of machine learning systems must be adept at perceiving and interacting with the physical world. sensory data from motion, thermal, geolocation, depth, wireless signals, video, and audio are increasingly used to model the states of physical environments. Existing efforts are often specialized to a single sensory modality or prediction task. This paper proposes MultiIoT, the most expansive and unified IoT benchmark to date, encompassing over 1.15 million samples from 12 modalities and 8 real-world tasks.
  arXiv  Detail & Related papers  (2023-11-10T18:13:08Z)
• Task-Oriented Integrated Sensing, Computation and Communication for Wireless Edge AI [46.61358701676358]
  Edge artificial intelligence (AI) has been proposed to provide high-performance computation of a conventional cloud down to the network edge. Recently, convergence of wireless sensing, computation and communication (SC$2$) for specific edge AI tasks, has aroused paradigm shift. It is paramount importance to advance fully integrated sensing, computation and communication (I SCC) to achieve ultra-reliable and low-latency edge intelligence acquisition.
  arXiv  Detail & Related papers  (2023-06-11T06:40:51Z)
• The Internet of Senses: Building on Semantic Communications and Edge Intelligence [67.75406096878321]
  The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human receptors' We elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms may satisfy the requirements of IoS use cases.
  arXiv  Detail & Related papers  (2022-12-21T03:37:38Z)
• Artificial Intelligence for the Metaverse: A Survey [66.57225253532748]
  We first deliver a preliminary of AI, including machine learning algorithms and deep learning architectures, and its role in the metaverse. We then convey a comprehensive investigation of AI-based methods concerning six technical aspects that have potentials for the metaverse. Several AI-aided applications, such as healthcare, manufacturing, smart cities, and gaming, are studied to be deployed in the virtual worlds.
  arXiv  Detail & Related papers  (2022-02-15T03:34:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.