Generative Semantic Communications: Principles and Practices

• URL: http://arxiv.org/abs/2504.14947v1
• Date: Mon, 21 Apr 2025 08:10:59 GMT
• Title: Generative Semantic Communications: Principles and Practices
• Authors: Xiaojun Yuan, Haoming Ma, Yinuo Huang, Zhoufan Hua, Yong Zuo, Zhi Ding,
• Abstract summary: We propose a new paradigm for AGI-driven communications, called generative semantic communication (GSC)<n>We first describe the basic concept of GSC and its difference from existing semantic communications, followed by two case studies to verify the advantages of GSC in AGI-driven applications.
• Score: 28.767753294089825
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semantic communication leverages artificial intelligence (AI) technologies to extract semantic information from data for efficient transmission, theraby significantly reducing communication cost. With the evolution towards artificial general intelligence (AGI), the increasing demands for AGI services pose new challenges to semantic communication. In response, we propose a new paradigm for AGI-driven communications, called generative semantic communication (GSC), which utilizes advanced AI technologies such as foundation models and generative models. We first describe the basic concept of GSC and its difference from existing semantic communications, and then introduce a general framework of GSC, followed by two case studies to verify the advantages of GSC in AGI-driven applications. Finally, open challenges and new research directions are discussed to stimulate this line of research and pave the way for practical applications.

Related papers

• Toward Agentic AI: Generative Information Retrieval Inspired Intelligent Communications and Networking [87.82985288731489]
  Agentic AI has emerged as a key paradigm for intelligent communications and networking. This article emphasizes the role of knowledge acquisition, processing, and retrieval in agentic AI for telecom systems.
  arXiv  Detail & Related papers  (2025-02-24T06:02:25Z)
• Generative Semantic Communication: Architectures, Technologies, and Applications [36.67865904029129]
  This paper delves into the applications of generative artificial intelligence (GAI) in semantic communication (SemCom)<n>Three popular SemCom systems are first introduced, including variational autoencoders, generative adversarial networks, and diffusion models.<n>A novel generative SemCom system is proposed by incorporating the cutting-edge GAI technology-large language models (LLMs)
  arXiv  Detail & Related papers  (2024-12-11T18:59:50Z)
• Large Generative Model-assisted Talking-face Semantic Communication System [55.42631520122753]
  This study introduces a Large Generative Model-assisted Talking-face Semantic Communication (LGM-TSC) system. Generative Semantic Extractor (GSE) at the transmitter converts semantically sparse talking-face videos into texts with high information density. Private Knowledge Base (KB) based on the Large Language Model (LLM) for semantic disambiguation and correction. Generative Semantic Reconstructor (GSR) that utilizes BERT-VITS2 and SadTalker models to transform text back into a high-QoE talking-face video.
  arXiv  Detail & Related papers  (2024-11-06T12:45:46Z)
• Variational Source-Channel Coding for Semantic Communication [6.55201432222942]
  The current semantic communication systems are generally modeled as an Auto-Encoder (AE) AE lacks a deep integration of AI principles with communication strategies due to its inability to effectively capture channel dynamics. This paper explores the inclusion of data distortion distinguishes semantic communication from classical communication. A Variational Source-Channel Coding (VSCC) method is proposed for constructing semantic communication systems.
  arXiv  Detail & Related papers  (2024-09-26T03:42:05Z)
• Agent-driven Generative Semantic Communication with Cross-Modality and Prediction [57.335922373309074]
  We propose a novel agent-driven generative semantic communication framework based on reinforcement learning. In this work, we develop an agent-assisted semantic encoder with cross-modality capability, which can track the semantic changes, channel condition, to perform adaptive semantic extraction and sampling. The effectiveness of the designed models has been verified using the UA-DETRAC dataset, demonstrating the performance gains of the overall A-GSC framework.
  arXiv  Detail & Related papers  (2024-04-10T13:24:27Z)
• Generative AI for Physical Layer Communications: A Survey [76.61956357178295]
  generative artificial intelligence (GAI) has the potential to enhance the efficiency of digital content production. GAI's capability in analyzing complex data distributions offers great potential for wireless communications. This paper presents a comprehensive investigation of GAI's applications for communications at the physical layer, ranging from traditional issues, including signal classification, channel estimation, and equalization, to emerging topics, such as intelligent reflecting surfaces and joint source channel coding.
  arXiv  Detail & Related papers  (2023-12-09T15:20:56Z)
• Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts [89.04751776308656]
  This paper proposes a GAI-aided SemCom system with multi-model prompts for accurate content decoding. In response to security concerns, we introduce the application of covert communications aided by a friendly jammer.
  arXiv  Detail & Related papers  (2023-09-05T23:24:56Z)
• Enhancing Semantic Communication with Deep Generative Models -- An ICASSP Special Session Overview [25.314693624878053]
  This ICASSP special session overview paper discloses the semantic communication challenges from the machine learning perspective. It unveils how deep generative models will significantly enhance semantic communication frameworks. It charts novel research pathways for the next generative semantic communication frameworks.
  arXiv  Detail & Related papers  (2023-09-05T15:11:16Z)
• Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approach [74.25870052841226]
  A digital twin (DT) leverages a virtual representation of the physical world, along with communication (e.g., 6G), computing, and artificial intelligence (AI) technologies to enable many connected intelligence services. Wireless systems can exploit the paradigm of semantic communication (SC) for facilitating informed decision-making under strict communication constraints. A novel framework called causal semantic communication (CSC) is proposed for DT-based wireless systems.
  arXiv  Detail & Related papers  (2023-04-25T00:15:00Z)
• Accordion: A Communication-Aware Machine Learning Framework for Next Generation Networks [8.296411540693706]
  We advocate for the design of ad hoc artificial intelligence (AI)/machine learning (ML) models to facilitate their usage in future smart infrastructures based on communication networks. We present a novel communication-aware ML framework, which enables an efficient AI/ML model transfer thanks to an overhauled model training and communication protocol.
  arXiv  Detail & Related papers  (2023-01-12T10:30:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.