Rate-Distortion-Perception Theory for Semantic Communication
- URL: http://arxiv.org/abs/2312.05437v1
- Date: Sat, 9 Dec 2023 02:04:32 GMT
- Title: Rate-Distortion-Perception Theory for Semantic Communication
- Authors: Jingxuan Chai, Yong Xiao, Guangming Shi, and Walid Saad
- Abstract summary: We study the achievable data rate of semantic communication under the symbol distortion and semantic perception constraints.
We observe that there exists cases that the receiver can directly infer the semantic information source satisfying certain distortion and perception constraints.
- Score: 73.04341519955223
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Semantic communication has attracted significant interest recently due to its
capability to meet the fast growing demand on user-defined and human-oriented
communication services such as holographic communications, eXtended reality
(XR), and human-to-machine interactions. Unfortunately, recent study suggests
that the traditional Shannon information theory, focusing mainly on delivering
semantic-agnostic symbols, will not be sufficient to investigate the
semantic-level perceptual quality of the recovered messages at the receiver. In
this paper, we study the achievable data rate of semantic communication under
the symbol distortion and semantic perception constraints. Motivated by the
fact that the semantic information generally involves rich intrinsic knowledge
that cannot always be directly observed by the encoder, we consider a semantic
information source that can only be indirectly sensed by the encoder. Both
encoder and decoder can access to various types of side information that may be
closely related to the user's communication preference. We derive the
achievable region that characterizes the tradeoff among the data rate, symbol
distortion, and semantic perception, which is then theoretically proved to be
achievable by a stochastic coding scheme. We derive a closed-form achievable
rate for binary semantic information source under any given distortion and
perception constraints. We observe that there exists cases that the receiver
can directly infer the semantic information source satisfying certain
distortion and perception constraints without requiring any data communication
from the transmitter. Experimental results based on the image semantic source
signal have been presented to verify our theoretical observations.
Related papers
- Reasoning with the Theory of Mind for Pragmatic Semantic Communication [62.87895431431273]
A pragmatic semantic communication framework is proposed in this paper.
It enables effective goal-oriented information sharing between two-intelligent agents.
Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits.
arXiv Detail & Related papers (2023-11-30T03:36:19Z) - Reasoning over the Air: A Reasoning-based Implicit Semantic-Aware
Communication Framework [124.6509194665514]
A novel implicit semantic-aware communication (iSAC) architecture is proposed for representing, communicating, and interpreting the implicit semantic meaning between source and destination users.
A projection-based semantic encoder is proposed to convert the high-dimensional graphical representation of explicit semantics into a low-dimensional semantic constellation space for efficient physical channel transmission.
A generative adversarial imitation learning-based solution, called G-RML, is proposed to enable the destination user to learn and imitate the implicit semantic reasoning process of source user.
arXiv Detail & Related papers (2023-06-20T01:32:27Z) - Semantic Communication of Learnable Concepts [16.373044313375782]
We consider the problem of communicating a sequence of concepts, i.e., unknown and potentially maps, which can be observed only through examples.
The transmitter applies a learning algorithm to the available examples, and extracts knowledge from the data.
The transmitter then needs to communicate the learned models to a remote receiver through a rate-limited channel.
arXiv Detail & Related papers (2023-05-14T11:16:17Z) - Cognitive Semantic Communication Systems Driven by Knowledge Graph:
Principle, Implementation, and Performance Evaluation [74.38561925376996]
Two cognitive semantic communication frameworks are proposed for the single-user and multiple-user communication scenarios.
An effective semantic correction algorithm is proposed by mining the inference rule from the knowledge graph.
For the multi-user cognitive semantic communication system, a message recovery algorithm is proposed to distinguish messages of different users.
arXiv Detail & Related papers (2023-03-15T12:01:43Z) - Knowledge Enhanced Semantic Communication Receiver [7.171974845607281]
We propose a knowledge enhanced semantic communication framework in which the receiver can more actively utilize the facts in the knowledge base for semantic reasoning and decoding.
Specifically, we design a transformer-based knowledge extractor to find relevant factual triples for the received noisy signal.
Extensive simulation results on the WebNLG dataset demonstrate that the proposed receiver yields superior performance on top of the knowledge graph enhanced decoding.
arXiv Detail & Related papers (2023-02-13T01:49:51Z) - Adversarial Learning for Implicit Semantic-Aware Communications [104.08383219177557]
We develop a novel adversarial learning-based implicit semantic-aware communication architecture (iSAC)
We prove that by applying iSAC, the destination user can always learn an inference rule that matches the true inference rule of the source messages.
Experimental results show that the proposed iSAC can offer up to a 19.69 dB improvement over existing non-inferential communication solutions.
arXiv Detail & Related papers (2023-01-27T08:28:12Z) - Semantic-Native Communication: A Simplicial Complex Perspective [50.099494681671224]
We study semantic communication from a topological space perspective.
A transmitter first maps its data into a $k$-order simplicial complex and then learns its high-order correlations.
The receiver decodes the structure and infers the missing or distorted data.
arXiv Detail & Related papers (2022-10-30T22:33:44Z) - Cognitive Semantic Communication Systems Driven by Knowledge Graph [33.29303908864777]
A cognitive semantic communication framework is proposed by exploiting knowledge graph.
A simple, general and interpretable solution for semantic information detection is developed.
Our proposed system is superior to other benchmark systems in terms of the data compression rate and the reliability of communication.
arXiv Detail & Related papers (2022-02-24T08:26:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.