Reinforcement Learning-powered Semantic Communication via Semantic
Similarity
- URL: http://arxiv.org/abs/2108.12121v1
- Date: Fri, 27 Aug 2021 05:21:05 GMT
- Title: Reinforcement Learning-powered Semantic Communication via Semantic
Similarity
- Authors: Kun Lu, Rongpeng Li, Xianfu Chen, Zhifeng Zhao, Honggang Zhang
- Abstract summary: We introduce a new semantic communication mechanism, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision.
We show that the commonly used bit-level metrics are vulnerable of catching important semantic meaning and structures.
We put forward a reinforcement learning (RL)-based solution which allows us to simultaneously optimize any user-defined semantic measurement.
- Score: 13.569045590522316
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce a new semantic communication mechanism, whose key idea is to
preserve the semantic information instead of strictly securing the bit-level
precision. Starting by analyzing the defects of existing joint source channel
coding (JSCC) methods, we show that the commonly used bit-level metrics are
vulnerable of catching important semantic meaning and structures. To address
this problem, we take advantage of learning from semantic similarity, instead
of relying on conventional paired bit-level supervisions like cross entropy and
bit error rate. However, to develop such a semantic communication system is
indeed a nontrivial task, considering the nondifferentiability of most semantic
metrics as well as the instability from noisy channels. To further resolve
these issues, we put forward a reinforcement learning (RL)-based solution which
allows us to simultaneously optimize any user-defined semantic measurement by
using the policy gradient technique, and to interact with the surrounding noisy
environment in a natural way. We have testified the proposed method in the
challenging European-parliament dataset. Experiments on both AWGN and
phase-invariant fading channel have confirmed the superiority of our method in
revealing the semantic meanings, and better handling the channel noise
especially in low-SNR situations. Apart from the experimental results, we
further provide an indepth look at how the semantics model behaves, along with
its superb generalization ability in real-life examples. As a brand new method
in learning-based JSCC tasks, we also exemplify an RL-based image transmission
paradigm, both to prove the generalization ability, and to leave this new topic
for future discussion.
Related papers
- Latent Diffusion Model-Enabled Real-Time Semantic Communication Considering Semantic Ambiguities and Channel Noises [18.539501941328393]
This paper constructs a latent diffusion model-enabled SemCom system, and proposes three improvements compared to existing works.
A lightweight single-layer latent space transformation adapter completes one-shot learning at the transmitter.
An end-to-end consistency distillation strategy is used to distill the diffusion models trained in latent space.
arXiv Detail & Related papers (2024-06-09T23:39:31Z) - Tackling Distribution Shifts in Task-Oriented Communication with Information Bottleneck [28.661084093544684]
We propose a novel approach based on the information bottleneck (IB) principle and invariant risk minimization (IRM) framework.
The proposed method aims to extract compact and informative features that possess high capability for effective domain-shift generalization.
We show that the proposed scheme outperforms state-of-the-art approaches and achieves a better rate-distortion tradeoff.
arXiv Detail & Related papers (2024-05-15T17:07:55Z) - Reasoning with the Theory of Mind for Pragmatic Semantic Communication [62.87895431431273]
A pragmatic semantic communication framework is proposed in this paper.
It enables effective goal-oriented information sharing between two-intelligent agents.
Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits.
arXiv Detail & Related papers (2023-11-30T03:36:19Z) - Model-free Reinforcement Learning of Semantic Communication by Stochastic Policy Gradient [9.6403215177092]
The idea of semantic communication by Weaver from 1949 has gained attention.
We apply the Policy Gradient (SPG) to design a semantic communication system.
We derive the use of both classic and semantic communication from the mutual information between received and target variables.
arXiv Detail & Related papers (2023-05-05T14:27:58Z) - Cognitive Semantic Communication Systems Driven by Knowledge Graph:
Principle, Implementation, and Performance Evaluation [74.38561925376996]
Two cognitive semantic communication frameworks are proposed for the single-user and multiple-user communication scenarios.
An effective semantic correction algorithm is proposed by mining the inference rule from the knowledge graph.
For the multi-user cognitive semantic communication system, a message recovery algorithm is proposed to distinguish messages of different users.
arXiv Detail & Related papers (2023-03-15T12:01:43Z) - Joint Task and Data Oriented Semantic Communications: A Deep Separate
Source-channel Coding Scheme [17.4244108919728]
To serve both the data transmission and semantic tasks, joint data compression and semantic analysis has become pivotal issue in semantic communications.
This paper proposes a deep separate source-channel coding framework for the joint task and data oriented semantic communications.
An iterative training algorithm is proposed to tackle the overfitting issue of deep learning models.
arXiv Detail & Related papers (2023-02-27T08:34:37Z) - Neuro-Symbolic Causal Reasoning Meets Signaling Game for Emergent
Semantic Communications [71.63189900803623]
A novel emergent SC system framework is proposed and is composed of a signaling game for emergent language design and a neuro-symbolic (NeSy) artificial intelligence (AI) approach for causal reasoning.
The ESC system is designed to enhance the novel metrics of semantic information, reliability, distortion and similarity.
arXiv Detail & Related papers (2022-10-21T15:33:37Z) - Semi-supervised Domain Adaptive Structure Learning [72.01544419893628]
Semi-supervised domain adaptation (SSDA) is a challenging problem requiring methods to overcome both 1) overfitting towards poorly annotated data and 2) distribution shift across domains.
We introduce an adaptive structure learning method to regularize the cooperation of SSL and DA.
arXiv Detail & Related papers (2021-12-12T06:11:16Z) - Context Decoupling Augmentation for Weakly Supervised Semantic
Segmentation [53.49821324597837]
Weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years.
We present a Context Decoupling Augmentation ( CDA) method to change the inherent context in which the objects appear.
To validate the effectiveness of the proposed method, extensive experiments on PASCAL VOC 2012 dataset with several alternative network architectures demonstrate that CDA can boost various popular WSSS methods to the new state-of-the-art by a large margin.
arXiv Detail & Related papers (2021-03-02T15:05:09Z) - Incremental Embedding Learning via Zero-Shot Translation [65.94349068508863]
Current state-of-the-art incremental learning methods tackle catastrophic forgetting problem in traditional classification networks.
We propose a novel class-incremental method for embedding network, named as zero-shot translation class-incremental method (ZSTCI)
In addition, ZSTCI can easily be combined with existing regularization-based incremental learning methods to further improve performance of embedding networks.
arXiv Detail & Related papers (2020-12-31T08:21:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.