A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications

• URL: http://arxiv.org/abs/2601.22202v1
• Date: Thu, 29 Jan 2026 17:19:46 GMT
• Title: A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications
• Authors: Runze Cheng, Yao Sun, Ahmad Taha, Xuesong Liu, David Flynn, Muhammad Ali Imran,
• Abstract summary: We present a systematic review of SemCom for visual data transmission (SemCom-Vision)<n>An interdisciplinary analysis integrating computer vision (CV) and communication engineering is conducted to provide comprehensive guidelines for the machine learning (ML)-empowered SemCom-Vision design.<n>We introduce a novel classification perspective to categorize existing SemCom-Vision approaches as semantic preservation communication (SPC), semantic expansion communication (SEC), and semantic refinement communication (SRC) based on communication goals interpreted through semantic quantization schemes.
• Score: 8.12478698989831
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semantic communication (SemCom) emerges as a transformative paradigm for traffic-intensive visual data transmission, shifting focus from raw data to meaningful content transmission and relieving the increasing pressure on communication resources. However, to achieve SemCom, challenges are faced in accurate semantic quantization for visual data, robust semantic extraction and reconstruction under diverse tasks and goals, transceiver coordination with effective knowledge utilization, and adaptation to unpredictable wireless communication environments. In this paper, we present a systematic review of SemCom for visual data transmission (SemCom-Vision), wherein an interdisciplinary analysis integrating computer vision (CV) and communication engineering is conducted to provide comprehensive guidelines for the machine learning (ML)-empowered SemCom-Vision design. Specifically, this survey first elucidates the basics and key concepts of SemCom. Then, we introduce a novel classification perspective to categorize existing SemCom-Vision approaches as semantic preservation communication (SPC), semantic expansion communication (SEC), and semantic refinement communication (SRC) based on communication goals interpreted through semantic quantization schemes. Moreover, this survey articulates the ML-based encoder-decoder models and training algorithms for each SemCom-Vision category, followed by knowledge structure and utilization strategies. Finally, we discuss potential SemCom-Vision applications.

Related papers

• Secure Digital Semantic Communications: Fundamentals, Challenges, and Opportunities [38.002422435815014]
  Shift from bit-accurate transmission to task-oriented delivery introduces new security and privacy risks.<n>Digital SemCom transmits semantic information through discrete bits or symbols within practical transceiver pipelines.
  arXiv  Detail & Related papers  (2025-12-31T03:44:37Z)
• Knowledge Graph-Based Explainable and Generalized Zero-Shot Semantic Communications [23.330677629962103]
  We propose a knowledge graph-enhanced zero-shot semantic communication (KGZS-SC) network.<n> Guided by the structured semantic information from a knowledge graph-based semantic knowledge base (KG-SKB), our scheme provides generalized semantic representations and enables reasoning for unseen cases.<n>At the receiver, zero-shot learning (ZSL) is leveraged to enable direct classification for unseen cases without the demand for retraining or additional computational overhead.
  arXiv  Detail & Related papers  (2025-07-03T03:57:26Z)
• Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications [78.80966346820553]
  We introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC)<n>In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems, present the key principles for efficient TokCom at various layers in future wireless networks.
  arXiv  Detail & Related papers  (2025-02-17T18:14:18Z)
• Generative Semantic Communication: Architectures, Technologies, and Applications [36.67865904029129]
  This paper delves into the applications of generative artificial intelligence (GAI) in semantic communication (SemCom)<n>Three popular SemCom systems are first introduced, including variational autoencoders, generative adversarial networks, and diffusion models.<n>A novel generative SemCom system is proposed by incorporating the cutting-edge GAI technology-large language models (LLMs)
  arXiv  Detail & Related papers  (2024-12-11T18:59:50Z)
• Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency [59.15544887307901]
  Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. Existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. We propose a novel trustworthy ISC framework that employs Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks.
  arXiv  Detail & Related papers  (2024-08-07T14:32:36Z)
• Agent-driven Generative Semantic Communication with Cross-Modality and Prediction [57.335922373309074]
  We propose a novel agent-driven generative semantic communication framework based on reinforcement learning. In this work, we develop an agent-assisted semantic encoder with cross-modality capability, which can track the semantic changes, channel condition, to perform adaptive semantic extraction and sampling. The effectiveness of the designed models has been verified using the UA-DETRAC dataset, demonstrating the performance gains of the overall A-GSC framework.
  arXiv  Detail & Related papers  (2024-04-10T13:24:27Z)
• Interplay of Semantic Communication and Knowledge Learning [17.508008926853186]
  In this chapter, we clarify the means of knowledge learning in SemCom with a particular focus on the utilization of Knowledge Graphs (KGs) We introduce a KG-enhanced SemCom system, wherein the receiver is carefully calibrated to leverage knowledge from its static knowledge base for ameliorating the decoding performance. Furthermore, we investigate the possibility of integration with Large Language Models (LLMs) for data augmentation, offering additional perspective into the potential implementation means of SemCom.
  arXiv  Detail & Related papers  (2024-01-18T06:11:06Z)
• Will 6G be Semantic Communications? Opportunities and Challenges from Task Oriented and Secure Communications to Integrated Sensing [49.83882366499547]
  This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) networks through the integration of multi-task learning. We employ deep neural networks representing a dedicated encoder at the transmitter and multiple task-specific decoders at the receiver. We scrutinize potential vulnerabilities stemming from adversarial attacks during both training and testing phases.
  arXiv  Detail & Related papers  (2024-01-03T04:01:20Z)
• A Unified Framework for Integrating Semantic Communication and AI-Generated Content in Metaverse [57.317580645602895]
  Integrated Semantic Communication and AI-Generated Content (ISGC) has attracted a lot of attentions recently. ISGC transfers semantic information from user inputs, generates digital content, and renders graphics for Metaverse. We introduce a unified framework that captures ISGC two primary benefits, including integration gain for optimized resource allocation.
  arXiv  Detail & Related papers  (2023-05-18T02:02:36Z)
• Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications [88.68461721069433]
  Next generation systems can be potentially enriched by folding message semantics and goals of communication into their design. This tutorial summarizes the efforts to date, starting from its early adaptations, semantic-aware and task-oriented communications. The focus is on approaches that utilize information theory to provide the foundations, as well as the significant role of learning in semantics and task-aware communications.
  arXiv  Detail & Related papers  (2022-07-19T16:00:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.