MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model

• URL: http://arxiv.org/abs/2409.16592v1
• Date: Wed, 25 Sep 2024 03:37:51 GMT
• Title: MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
• Abstract summary: MambaJSCC achieves state-of-the-art performance with low computational and parameter overhead. We design the CSI-ReST method, which injects channel state information (CSI) into the initial state of GSSM to utilize its native response. Experimental results show that MambaJSCC not only outperforms existing J SCC methods but also significantly reduces parameter size, computational overhead, and inference delay.
• Score: 44.01221953073462
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Lightweight and efficient neural network models for deep joint source-channel coding (JSCC) are crucial for semantic communications. In this paper, we propose a novel JSCC architecture, named MambaJSCC, that achieves state-of-the-art performance with low computational and parameter overhead. MambaJSCC utilizes the visual state space model with channel adaptation (VSSM-CA) blocks as its backbone for transmitting images over wireless channels, where the VSSM-CA primarily consists of the generalized state space models (GSSM) and the zero-parameter, zero-computational channel adaptation method (CSI-ReST). We design the GSSM module, leveraging reversible matrix transformations to express generalized scan expanding operations, and theoretically prove that two GSSM modules can effectively capture global information. We discover that GSSM inherently possesses the ability to adapt to channels, a form of endogenous intelligence. Based on this, we design the CSI-ReST method, which injects channel state information (CSI) into the initial state of GSSM to utilize its native response, and into the residual state to mitigate CSI forgetting, enabling effective channel adaptation without introducing additional computational and parameter overhead. Experimental results show that MambaJSCC not only outperforms existing JSCC methods (e.g., SwinJSCC) across various scenarios but also significantly reduces parameter size, computational overhead, and inference delay.

Related papers

• Fast Cross-Scenario Adaptation of CSI Models via Channel Conditional Parameter Generation [71.49439535846827]
  Conditional Channel Generation (CCPG) is an end-to-end pipeline for rapid deployment of CSI models in dynamic wireless environments.<n> CCPG identifies scene-sensitive adaptation bottlenecks through component-freezing experiments and generates only lightweight LoRA weights.<n>Experiments on DeepMIMO and WAIR-D for CSI feedback and channel estimation show that CCPG adapts to new scenarios in about 3 seconds with a single forward pass.
  arXiv  Detail & Related papers  (2026-06-22T13:20:01Z)
• Statistical Channel Fingerprint Construction for Massive MIMO: A Unified Tensor Learning Framework [51.39651336043647]
  Channel fingerprint (CF) is considered a key enabler for facilitating the acquisition of channel state information inIMO communication systems.<n>We propose a novel type of CF that stores statistical CSI (sCSI) at each potential location, referred to as statistical CF (sCF)
  arXiv  Detail & Related papers  (2026-04-30T08:28:45Z)
• MambaCSP: Hybrid-Attention State Space Models for Hardware-Efficient Channel State Prediction [37.23142541350246]
  We propose MambaCSP, a hybrid-attention SSM architecture that replaces LLM-based prediction backbones with a linear-time Mamba model.<n>MambaCSP improves prediction accuracy over LLM-based approaches by 9-12%, while delivering up to 3.0x higher throughput, 2.6x lower VRAM usage, and 2.9x faster inference.
  arXiv  Detail & Related papers  (2026-04-23T10:05:33Z)
• Joint Source-Channel-Generation Coding: From Distortion-oriented Reconstruction to Semantic-consistent Generation [58.67925548779465]
  We propose Joint Source-Channel-Generation Coding (JSCGC), a novel paradigm that shifts the focus from perceptual reconstruction to probabilistic generation.<n>JSCGC improves substantially semantic quality and semantic fidelity, significantly outperforming conventional distortion-oriented J SCC methods.
  arXiv  Detail & Related papers  (2026-01-19T08:12:47Z)
• Green Learning for STAR-RIS mmWave Systems with Implicit CSI [53.03358325565645]
  Green learning (GL)-based precoding framework is proposed for simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-aided millimeter-wave (mmWave) broadcasting systems.<n>Motivated by the emphasis on environmental sustainability in future 6G networks, this work adopts a transmission framework for scenarios where multiple users share identical information, improving spectral efficiency and reducing redundant transmissions and power consumption.
  arXiv  Detail & Related papers  (2025-09-08T15:56:06Z)
• Few-Shot Object Detection via Spatial-Channel State Space Model [9.644454618045133]
  Current methods may struggle to accurately extract effective features from each channel.<n>We propose a Spatial-Channel State Space Modeling (SCSM) module for spatial-channel state modeling.<n>SCSM module highlights the effective patterns and rectifies those ineffective ones in feature channels.
  arXiv  Detail & Related papers  (2025-07-21T07:08:19Z)
• MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution [33.457410717030946]
  We propose MambaVSR, the first state-space model framework for super-resolution video.<n>MambaVSR enables dynamic interactions through the Shared Compass Construction ( SCC) and the Content-Aware Sequentialization (CAS)<n>Building upon, the CAS module effectively aligns and aggregates non-local similar content across multiple frames by interleaving temporal features along the learned spatial order.
  arXiv  Detail & Related papers  (2025-06-13T13:22:28Z)
• Channel Fingerprint Construction for Massive MIMO: A Deep Conditional Generative Approach [65.47969413708344]
  We introduce the concept of CF twins and design a conditional generative diffusion model (CGDM)<n>We employ a variational inference technique to derive the evidence lower bound (ELBO) for the log-marginal distribution of the observed fine-grained CF conditioned on the coarse-grained CF.<n>We show that the proposed approach exhibits significant improvement in reconstruction performance compared to the baselines.
  arXiv  Detail & Related papers  (2025-05-12T01:36:06Z)
• Modeling and Performance Analysis for Semantic Communications Based on Empirical Results [53.805458017074294]
  We propose an Alpha-Beta-Gamma (ABG) formula to model the relationship between the end-to-end measurement and SNR. For image reconstruction tasks, the proposed ABG formula can well fit the commonly used DL networks, such as SCUNet, and Vision Transformer. To the best of our knowledge, this is the first theoretical expression between end-to-end performance metrics and SNR for semantic communications.
  arXiv  Detail & Related papers  (2025-04-29T06:07:50Z)
• Uplink Assisted Joint Channel Estimation and CSI Feedback: An Approach Based on Deep Joint Source-Channel Coding [20.422899602093786]
  We propose an uplink assisted joint CE and and CSI feedback approach via deep learning for downlink CSI acquisition. The proposed network adopts a deep joint source-channel coding architecture to mitigate the cliff effect encountered in the conventional separate source-channel coding.
  arXiv  Detail & Related papers  (2025-04-15T03:29:24Z)
• CMamba: Learned Image Compression with State Space Models [31.10785880342252]
  We propose a hybrid Convolution and State Space Models (SSMs) based image compression framework to achieve superior rate-distortion performance. Specifically, CMamba introduces two key components: a Content-Adaptive SSM (CA-SSM) module and a Context-Aware Entropy (CAE) module. Experimental results demonstrate that CMamba achieves superior rate-distortion performance.
  arXiv  Detail & Related papers  (2025-02-07T15:07:04Z)
• A Memory-Based Reinforcement Learning Approach to Integrated Sensing and Communication [52.40430937325323]
  We consider a point-to-point integrated sensing and communication (ISAC) system, where a transmitter conveys a message to a receiver over a channel with memory. We formulate the capacity-distortion tradeoff for the ISAC problem when sensing is performed in an online fashion.
  arXiv  Detail & Related papers  (2024-12-02T03:30:50Z)
• Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs [6.059175509501795]
  Joint source-channel coding (JSCC) offers an alternative end-to-end approach by optimizing compression and channel coding together. This article provides an overview of the information theoretic foundations of J SCC, surveys practical J SCC designs over the decades, and discusses the reasons for their limited adoption in practical systems.
  arXiv  Detail & Related papers  (2024-09-26T06:10:29Z)
• Empowering Snapshot Compressive Imaging: Spatial-Spectral State Space Model with Across-Scanning and Local Enhancement [51.557804095896174]
  We introduce a State Space Model with Across-Scanning and Local Enhancement, named ASLE-SSM, that employs a Spatial-Spectral SSM for global-local balanced context encoding and cross-channel interaction promoting. Experimental results illustrate ASLE-SSM's superiority over existing state-of-the-art methods, with an inference speed 2.4 times faster than Transformer-based MST and saving 0.12 (M) of parameters.
  arXiv  Detail & Related papers  (2024-08-01T15:14:10Z)
• Robust Image Semantic Coding with Learnable CSI Fusion Masking over MIMO Fading Channels [44.15994739018646]
  Existing semantic communication frameworks mainly consider single-input single-output Gaussian channels or Rayleigh fading channels. We propose a learnable CSI fusion semantic communication framework, where CSI is treated as side information by the semantic extractor. Experiment results testify the superiority of LCFSC over traditional schemes and state-of-the-art Swin Transformer-based semantic communication frameworks.
  arXiv  Detail & Related papers  (2024-05-30T08:23:17Z)
• CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration [7.292363114816646]
  We introduce the Channel-Aware U-Shaped Mamba model, which incorporates a dual State Space Model framework into the U-Net architecture. Experiments validate CU-Mamba's superiority over existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-04-17T22:02:22Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Binarized Spectral Compressive Imaging [59.18636040850608]
  Existing deep learning models for hyperspectral image (HSI) reconstruction achieve good performance but require powerful hardwares with enormous memory and computational resources. We propose a novel method, Binarized Spectral-Redistribution Network (BiSRNet) BiSRNet is derived by using the proposed techniques to binarize the base model.
  arXiv  Detail & Related papers  (2023-05-17T15:36:08Z)
• IMDeception: Grouped Information Distilling Super-Resolution Network [7.6146285961466]
  Single-Image-Super-Resolution (SISR) is a classical computer vision problem that has benefited from the recent advancements in deep learning methods. In this work, we propose the Global Progressive Refinement Module (GPRM) as a less parameter-demanding alternative to the IIC module for feature aggregation. We also propose Grouped Information Distilling Blocks (GIDB) to further decrease the number of parameters and floating point operations persecond (FLOPS) Experiments reveal that the proposed network performs on par with state-of-the-art models despite having a limited number of parameters and FLOPS
  arXiv  Detail & Related papers  (2022-04-25T06:43:45Z)
• Deep Learning-based Resource Allocation For Device-to-Device Communication [66.74874646973593]
  We propose a framework for the optimization of the resource allocation in multi-channel cellular systems with device-to-device (D2D) communication. A deep learning (DL) framework is proposed, where the optimal resource allocation strategy for arbitrary channel conditions is approximated by deep neural network (DNN) models. Our simulation results confirm that near-optimal performance can be attained with low time, which underlines the real-time capability of the proposed scheme.
  arXiv  Detail & Related papers  (2020-11-25T14:19:23Z)
• Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution [79.97180849505294]
  We propose a novel coupled unmixing network with a cross-attention mechanism, CUCaNet, to enhance the spatial resolution of HSI. Experiments are conducted on three widely-used HS-MS datasets in comparison with state-of-the-art HSI-SR models.
  arXiv  Detail & Related papers  (2020-07-10T08:08:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.