Detect to Learn: Structure Learning with Attention and Decision Feedback
for MIMO-OFDM Receive Processing
- URL: http://arxiv.org/abs/2208.09287v4
- Date: Tue, 20 Jun 2023 18:23:11 GMT
- Title: Detect to Learn: Structure Learning with Attention and Decision Feedback
for MIMO-OFDM Receive Processing
- Authors: Jiarui Xu, Lianjun Li, Lizhong Zheng, and Lingjia Liu
- Abstract summary: This paper introduces an online attention-based approach, namely RC-AttStructNet-DF, that can efficiently utilize pilot symbols and be dynamically updated with the detected payload data.
The DF mechanism further enhances detection performance by dynamically tracking the channel changes through detected data symbols.
- Score: 25.66317464603635
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The limited over-the-air (OTA) pilot symbols in
multiple-input-multiple-output orthogonal-frequency-division-multiplexing
(MIMO-OFDM) systems presents a major challenge for detecting transmitted data
symbols at the receiver, especially for machine learning-based approaches.
While it is crucial to explore effective ways to exploit pilots, one can also
take advantage of the data symbols to improve detection performance. Thus, this
paper introduces an online attention-based approach, namely RC-AttStructNet-DF,
that can efficiently utilize pilot symbols and be dynamically updated with the
detected payload data using the decision feedback (DF) mechanism. Reservoir
computing (RC) is employed in the time domain network to facilitate efficient
online training. The frequency domain network adopts the novel 2D multi-head
attention (MHA) module to capture the time and frequency correlations, and the
structural-based StructNet to facilitate the DF mechanism. The attention loss
is designed to learn the frequency domain network. The DF mechanism further
enhances detection performance by dynamically tracking the channel changes
through detected data symbols. The effectiveness of the RC-AttStructNet-DF
approach is demonstrated through extensive experiments in MIMO-OFDM and massive
MIMO-OFDM systems with different modulation orders and under various scenarios.
Related papers
- Online Multi-modal Root Cause Analysis [61.94987309148539]
Root Cause Analysis (RCA) is essential for pinpointing the root causes of failures in microservice systems.
Existing online RCA methods handle only single-modal data overlooking, complex interactions in multi-modal systems.
We introduce OCEAN, a novel online multi-modal causal structure learning method for root cause localization.
arXiv Detail & Related papers (2024-10-13T21:47:36Z) - Towards xAI: Configuring RNN Weights using Domain Knowledge for MIMO Receive Processing [19.995241682744567]
We advance the field of Explainable AI (xAI) in the physical layer of wireless communications.
We focus on the task of.
MIMO-OFDM receive processing (e.g., symbol detection) using reservoir computing (RC), a framework.
within recurrent neural networks (RNNs)
Our analysis provides a signal processing-based, first-principles understanding of the corresponding operation of RC.
arXiv Detail & Related papers (2024-10-09T17:16:11Z) - DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection [52.74152717667157]
We propose a lightweight module called Dual Attention Module (DAM) for capturing cross-dimension interaction relationships in-temporal skeletal data.
It employs the frame attention mechanism to identify the most significant frames and the skeleton attention mechanism to capture broader relationships across fixed partitions with minimal parameters and flops.
arXiv Detail & Related papers (2024-06-05T06:18:03Z) - Joint Channel Estimation and Feedback with Masked Token Transformers in
Massive MIMO Systems [74.52117784544758]
This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix.
The entire encoder-decoder network is utilized for channel compression.
Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
arXiv Detail & Related papers (2023-06-08T06:15:17Z) - ASR: Attention-alike Structural Re-parameterization [53.019657810468026]
We propose a simple-yet-effective attention-alike structural re- parameterization (ASR) that allows us to achieve SRP for a given network while enjoying the effectiveness of the attention mechanism.
In this paper, we conduct extensive experiments from a statistical perspective and discover an interesting phenomenon Stripe Observation, which reveals that channel attention values quickly approach some constant vectors during training.
arXiv Detail & Related papers (2023-04-13T08:52:34Z) - Three-Way Deep Neural Network for Radio Frequency Map Generation and
Source Localization [67.93423427193055]
Monitoring wireless spectrum over spatial, temporal, and frequency domains will become a critical feature in beyond-5G and 6G communication technologies.
In this paper, we present a Generative Adversarial Network (GAN) machine learning model to interpolate irregularly distributed measurements across the spatial domain.
arXiv Detail & Related papers (2021-11-23T22:25:10Z) - RC-Struct: A Structure-based Neural Network Approach for MIMO-OFDM
Detection [33.414673669107906]
We introduce a structure-based neural network architecture, namely RC-Struct, for signal detection.
The RC-Struct exploits the temporal structure of the signals through reservoir computing (RC)
The introduced RC-Struct sheds light on combining communication domain knowledge and learning-based receive processing for 5G and 5G Beyond.
arXiv Detail & Related papers (2021-10-03T19:39:21Z) - Learnable Multi-level Frequency Decomposition and Hierarchical Attention
Mechanism for Generalized Face Presentation Attack Detection [7.324459578044212]
Face presentation attack detection (PAD) is attracting a lot of attention and playing a key role in securing face recognition systems.
We propose a dual-stream convolution neural networks (CNNs) framework to deal with unseen scenarios.
We successfully prove the design of our proposed PAD solution in a step-wise ablation study.
arXiv Detail & Related papers (2021-09-16T13:06:43Z) - Model-Driven Deep Learning Based Channel Estimation and Feedback for
Millimeter-Wave Massive Hybrid MIMO Systems [61.78590389147475]
This paper proposes a model-driven deep learning (MDDL)-based channel estimation and feedback scheme for millimeter-wave (mmWave) systems.
To reduce the uplink pilot overhead for estimating the high-dimensional channels from a limited number of radio frequency (RF) chains, we propose to jointly train the phase shift network and the channel estimator as an auto-encoder.
Numerical results show that the proposed MDDL-based channel estimation and feedback scheme outperforms the state-of-the-art approaches.
arXiv Detail & Related papers (2021-04-22T13:34:53Z) - Harnessing Tensor Structures -- Multi-Mode Reservoir Computing and Its
Application in Massive MIMO [39.46260351352041]
We introduce a new neural network (NN) structure, multi-mode reservoir computing (Multi-Mode RC)
The Multi-Mode RC-based learning framework can efficiently and effectively combat practical constraints of wireless systems.
arXiv Detail & Related papers (2021-01-25T20:30:22Z) - RCNet: Incorporating Structural Information into Deep RNN for MIMO-OFDM
Symbol Detection with Limited Training [26.12840500767443]
We introduce the Time-Frequency RC to take advantage of the structural information inherent in OFDM signals.
We show that RCNet can offer a faster learning convergence and as much as 20% gain in bit error rate over a shallow RC structure.
arXiv Detail & Related papers (2020-03-15T21:06:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.