Harnessing Tensor Structures -- Multi-Mode Reservoir Computing and Its Application in Massive MIMO

• URL: http://arxiv.org/abs/2102.09322v1
• Date: Mon, 25 Jan 2021 20:30:22 GMT
• Title: Harnessing Tensor Structures -- Multi-Mode Reservoir Computing and Its Application in Massive MIMO
• Authors: Zhou Zhou, Lingjia Liu, Jiarui Xu
• Abstract summary: We introduce a new neural network (NN) structure, multi-mode reservoir computing (Multi-Mode RC) The Multi-Mode RC-based learning framework can efficiently and effectively combat practical constraints of wireless systems.
• Score: 39.46260351352041
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we introduce a new neural network (NN) structure, multi-mode reservoir computing (Multi-Mode RC). It inherits the dynamic mechanism of RC and processes the forward path and loss optimization of the NN using tensor as the underlying data format. Multi-Mode RC exhibits less complexity compared with conventional RC structures (e.g. single-mode RC) with comparable generalization performance. Furthermore, we introduce an alternating least square-based learning algorithm for Multi-Mode RC as well as conduct the associated theoretical analysis. The result can be utilized to guide the configuration of NN parameters to sufficiently circumvent over-fitting issues. As a key application, we consider the symbol detection task in multiple-input-multiple-output (MIMO) orthogonal-frequency-division-multiplexing (OFDM) systems with massive MIMO employed at the base stations (BSs). Thanks to the tensor structure of massive MIMO-OFDM signals, our online learning-based symbol detection method generalizes well in terms of bit error rate even using a limited online training set. Evaluation results suggest that the Multi-Mode RC-based learning framework can efficiently and effectively combat practical constraints of wireless systems (i.e. channel state information (CSI) errors and hardware non-linearity) to enable robust and adaptive learning-based communications over the air.

Related papers

• DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection [52.74152717667157]
  We propose a lightweight module called Dual Attention Module (DAM) for capturing cross-dimension interaction relationships in-temporal skeletal data. It employs the frame attention mechanism to identify the most significant frames and the skeleton attention mechanism to capture broader relationships across fixed partitions with minimal parameters and flops.
  arXiv  Detail & Related papers  (2024-06-05T06:18:03Z)
• Learning Reservoir Dynamics with Temporal Self-Modulation [3.2548794659022393]
  Reservoir computing (RC) can efficiently process time-series data by transferring the input signal to randomly connected neural networks (RNNs) However, the learning performance of RC is inferior to that of other state-of-the-art RNN models. We propose self-modulated RC (SM-RC), which extends RC by adding a self-modulation mechanism.
  arXiv  Detail & Related papers  (2023-01-23T00:44:05Z)
• Detect to Learn: Structure Learning with Attention and Decision Feedback for MIMO-OFDM Receive Processing [25.66317464603635]
  This paper introduces an online attention-based approach, namely RC-AttStructNet-DF, that can efficiently utilize pilot symbols and be dynamically updated with the detected payload data. The DF mechanism further enhances detection performance by dynamically tracking the channel changes through detected data symbols.
  arXiv  Detail & Related papers  (2022-08-17T20:01:05Z)
• Hybridization of Capsule and LSTM Networks for unsupervised anomaly detection on multivariate data [0.0]
  This paper introduces a novel NN architecture which hybridises the Long-Short-Term-Memory (LSTM) and Capsule Networks into a single network. The proposed method uses an unsupervised learning technique to overcome the issues with finding large volumes of labelled training data.
  arXiv  Detail & Related papers  (2022-02-11T10:33:53Z)
• RC-Struct: A Structure-based Neural Network Approach for MIMO-OFDM Detection [33.414673669107906]
  We introduce a structure-based neural network architecture, namely RC-Struct, for signal detection. The RC-Struct exploits the temporal structure of the signals through reservoir computing (RC) The introduced RC-Struct sheds light on combining communication domain knowledge and learning-based receive processing for 5G and 5G Beyond.
  arXiv  Detail & Related papers  (2021-10-03T19:39:21Z)
• Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning [89.31889875864599]
  We propose an efficient model-based reinforcement learning algorithm for learning in multi-agent systems. Our main theoretical contributions are the first general regret bounds for model-based reinforcement learning for MFC. We provide a practical parametrization of the core optimization problem.
  arXiv  Detail & Related papers  (2021-07-08T18:01:02Z)
• Learning Frequency-aware Dynamic Network for Efficient Super-Resolution [56.98668484450857]
  This paper explores a novel frequency-aware dynamic network for dividing the input into multiple parts according to its coefficients in the discrete cosine transform (DCT) domain. In practice, the high-frequency part will be processed using expensive operations and the lower-frequency part is assigned with cheap operations to relieve the computation burden. Experiments conducted on benchmark SISR models and datasets show that the frequency-aware dynamic network can be employed for various SISR neural architectures.
  arXiv  Detail & Related papers  (2021-03-15T12:54:26Z)
• Deep Multi-Task Learning for Cooperative NOMA: System Design and Principles [52.79089414630366]
  We develop a novel deep cooperative NOMA scheme, drawing upon the recent advances in deep learning (DL) We develop a novel hybrid-cascaded deep neural network (DNN) architecture such that the entire system can be optimized in a holistic manner.
  arXiv  Detail & Related papers  (2020-07-27T12:38:37Z)
• When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks [57.0502745301132]
  We propose Micro-Dense Nets, a novel architecture with global residual learning and local micro-dense aggregations. Our micro-dense block can be integrated with neural architecture search based models to boost their performance.
  arXiv  Detail & Related papers  (2020-04-19T08:34:52Z)
• RCNet: Incorporating Structural Information into Deep RNN for MIMO-OFDM Symbol Detection with Limited Training [26.12840500767443]
  We introduce the Time-Frequency RC to take advantage of the structural information inherent in OFDM signals. We show that RCNet can offer a faster learning convergence and as much as 20% gain in bit error rate over a shallow RC structure.
  arXiv  Detail & Related papers  (2020-03-15T21:06:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.