Enhancing Time-Series Anomaly Detection by Integrating Spectral-Residual Bottom-Up Attention with Reservoir Computing

• URL: http://arxiv.org/abs/2510.14287v1
• Date: Thu, 16 Oct 2025 04:17:30 GMT
• Title: Enhancing Time-Series Anomaly Detection by Integrating Spectral-Residual Bottom-Up Attention with Reservoir Computing
• Authors: Hayato Nihei, Sou Nobukawa, Yusuke Sakemi, Kazuyuki Aihara,
• Abstract summary: Reservoir computing (RC) establishes the basis for processing of time-series data by exploiting the high-dimensional response of a recurrent neural network to an input signal.<n>This simplicity has drawn attention especially in Edge Artificial Intelligence (AI) applications.<n>We propose a spectral residual RC (SR-RC) that integrates the spectral residual (SR) method with RC.
• Score: 1.5119440099674917
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reservoir computing (RC) establishes the basis for the processing of time-series data by exploiting the high-dimensional spatiotemporal response of a recurrent neural network to an input signal. In particular, RC trains only the output layer weights. This simplicity has drawn attention especially in Edge Artificial Intelligence (AI) applications. Edge AI enables time-series anomaly detection in real time, which is important because detection delays can lead to serious incidents. However, achieving adequate anomaly-detection performance with RC alone may require an unacceptably large reservoir on resource-constrained edge devices. Without enlarging the reservoir, attention mechanisms can improve accuracy, although they may require substantial computation and undermine the learning efficiency of RC. In this study, to improve the anomaly detection performance of RC without sacrificing learning efficiency, we propose a spectral residual RC (SR-RC) that integrates the spectral residual (SR) method - a learning-free, bottom-up attention mechanism - with RC. We demonstrated that SR-RC outperformed conventional RC and logistic-regression models based on values extracted by the SR method across benchmark tasks and real-world time-series datasets. Moreover, because the SR method, similarly to RC, is well suited for hardware implementation, SR-RC suggests a practical direction for deploying RC as Edge AI for time-series anomaly detection.

Related papers

• Integrated Sensing, Communication, and Computation for Over-the-Air Federated Edge Learning [52.904670248426626]
  This paper studies an over-the-air federated edge learning (Air-FEEL) system with integrated sensing, communication, and computation.<n>We derive a low-complexity I SCC algorithm by alternately optimizing the batch size control and the network resource allocation.
  arXiv  Detail & Related papers  (2025-08-21T02:46:46Z)
• Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better [63.567886330598945]
  Infrared small target (IRST) detection is challenging in simultaneously achieving precise, universal, robust and efficient performance.<n>Current learning-based methods attempt to leverage more" information from both the spatial and the short-term temporal domains.<n>We propose an efficient deep temporal probe network (DeepPro) that only performs calculations in the time dimension for IRST detection.
  arXiv  Detail & Related papers  (2025-06-15T08:19:32Z)
• Hybridizing Traditional and Next-Generation Reservoir Computing to Accurately and Efficiently Forecast Dynamical Systems [0.0]
  Reservoir computers (RCs) are powerful machine learning architectures for time series prediction. Next generation reservoir computers (NGRCs) have been introduced, offering distinct advantages over RCs. Here, we introduce a hybrid RC-NGRC approach for time series forecasting of dynamical systems.
  arXiv  Detail & Related papers  (2024-03-04T17:35:17Z)
• Analysis and Fully Memristor-based Reservoir Computing for Temporal Data Classification [0.6291443816903801]
  Reservoir computing (RC) offers a neuromorphic framework that is particularly effective for processing signals.<n>Key component in RC hardware is the ability to generate dynamic reservoir states.<n>This study illuminates the adeptness of memristor-based RC systems in managing novel temporal challenges.
  arXiv  Detail & Related papers  (2024-03-04T08:22:29Z)
• Universal Approximation of Linear Time-Invariant (LTI) Systems through RNNs: Power of Randomness in Reservoir Computing [19.995241682744567]
  Reservoir computing (RC) is a special RNN where the recurrent weights are randomized and left untrained. We show that RC can universally approximate a general linear time-invariant (LTI) system.
  arXiv  Detail & Related papers  (2023-08-04T17:04:13Z)
• Eigensubspace of Temporal-Difference Dynamics and How It Improves Value Approximation in Reinforcement Learning [44.663181739694664]
  Eigensubspace Regularized Critic (ERC) is motivated by an analysis of dynamics of Q-value approximation error. We show that ERC effectively reduces the variance of value functions. It shows significant advantages in Q-value approximation and variance reduction.
  arXiv  Detail & Related papers  (2023-06-29T07:47:32Z)
• Disentangled Causal Graph Learning for Online Unsupervised Root Cause Analysis [49.910053255238566]
  Root cause analysis (RCA) can identify the root causes of system faults/failures by analyzing system monitoring data. Previous research has mostly focused on developing offline RCA algorithms, which often require manually initiating the RCA process. We propose CORAL, a novel online RCA framework that can automatically trigger the RCA process and incrementally update the RCA model.
  arXiv  Detail & Related papers  (2023-05-18T01:27:48Z)
• Embedding Theory of Reservoir Computing and Reducing Reservoir Network Using Time Delays [6.543793376734818]
  Reservoir computing (RC) is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems. Here, we rigorously prove that RC is essentially a high dimensional embedding of the original input nonlinear dynamical system. We significantly reduce the network size of RC for reconstructing and predicting some representative physical systems, and, more surprisingly, only using a single neuron reservoir with time delays is sometimes sufficient for achieving those tasks.
  arXiv  Detail & Related papers  (2023-03-16T02:25:51Z)
• Learning Reservoir Dynamics with Temporal Self-Modulation [3.2548794659022393]
  Reservoir computing (RC) can efficiently process time-series data by transferring the input signal to randomly connected neural networks (RNNs) However, the learning performance of RC is inferior to that of other state-of-the-art RNN models. We propose self-modulated RC (SM-RC), which extends RC by adding a self-modulation mechanism.
  arXiv  Detail & Related papers  (2023-01-23T00:44:05Z)
• Deep Spectrum Cartography: Completing Radio Map Tensors Using Learned Neural Models [44.609368050610044]
  Deep neural networks (DNNs) are able to "learn" intricate underlying structures from data. In this work, an emitter radio map disaggregation-based approach is proposed.
  arXiv  Detail & Related papers  (2021-05-01T07:04:09Z)
• Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks [44.40722828581203]
  An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users. A deep reinforcement learning (DRL) based solution is proposed, which includes the following components. A preserved and prioritized experience replay (2p-ER) is introduced to assist the DRL to train the policy network and find the optimal offloading policy.
  arXiv  Detail & Related papers  (2020-01-24T23:01:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.