Lightweight Multi-Scale Anomaly Detection for Resource-Constrained Edge Devices
- URL: http://arxiv.org/abs/2607.12599v1
- Date: Tue, 14 Jul 2026 10:19:07 GMT
- Title: Lightweight Multi-Scale Anomaly Detection for Resource-Constrained Edge Devices
- Abstract summary: Time-series anomaly detection is increasingly important in IoT systems, sensor networks, and edge monitoring applications.<n>Recent deep-learning approaches have improved detection accuracy, but many remain computationally expensive and often fail to capture subtle anomalies.<n>We propose a Lightweight MultiScale AutoEncoder network for univariate time-series anomaly detection, designed to be compact and computationally efficient.
- Score: 0.12891210250935145
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Time-series anomaly detection is increasingly important in IoT systems, sensor networks, and edge monitoring applications, where models must operate under strict constraints on memory, latency, and power consumption. While recent deep-learning approaches have improved detection accuracy, many remain computationally expensive and often fail to capture subtle anomalies due to limited multi-scale sensitivity. Autoencoders are widely used for anomaly detection because they reconstruct normal patterns well, leading to elevated reconstruction errors for anomalous inputs. Their simplicity and efficiency also make them suitable lightweight backbones for handling multi-scale inputs. To address these challenges, we propose a Lightweight MultiScale AutoEncoder (LMSAE) network for univariate time-series anomaly detection, designed to be compact and computationally efficient. LMSAE leverages the Discrete Wavelet Transform (DWT) to extract multi-scale features and employs a multi-scale loss function to improve sensitivity to subtle or hidden anomalies. Experiments on benchmark datasets demonstrate competitive or superior detection performance despite using significantly fewer parameters and a model size of less than 500 KB. LMSAE also achieves low-latency, low-power inference on the NVIDIA Jetson Nano, with 9x reduction in inference latency and 2x reduction in power consumption, making it ideal for edge deployment.
Related papers
- SMT-AD: a scalable quantum-inspired anomaly detection approach [11.096405723993607]
Quantum-inspired tensor networks algorithms have shown to be effective and efficient models for machine learning tasks.<n>We propose a parallelizable quantum-inspired approach which we call SMT-AD from Superposition of Multiresolutions for Anomaly Detection.<n>We demonstrate successful anomaly detection when applied to standard datasets, including credit card transactions.
arXiv Detail & Related papers (2026-04-07T02:37:45Z) - Amped: Adaptive Multi-stage Non-edge Pruning for Edge Detection [53.59823657644554]
We propose an Adaptive Multi-stage non-edge Pruning framework for Edge Detection(Amped)<n>Amped identifies high-confidence non-edge tokens and removes them as early as possible to substantially reduce computation.<n>To mitigate the structural complexity of existing edge detection networks, we introduce a simple yet high-performance Transformer-based model, termed Streamline Edge Detector(SED)
arXiv Detail & Related papers (2026-03-29T12:26:35Z) - SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model [52.47816604709358]
Video anomaly detection (VAD) aims to identify unexpected events in videos and has wide applications in safety-critical domains.<n> vision-language models (VLMs) have demonstrated strong multimodal reasoning capabilities, offering new opportunities for anomaly detection.<n>We propose SlowFastVAD, a hybrid framework that integrates a fast anomaly detector with a slow anomaly detector.
arXiv Detail & Related papers (2025-04-14T15:30:03Z) - Towards Resource-Efficient Federated Learning in Industrial IoT for Multivariate Time Series Analysis [50.18156030818883]
Anomaly and missing data constitute a thorny problem in industrial applications.
Deep learning enabled anomaly detection has emerged as a critical direction.
The data collected in edge devices contain user privacy.
arXiv Detail & Related papers (2024-11-06T15:38:31Z) - DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection [42.07920565812081]
We propose a novel post-training weight pruning scheme for 3D object detection.
It determines redundant parameters in the pretrained model that lead to minimal distortion in both locality and confidence.
This framework aims to minimize detection distortion of network output to maximally maintain detection precision.
arXiv Detail & Related papers (2024-07-02T09:33:32Z) - Towards efficient deep autoencoders for multivariate time series anomaly
detection [0.8681331155356999]
We propose a novel compression method for deep autoencoders that involves three key factors.
First, pruning reduces the number of weights, while preventing catastrophic drops in accuracy by means of a fast search process.
Second, linear and non-linear quantization reduces model complexity by reducing the number of bits for every single weight.
arXiv Detail & Related papers (2024-03-04T19:22:09Z) - Global Context Aggregation Network for Lightweight Saliency Detection of
Surface Defects [70.48554424894728]
We develop a Global Context Aggregation Network (GCANet) for lightweight saliency detection of surface defects on the encoder-decoder structure.
First, we introduce a novel transformer encoder on the top layer of the lightweight backbone, which captures global context information through a novel Depth-wise Self-Attention (DSA) module.
The experimental results on three public defect datasets demonstrate that the proposed network achieves a better trade-off between accuracy and running efficiency compared with other 17 state-of-the-art methods.
arXiv Detail & Related papers (2023-09-22T06:19:11Z) - Quantized Non-Volatile Nanomagnetic Synapse based Autoencoder for
Efficient Unsupervised Network Anomaly Detection [0.07892577704654172]
We show that implementing the autoencoder in edge devices capable of learning in real-time is challenging due to limited hardware, energy, and computational resources.
We propose a ferromagnetic racetrack with engineered notches hosting a magnetic domain wall (DW) as the autoencoder synapses.
Our DW-based approach demonstrates a remarkable reduction of at least three orders of magnitude in weight updates during training compared to the floating-point approach.
arXiv Detail & Related papers (2023-09-12T02:29:09Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - Efficient Decoder-free Object Detection with Transformers [75.00499377197475]
Vision transformers (ViTs) are changing the landscape of object detection approaches.
We propose a decoder-free fully transformer-based (DFFT) object detector.
DFFT_SMALL achieves high efficiency in both training and inference stages.
arXiv Detail & Related papers (2022-06-14T13:22:19Z) - Minimal-Configuration Anomaly Detection for IIoT Sensors [0.2462953128215087]
Low-cost IoT sensor platforms in industry boost the demand for anomaly detection solutions.
Recent advances in deep learning offer promising methods for detecting anomalies in sensor data recordings.
We consider this work as being the first step towards a generic anomaly detection method.
arXiv Detail & Related papers (2021-10-08T11:52:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.