Change Point Detection in Time Series Data using Autoencoders with a
Time-Invariant Representation
- URL: http://arxiv.org/abs/2008.09524v2
- Date: Wed, 10 Feb 2021 11:25:07 GMT
- Title: Change Point Detection in Time Series Data using Autoencoders with a
Time-Invariant Representation
- Authors: Tim De Ryck, Maarten De Vos, Alexander Bertrand
- Abstract summary: Change point detection (CPD) aims to locate abrupt property changes in time series data.
Recent CPD methods demonstrated the potential of using deep learning techniques, but often lack the ability to identify more subtle changes in the autocorrelation statistics of the signal.
We employ an autoencoder-based methodology with a novel loss function, through which the used autoencoders learn a partially time-invariant representation that is tailored for CPD.
- Score: 69.34035527763916
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Change point detection (CPD) aims to locate abrupt property changes in time
series data. Recent CPD methods demonstrated the potential of using deep
learning techniques, but often lack the ability to identify more subtle changes
in the autocorrelation statistics of the signal and suffer from a high false
alarm rate. To address these issues, we employ an autoencoder-based methodology
with a novel loss function, through which the used autoencoders learn a
partially time-invariant representation that is tailored for CPD. The result is
a flexible method that allows the user to indicate whether change points should
be sought in the time domain, frequency domain or both. Detectable change
points include abrupt changes in the slope, mean, variance, autocorrelation
function and frequency spectrum. We demonstrate that our proposed method is
consistently highly competitive or superior to baseline methods on diverse
simulated and real-life benchmark data sets. Finally, we mitigate the issue of
false detection alarms through the use of a postprocessing procedure that
combines a matched filter and a newly proposed change point score. We show that
this combination drastically improves the performance of our method as well as
all baseline methods.
Related papers
- Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Change points detection in crime-related time series: an on-line fuzzy
approach based on a shape space representation [0.0]
We propose an on-line method for detecting and querying change points in crime-related time series.
The method is able to accurately detect change points at very low computational costs.
arXiv Detail & Related papers (2023-12-18T10:49:03Z) - Online Change Points Detection for Linear Dynamical Systems with Finite
Sample Guarantees [1.6026317505839445]
We study the online change point detection problem for linear dynamical systems with unknown dynamics.
We develop a data-dependent threshold that can be used in our test that allows one to achieve a pre-specified upper bound on the probability of making a false alarm.
arXiv Detail & Related papers (2023-11-30T18:08:16Z) - Greedy online change point detection [0.0]
Greedy Online Change Point Detection (GOCPD) is a computationally appealing method which finds change points by maximizing the probability of the data coming from the (temporal) concatenation of two independent models.
We show that, for time series with a single change point, this objective is unimodal and thus CPD can be accelerated via ternary search with logarithmic complexity.
arXiv Detail & Related papers (2023-08-14T08:59:59Z) - Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs)
The performance of existing RS-CD methods is attributed to training on large annotated datasets.
This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
arXiv Detail & Related papers (2023-03-16T17:52:45Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Optimal Sequential Detection of Signals with Unknown Appearance and
Disappearance Points in Time [64.26593350748401]
The paper addresses a sequential changepoint detection problem, assuming that the duration of change may be finite and unknown.
We focus on a reliable maximin change detection criterion of maximizing the minimal probability of detection in a given time (or space) window.
The FMA algorithm is applied to detecting faint streaks of satellites in optical images.
arXiv Detail & Related papers (2021-02-02T04:58:57Z) - Time Series Change Point Detection with Self-Supervised Contrastive
Predictive Coding [7.60848038196539]
We propose a novel approach for self-supervised Time Series Change Point detection method based onContrastivePredictive coding (TS-CP2)
TS-CP2 is the first approach to employ a contrastive learning strategy for CPD by learning an embedded representation that separates pairs of embeddings of time adjacent intervals from pairs of interval embeddings separated across time.
arXiv Detail & Related papers (2020-11-28T09:36:18Z) - Partially Observable Online Change Detection via Smooth-Sparse
Decomposition [16.8028358824706]
We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities.
On the one hand, the detection scheme should be able to deal with partially observable data and meanwhile have efficient detection power for sparse changes.
In this paper, we propose a novel detection scheme called CDSSD. In particular, it describes the structure of high dimensional data with sparse changes by smooth-sparse decomposition.
arXiv Detail & Related papers (2020-09-22T16:03:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.