Dynamic Interpretable Change Point Detection
- URL: http://arxiv.org/abs/2211.03991v2
- Date: Wed, 7 Jun 2023 18:39:11 GMT
- Title: Dynamic Interpretable Change Point Detection
- Authors: Kopal Garg and Jennifer Yu and Tina Behrouzi and Sana Tonekaboni and
Anna Goldenberg
- Abstract summary: TiVaCPD is an approach that uses a Time-Varying Graphical Lasso to identify changes in correlation patterns between multidimensional features over time.
We evaluate the performance of TiVaCPD in identifying and characterizing various types of CPs and show that our method outperforms current state-of-the-art methods in real-world CPD datasets.
- Score: 9.879634139205569
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Identifying change points (CPs) in a time series is crucial to guide better
decision making across various fields like finance and healthcare and
facilitating timely responses to potential risks or opportunities. Existing
Change Point Detection (CPD) methods have a limitation in tracking changes in
the joint distribution of multidimensional features. In addition, they fail to
generalize effectively within the same time series as different types of CPs
may require different detection methods. As the volume of multidimensional time
series continues to grow, capturing various types of complex CPs such as
changes in the correlation structure of the time-series features has become
essential. To overcome the limitations of existing methods, we propose TiVaCPD,
an approach that uses a Time-Varying Graphical Lasso (TVGL) to identify changes
in correlation patterns between multidimensional features over time, and
combines that with an aggregate Kernel Maximum Mean Discrepancy (MMD) test to
identify changes in the underlying statistical distributions of dynamic time
windows with varying length. The MMD and TVGL scores are combined using a novel
ensemble method based on similarity measures leveraging the power of both
statistical tests. We evaluate the performance of TiVaCPD in identifying and
characterizing various types of CPs and show that our method outperforms
current state-of-the-art methods in real-world CPD datasets. We further
demonstrate that TiVaCPD scores characterize the type of CPs and facilitate
interpretation of change dynamics, offering insights into real-life
applications.
Related papers
- TiVaT: Joint-Axis Attention for Time Series Forecasting with Lead-Lag Dynamics [5.016178141636157]
TiVaT (Time-Variable Transformer) is a novel architecture that integrates temporal and variable dependencies.
TiVaT consistently delivers strong performance across diverse datasets.
This positions TiVaT as a new benchmark in MTS forecasting, particularly in handling datasets characterized by intricate and challenging dependencies.
arXiv Detail & Related papers (2024-10-02T13:24:24Z) - Bayesian Autoregressive Online Change-Point Detection with Time-Varying Parameters [0.8192907805418583]
Change points in real-world systems mark significant regime shifts in system dynamics.
We propose a new method for online change point detection in the mean of a univariate time series.
By modeling temporal dependencies and time-varying parameters, the proposed approach enhances both the estimate accuracy and the forecasting power.
arXiv Detail & Related papers (2024-07-23T10:57:13Z) - Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - Compatible Transformer for Irregularly Sampled Multivariate Time Series [75.79309862085303]
We propose a transformer-based encoder to achieve comprehensive temporal-interaction feature learning for each individual sample.
We conduct extensive experiments on 3 real-world datasets and validate that the proposed CoFormer significantly and consistently outperforms existing methods.
arXiv Detail & Related papers (2023-10-17T06:29:09Z) - Correlation-aware Spatial-Temporal Graph Learning for Multivariate
Time-series Anomaly Detection [67.60791405198063]
We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection.
CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module.
A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
arXiv Detail & Related papers (2023-07-17T11:04:27Z) - The Capacity and Robustness Trade-off: Revisiting the Channel
Independent Strategy for Multivariate Time Series Forecasting [50.48888534815361]
We show that models trained with the Channel Independent (CI) strategy outperform those trained with the Channel Dependent (CD) strategy.
Our results conclude that the CD approach has higher capacity but often lacks robustness to accurately predict distributionally drifted time series.
We propose a modified CD method called Predict Residuals with Regularization (PRReg) that can surpass the CI strategy.
arXiv Detail & Related papers (2023-04-11T13:15:33Z) - Multi-scale Attention Flow for Probabilistic Time Series Forecasting [68.20798558048678]
We propose a novel non-autoregressive deep learning model, called Multi-scale Attention Normalizing Flow(MANF)
Our model avoids the influence of cumulative error and does not increase the time complexity.
Our model achieves state-of-the-art performance on many popular multivariate datasets.
arXiv Detail & Related papers (2022-05-16T07:53:42Z) - WATCH: Wasserstein Change Point Detection for High-Dimensional Time
Series Data [4.228718402877829]
Change point detection methods have the ability to discover changes in an unsupervised fashion.
We propose WATCH, a novel Wasserstein distance-based change point detection approach.
An extensive evaluation shows that WATCH is capable of accurately identifying change points and outperforming state-of-the-art methods.
arXiv Detail & Related papers (2022-01-18T16:55:29Z) - Time Series Change Point Detection with Self-Supervised Contrastive
Predictive Coding [7.60848038196539]
We propose a novel approach for self-supervised Time Series Change Point detection method based onContrastivePredictive coding (TS-CP2)
TS-CP2 is the first approach to employ a contrastive learning strategy for CPD by learning an embedded representation that separates pairs of embeddings of time adjacent intervals from pairs of interval embeddings separated across time.
arXiv Detail & Related papers (2020-11-28T09:36:18Z) - Change Point Detection in Time Series Data using Autoencoders with a
Time-Invariant Representation [69.34035527763916]
Change point detection (CPD) aims to locate abrupt property changes in time series data.
Recent CPD methods demonstrated the potential of using deep learning techniques, but often lack the ability to identify more subtle changes in the autocorrelation statistics of the signal.
We employ an autoencoder-based methodology with a novel loss function, through which the used autoencoders learn a partially time-invariant representation that is tailored for CPD.
arXiv Detail & Related papers (2020-08-21T15:03:21Z) - Correlation-aware Unsupervised Change-point Detection via Graph Neural
Networks [37.68666658785003]
Change-point detection (CPD) aims to detect abrupt changes over time series data.
Existing CPD methods either ignore the dependency structures entirely or rely on the (unrealistic) assumption that the correlation structures are static over time.
We propose a Correlation-aware Dynamics Model for CPD, which explicitly models the correlation structure and dynamics of variables.
arXiv Detail & Related papers (2020-04-24T18:28:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.