Using matrix-product states for time-series machine learning

• URL: http://arxiv.org/abs/2412.15826v2
• Date: Mon, 12 May 2025 01:12:12 GMT
• Title: Using matrix-product states for time-series machine learning
• Authors: Joshua B. Moore, Hugo P. Stackhouse, Ben D. Fulcher, Sahand Mahmoodian,
• Abstract summary: Matrix-product states (MPS) have proven to be a versatile ansatz for modeling quantum many-body physics.<n>Here, we develop and apply an MPS-based algorithm, MPSTime, for learning a joint probability distribution underlying an observed time-series dataset.<n>We show how it can be used to tackle important time-series ML problems, including classification and imputation.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Matrix-product states (MPS) have proven to be a versatile ansatz for modeling quantum many-body physics. For many applications, and particularly in one-dimension, they capture relevant quantum correlations in many-body wavefunctions while remaining tractable to store and manipulate on a classical computer. This has motivated researchers to also apply the MPS ansatz to machine learning (ML) problems where capturing complex correlations in datasets is also a key requirement. Here, we develop and apply an MPS-based algorithm, MPSTime, for learning a joint probability distribution underlying an observed time-series dataset, and show how it can be used to tackle important time-series ML problems, including classification and imputation. MPSTime can efficiently learn complicated time-series probability distributions directly from data, requires only moderate maximum MPS bond dimension $\chi_{\rm max}$, with values for our applications ranging between $\chi_{\rm max} = 20-160$, and can be trained for both classification and imputation tasks under a single logarithmic loss function. Using synthetic and publicly available real-world datasets, spanning applications in medicine, energy, and astronomy, we demonstrate performance competitive with state-of-the-art ML approaches, but with the key advantage of encoding the full joint probability distribution learned from the data, which is useful for analyzing and interpreting its underlying structure. This manuscript is supplemented with the release of a publicly available code package MPSTime that implements our approach. The effectiveness of the MPS-based ansatz for capturing complex correlation structures in time-series data makes it a powerful foundation for tackling challenging time-series analysis problems across science, industry, and medicine.

Related papers

• Comparing Quantum Machine Learning Approaches in Astrophysical Signal Detection [1.2124551005857038]
  A four-step quantum machine learning (QML) workflow is proposed.<n>Different techniques and models are investigated within a case study centered on the Gamma-Ray Bursts (GRB) signal detection in the astrophysics domain.
  arXiv  Detail & Related papers  (2025-07-14T16:16:58Z)
• TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agents [52.13094810313054]
  TimeCAP is a time-series processing framework that creatively employs Large Language Models (LLMs) as contextualizers of time series data. TimeCAP incorporates two independent LLM agents: one generates a textual summary capturing the context of the time series, while the other uses this enriched summary to make more informed predictions. Experimental results on real-world datasets demonstrate that TimeCAP outperforms state-of-the-art methods for time series event prediction.
  arXiv  Detail & Related papers  (2025-02-17T04:17:27Z)
• Non-stationary and Sparsely-correlated Multi-output Gaussian Process with Spike-and-Slab Prior [0.0]
  Multi-output Gaussian process (MGP) is commonly used as a transfer learning method. This study proposes a non-stationary MGP model that can capture both the dynamic and sparse correlation among outputs.
  arXiv  Detail & Related papers  (2024-09-05T00:56:25Z)
• Near-Optimal Learning and Planning in Separated Latent MDPs [70.88315649628251]
  We study computational and statistical aspects of learning Latent Markov Decision Processes (LMDPs) In this model, the learner interacts with an MDP drawn at the beginning of each epoch from an unknown mixture of MDPs.
  arXiv  Detail & Related papers  (2024-06-12T06:41:47Z)
• Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection [67.60791405198063]
  We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection. CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module. A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
  arXiv  Detail & Related papers  (2023-07-17T11:04:27Z)
• Bootstrap aggregation and confidence measures to improve time series causal discovery [0.0]
  We introduce a novel bootstrap approach designed for time series causal discovery that preserves the temporal dependencies and lag structure. We combine this approach with the state-of-the-art conditional-independence-based algorithm PCMCI+.
  arXiv  Detail & Related papers  (2023-06-15T08:37:16Z)
• Time Associated Meta Learning for Clinical Prediction [78.99422473394029]
  We propose a novel time associated meta learning (TAML) method to make effective predictions at multiple future time points. To address the sparsity problem after task splitting, TAML employs a temporal information sharing strategy to augment the number of positive samples. We demonstrate the effectiveness of TAML on multiple clinical datasets, where it consistently outperforms a range of strong baselines.
  arXiv  Detail & Related papers  (2023-03-05T03:54:54Z)
• TemporAI: Facilitating Machine Learning Innovation in Time Domain Tasks for Medicine [91.3755431537592]
  TemporAI is an open source Python software library for machine learning (ML) tasks involving data with a time component. It supports data in time series, static, and eventmodalities and provides an interface for prediction, causal inference, and time-to-event analysis.
  arXiv  Detail & Related papers  (2023-01-28T17:57:53Z)
• Self-learning locally-optimal hypertuning using maximum entropy, and comparison of machine learning approaches for estimating fatigue life in composite materials [0.0]
  We develop an ML nearest-neighbors-alike algorithm based on the principle of maximum entropy to predict fatigue damage. The predictions achieve a good level of accuracy, similar to other ML algorithms.
  arXiv  Detail & Related papers  (2022-10-19T12:20:07Z)
• Combining Machine Learning and Agent-Based Modeling to Study Biomedical Systems [0.0]
  Agent-based modeling (ABM) is a well-established paradigm for simulating complex systems via interactions between constituent entities. Machine learning (ML) refers to approaches whereby statistical algorithms 'learn from data on their own, without imposing a priori theories of system behavior.
  arXiv  Detail & Related papers  (2022-06-02T15:19:09Z)
• TACTiS: Transformer-Attentional Copulas for Time Series [76.71406465526454]
  estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. We propose a versatile method that estimates joint distributions using an attention-based decoder. We show that our model produces state-of-the-art predictions on several real-world datasets.
  arXiv  Detail & Related papers  (2022-02-07T21:37:29Z)
• Learning summary features of time series for likelihood free inference [93.08098361687722]
  We present a data-driven strategy for automatically learning summary features from time series data. Our results indicate that learning summary features from data can compete and even outperform LFI methods based on hand-crafted values.
  arXiv  Detail & Related papers  (2020-12-04T19:21:37Z)
• A GRU-based Mixture Density Network for Data-Driven Dynamic Stochastic Programming [15.517550827358104]
  We propose an innovative data-driven dynamic programming (DD-DSP) framework for time-series decision-making problem. Specifically, we devise a deep neural network that integrates GRU and Gaussian Mixture Model (GMM) Our framework is superior to data-driven optimization based on LSTM with the vehicle average moving lower than LSTM.
  arXiv  Detail & Related papers  (2020-06-26T15:42:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.