An information-geometric approach to feature extraction and moment reconstruction in dynamical systems

• URL: http://arxiv.org/abs/2004.02172v1
• Date: Sun, 5 Apr 2020 12:07:21 GMT
• Title: An information-geometric approach to feature extraction and moment reconstruction in dynamical systems
• Authors: Suddhasattwa Das, Dimitrios Giannakis, Enik\H{o} Sz\'ekely
• Abstract summary: We show that orbits of a dynamical system induce probability measures over the measurable space defined by (partial) observations of the system. We show that the evolution of the moments of the dynamics-dependent probability measures can be related to a time-averaging operator on the original dynamical system. We present applications to ergodic dynamical systems on the 2-torus and the Lorenz 63 system.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a dimension reduction framework for feature extraction and moment reconstruction in dynamical systems that operates on spaces of probability measures induced by observables of the system rather than directly in the original data space of the observables themselves as in more conventional methods. Our approach is based on the fact that orbits of a dynamical system induce probability measures over the measurable space defined by (partial) observations of the system. We equip the space of these probability measures with a divergence, i.e., a distance between probability distributions, and use this divergence to define a kernel integral operator. The eigenfunctions of this operator create an orthonormal basis of functions that capture different timescales of the dynamical system. One of our main results shows that the evolution of the moments of the dynamics-dependent probability measures can be related to a time-averaging operator on the original dynamical system. Using this result, we show that the moments can be expanded in the eigenfunction basis, thus opening up the avenue for nonparametric forecasting of the moments. If the collection of probability measures is itself a manifold, we can in addition equip the statistical manifold with the Riemannian metric and use techniques from information geometry. We present applications to ergodic dynamical systems on the 2-torus and the Lorenz 63 system, and show on a real-world example that a small number of eigenvectors is sufficient to reconstruct the moments (here the first four moments) of an atmospheric time series, i.e., the realtime multivariate Madden-Julian oscillation index.

Related papers

• Inferring Kernel $ε$-Machines: Discovering Structure in Complex Systems [49.1574468325115]
  We introduce causal diffusion components that encode the kernel causal-state estimates as a set of coordinates in a reduced dimension space. We show how each component extracts predictive features from data and demonstrate their application on four examples.
  arXiv  Detail & Related papers  (2024-10-01T21:14:06Z)
• Autoregressive with Slack Time Series Model for Forecasting a Partially-Observed Dynamical Time Series [3.0232957374216953]
  We introduce the autoregressive with slack time series (ARS) model, that simultaneously estimates the evolution function and imputes missing variables as a slack time series. From a theoretical perspective, we prove that a 2-dimensional time-invariant and linear system can be reconstructed by utilizing observations from a single, partially observed dimension of the system.
  arXiv  Detail & Related papers  (2023-06-28T23:07:43Z)
• An information field theory approach to Bayesian state and parameter estimation in dynamical systems [0.0]
  This paper develops a scalable Bayesian approach to state and parameter estimation suitable for continuous-time, deterministic dynamical systems. We construct a physics-informed prior probability measure on the function space of system responses so that functions that satisfy the physics are more likely.
  arXiv  Detail & Related papers  (2023-06-03T16:36:43Z)
• Continuously Monitored Quantum Systems beyond Lindblad Dynamics [68.8204255655161]
  We study the probability distribution of the expectation value of a given observable over the possible quantum trajectories. The measurements are applied to the entire system, having the effect of projecting the system into a product state.
  arXiv  Detail & Related papers  (2023-05-06T18:09:17Z)
• Initial Correlations in Open Quantum Systems: Constructing Linear Dynamical Maps and Master Equations [62.997667081978825]
  We show that, for any predetermined initial correlations, one can introduce a linear dynamical map on the space of operators of the open system. We demonstrate that this construction leads to a linear, time-local quantum master equation with generalized Lindblad structure.
  arXiv  Detail & Related papers  (2022-10-24T13:43:04Z)
• Semi-supervised Learning of Partial Differential Operators and Dynamical Flows [68.77595310155365]
  We present a novel method that combines a hyper-network solver with a Fourier Neural Operator architecture. We test our method on various time evolution PDEs, including nonlinear fluid flows in one, two, and three spatial dimensions. The results show that the new method improves the learning accuracy at the time point of supervision point, and is able to interpolate and the solutions to any intermediate time.
  arXiv  Detail & Related papers  (2022-07-28T19:59:14Z)
• Neural-Network Quantum States for Periodic Systems in Continuous Space [66.03977113919439]
  We introduce a family of neural quantum states for the simulation of strongly interacting systems in the presence of periodicity. For one-dimensional systems we find very precise estimations of the ground-state energies and the radial distribution functions of the particles. In two dimensions we obtain good estimations of the ground-state energies, comparable to results obtained from more conventional methods.
  arXiv  Detail & Related papers  (2021-12-22T15:27:30Z)
• Operational approach to metastability [0.0]
  We introduce an information-theoretic approach for considering changes in dynamics of finitely dimensional open quantum systems governed by master equations. In turn, we establish a quantitative description of the phenomenon of metastability in open quantum systems.
  arXiv  Detail & Related papers  (2021-04-11T20:25:27Z)
• Functional Space Analysis of Local GAN Convergence [26.985600125290908]
  We study the local dynamics of adversarial training in the general functional space. We show how it can be represented as a system of partial differential equations. Our perspective reveals several insights on the practical tricks commonly used to stabilize GANs.
  arXiv  Detail & Related papers  (2021-02-08T18:59:46Z)
• Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems [65.44033635330604]
  We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system. We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid.
  arXiv  Detail & Related papers  (2020-10-08T20:25:52Z)
• Kernel-based parameter estimation of dynamical systems with unknown observation functions [15.1749038371963]
  A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal. Can we estimate the underlying system's parameters by measuring its time-evolution only once? Key information for performing this estimation lies in the temporal inter-dependencies between the signal and the model.
  arXiv  Detail & Related papers  (2020-09-09T07:29:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.