Recurrences reveal shared causal drivers of complex time series

• URL: http://arxiv.org/abs/2301.13516v3
• Date: Mon, 02 Dec 2024 07:07:42 GMT
• Title: Recurrences reveal shared causal drivers of complex time series
• Abstract summary: We show that simultaneous recurrence events across multiple time series reveal the structure of their shared unobserved driving signal.<n>We introduce a physics-based unsupervised learning algorithm that reconstructs causal drivers by iteratively building a recurrence graph with glass-like structure.<n>We demonstrate our method's ability to extract causal drivers from diverse experimental datasets spanning ecology, genomics, fluid dynamics, and physiology.
• Score: 7.6146285961466
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Unmeasured causal forces influence diverse experimental time series, such as the transcription factors that regulate genes, or the descending neurons that steer motor circuits. Combining the theory of skew-product dynamical systems with topological data analysis, we show that simultaneous recurrence events across multiple time series reveal the structure of their shared unobserved driving signal. We introduce a physics-based unsupervised learning algorithm that reconstructs causal drivers by iteratively building a recurrence graph with glass-like structure. As the amount of data increases, a percolation transition on this graph leads to weak ergodicity breaking for random walks -- revealing the shared driver's dynamics, even from strongly-corrupted measurements. We relate reconstruction accuracy to the rate of information transfer from a chaotic driver to the response systems, and we find that effective reconstruction proceeds through gradual approximation of the driver's dynamical attractor. Through extensive benchmarks against classical signal processing and machine learning techniques, we demonstrate our method's ability to extract causal drivers from diverse experimental datasets spanning ecology, genomics, fluid dynamics, and physiology.

Related papers

• Invariant Learning Dynamics of Transformers in Inductive Reasoning Tasks [50.79340930913805]
  We study a class of inductive tasks that unifies several synthetic tasks known in the literature, including in-context n-grams and multi-hop reasoning.<n>By casting circuit formation as a low-dimensional dynamical phenomenon, we take a step toward a predictive theory of how Transformers learn.
  arXiv  Detail & Related papers  (2026-07-13T17:56:11Z)
• Controlled Dynamics Attractor Transformer [58.15454173718687]
  Transformer architectures have advanced representation learning and inference in deep models through self-attention mechanisms.<n>In parallel,associative memory (AM) frameworks map representations onto energy landscapes, offering interpretable retrieval mechanisms.<n>We propose Controlled Dynamics Attractor Transformer (CCAT), which couples a mixture von Mises-Fisher (Mo-vMF) attention energy with a Hopfield refinement energy.<n>CCAT achieves state-of-the-art performance across multiple benchmarks in graph anomaly detection and graph classification.
  arXiv  Detail & Related papers  (2026-06-13T09:04:22Z)
• Physics as the Inductive Bias for Causal Discovery [7.9653270330458446]
  Causal discovery is often a data-driven paradigm to analyze complex real-world systems.<n>We develop a scalable sparsity-inducing MLE algorithm that exploits causal graph structure for efficient parameter estimation.
  arXiv  Detail & Related papers  (2026-02-03T23:42:01Z)
• Transformer Learning of Chaotic Collective Dynamics in Many-Body Systems [0.0]
  We show that a self-attention-based transformer framework provides an effective approach for modeling chaotic collective dynamics.<n>We study the one-dimensional semiclassical Holstein model, where interaction quenches induce strongly nonlinear and chaotic dynamics.<n>Our results establish self-attention as a powerful mechanism for learning effective reduced dynamics in chaotic many-body systems.
  arXiv  Detail & Related papers  (2026-01-27T01:33:33Z)
• Latent Causal Diffusions for Single-Cell Perturbation Modeling [83.47931153555321]
  We present a generative model that frames single-cell gene expression as a stationary diffusion process observed under measurement noise.<n> LCD outperforms established approaches in predicting the distributional shifts of unseen perturbation combinations in single-cell RNA-sequencing screens.<n>We develop an approach we call causal linearization via perturbation responses (CLIPR), which yields an approximation of the direct causal effects between all genes.
  arXiv  Detail & Related papers  (2026-01-20T16:15:38Z)
• Langevin Flows for Modeling Neural Latent Dynamics [81.81271685018284]
  We introduce LangevinFlow, a sequential Variational Auto-Encoder where the time evolution of latent variables is governed by the underdamped Langevin equation.<n>Our approach incorporates physical priors -- such as inertia, damping, a learned potential function, and forces -- to represent both autonomous and non-autonomous processes in neural systems.<n>Our method outperforms state-of-the-art baselines on synthetic neural populations generated by a Lorenz attractor.
  arXiv  Detail & Related papers  (2025-07-15T17:57:48Z)
• Scientific Machine Learning of Chaotic Systems Discovers Governing Equations for Neural Populations [0.05804487044220691]
  We introduce the PEM-UDE method to extract interpretable mathematical expressions from chaotic dynamical systems.<n>When applied to neural populations, our method derives novel governing equations that respect biological constraints.<n>These equations predict an emergent relationship between connection density and both oscillation frequency and synchrony in neural circuits.
  arXiv  Detail & Related papers  (2025-07-04T14:57:58Z)
• Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks [59.552873049024775]
  We show that compute-optimally trained models exhibit a remarkably precise universality.<n>With learning rate decay, the collapse becomes so tight that differences in the normalized curves across models fall below the noise floor.<n>We explain these phenomena by connecting collapse to the power-law structure in typical neural scaling laws.
  arXiv  Detail & Related papers  (2025-07-02T20:03:34Z)
• A Driving Regime-Embedded Deep Learning Framework for Modeling Intra-Driver Heterogeneity in Multi-Scale Car-Following Dynamics [5.579243411257874]
  We propose a novel data-driven car-following framework that embeds discrete driving regimes into vehicular motion predictions.<n>The proposed hybrid deep learning architecture combines Gated Recurrent Units for discrete driving regime classification with Long Short-Term Memory networks for continuous kinematic prediction.<n>The framework significantly reduces prediction errors for acceleration (maximum MSE improvement reached 58.47%), speed, and spacing metrics while reproducing critical traffic phenomena.
  arXiv  Detail & Related papers  (2025-06-06T09:19:33Z)
• The emergence of sparse attention: impact of data distribution and benefits of repetition [14.652502263025882]
  We study the emergence over training of sparse attention, a critical and frequently observed attention pattern in Transformers.<n>By combining theoretical analysis of a toy model with empirical observations on small Transformers trained on a linear regression variant, we uncover the mechanics sparse attention emergence.<n>Our findings provide a simple, theoretically grounded framework for understanding how data distributions and model design influence the learning dynamics behind one form of emergence.
  arXiv  Detail & Related papers  (2025-05-23T13:14:02Z)
• Inference of hidden common driver dynamics by anisotropic self-organizing neural networks [0.0]
  We introduce a novel approach to infer the underlying dynamics of hidden common drivers. The inference relies on time-delay embedding, estimation of the intrinsic dimension of the observed systems.
  arXiv  Detail & Related papers  (2025-04-02T15:17:23Z)
• Communities in the Kuramoto Model: Dynamics and Detection via Path Signatures [1.024113475677323]
  We propose a mathematical framework that encodes geometric and temporal properties of continuous paths to address this problem. Path signatures provide a reparametrization-invariant characterization of dynamical data. We propose a novel signature-based community detection algorithm, achieving exact recovery of structural communities from observed time series.
  arXiv  Detail & Related papers  (2025-03-21T21:41:48Z)
• Learning and Current Prediction of PMSM Drive via Differential Neural Networks [13.370017978792479]
  This study presents a novel approach utilizing differential neural networks (DNNs) to model nonlinear systems. The efficacy of our approach is validated through experiments conducted under various load disturbances and no-load conditions.
  arXiv  Detail & Related papers  (2024-12-12T07:43:27Z)
• A Differential Smoothness-based Compact-Dynamic Graph Convolutional Network for Spatiotemporal Signal Recovery [9.369246678101048]
  This paper proposes a Compact-fold Con Graphal Network (CDCN) fortemporal signal recovery. Experiments on real-world datasets show that CDCN significantly outperforms the state-of-the-art models fortemporal signal recovery.
  arXiv  Detail & Related papers  (2024-08-06T06:42:53Z)
• Nested replicator dynamics, nested logit choice, and similarity-based learning [56.98352103321524]
  We consider a model of learning and evolution in games with action sets endowed with a partition-based similarity structure. In this model, revising agents have a higher probability of comparing their current strategy with other strategies that they deem similar. Because of this implicit bias toward similar strategies, the resulting dynamics do not satisfy any of the standard monotonicity rationalitys for imitative game dynamics.
  arXiv  Detail & Related papers  (2024-07-25T07:09:53Z)
• Delay Embedding Theory of Neural Sequence Models [6.294884163829946]
  Theory of delay embeddings in dynamical systems prove that unobserved variables can be recovered from the history of only a handful of observed variables. We measure the capacities of sequence models to reconstruct unobserved dynamics.
  arXiv  Detail & Related papers  (2024-06-17T18:07:16Z)
• Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks [59.38765771221084]
  We present a physiologically inspired speech recognition architecture compatible and scalable with deep learning frameworks. We show end-to-end gradient descent training leads to the emergence of neural oscillations in the central spiking neural network. Our findings highlight the crucial inhibitory role of feedback mechanisms, such as spike frequency adaptation and recurrent connections, in regulating and synchronising neural activity to improve recognition performance.
  arXiv  Detail & Related papers  (2024-04-22T09:40:07Z)
• Multi-modal Causal Structure Learning and Root Cause Analysis [67.67578590390907]
  We propose Mulan, a unified multi-modal causal structure learning method for root cause localization. We leverage a log-tailored language model to facilitate log representation learning, converting log sequences into time-series data. We also introduce a novel key performance indicator-aware attention mechanism for assessing modality reliability and co-learning a final causal graph.
  arXiv  Detail & Related papers  (2024-02-04T05:50:38Z)
• AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regression [2.07180164747172]
  We develop a framework that learns mathematical expressions modeling complex dynamical behaviors. We train a small neural network to learn the dynamics of a system, its rate of change in time, and missing model terms. This, in turn, enables us to predict the future evolution of the dynamical behavior.
  arXiv  Detail & Related papers  (2023-12-21T18:58:41Z)
• Let's do the time-warp-attend: Learning topological invariants of dynamical systems [3.9735602856280132]
  We propose a data-driven, physically-informed deep-learning framework for classifying dynamical regimes and characterizing bifurcation boundaries. We focus on the paradigmatic case of the supercritical Hopf bifurcation, which is used to model periodic dynamics across a range of applications. Our method provides valuable insights into the qualitative, long-term behavior of a wide range of dynamical systems, and can detect bifurcations or catastrophic transitions in large-scale physical and biological systems.
  arXiv  Detail & Related papers  (2023-12-14T18:57:16Z)
• Engineering Transport via Collisional Noise: a Toolbox for Biology Systems [44.99833362998488]
  We study a generalised XXZ model in the presence of collision noise, which allows to describe environments beyond the standard Markovian formulation. Results constitute an example of the essential building blocks for the understanding of quantum transport in noisy and warm disordered environments.
  arXiv  Detail & Related papers  (2023-11-15T12:55:28Z)
• Interpretable Imitation Learning with Dynamic Causal Relations [65.18456572421702]
  We propose to expose captured knowledge in the form of a directed acyclic causal graph. We also design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs. The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner.
  arXiv  Detail & Related papers  (2023-09-30T20:59:42Z)
• Neural-network solutions to stochastic reaction networks [7.021105583098606]
  We propose a machine-learning approach using the variational autoregressive network to solve the chemical master equation. The proposed approach tracks the time evolution of the joint probability distribution in the state space of species counts. We demonstrate that it accurately generates the probability distribution over time in the genetic toggle switch and the early life self-replicator.
  arXiv  Detail & Related papers  (2022-09-29T07:27:59Z)
• Reminiscence of classical chaos in driven transmons [117.851325578242]
  We show that even off-resonant drives can cause strong modifications to the structure of the transmon spectrum rendering a large part of it chaotic. Results lead to a photon number threshold characterizing the appearance of chaos-induced quantum demolition effects.
  arXiv  Detail & Related papers  (2022-07-19T16:04:46Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrence [0.0]
  Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs) This paper presents a computational technique to learn the fine-scale dynamics from such coarsely observed data.
  arXiv  Detail & Related papers  (2022-06-03T20:28:52Z)
• Convolutional generative adversarial imputation networks for spatio-temporal missing data in storm surge simulations [86.5302150777089]
  Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods. We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
  arXiv  Detail & Related papers  (2021-11-03T03:50:48Z)
• Learning Neural Causal Models with Active Interventions [83.44636110899742]
  We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process. Our method significantly reduces the required number of interactions compared with random intervention targeting. We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
  arXiv  Detail & Related papers  (2021-09-06T13:10:37Z)
• A Predictive Coding Account for Chaotic Itinerancy [68.8204255655161]
  We show how a recurrent neural network implementing predictive coding can generate neural trajectories similar to chaotic itinerancy in the presence of input noise. We propose two scenarios generating random and past-independent attractor switching trajectories using our model.
  arXiv  Detail & Related papers  (2021-06-16T16:48:14Z)
• Consistency of mechanistic causal discovery in continuous-time using Neural ODEs [85.7910042199734]
  We consider causal discovery in continuous-time for the study of dynamical systems. We propose a causal discovery algorithm based on penalized Neural ODEs.
  arXiv  Detail & Related papers  (2021-05-06T08:48:02Z)
• Neural Relational Inference with Efficient Message Passing Mechanisms [10.329082213561785]
  This paper introduces efficient message passing mechanisms to the graph neural networks with structural prior knowledge to address these problems. A relation interaction mechanism is proposed to capture the coexistence of all relations and atemporal message passing mechanism is proposed to use historical information to alleviate error accumulation.
  arXiv  Detail & Related papers  (2021-01-23T11:27:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.