The Powers of Precision: Structure-Informed Detection in Complex Systems -- From Customer Churn to Seizure Onset
- URL: http://arxiv.org/abs/2601.21170v2
- Date: Tue, 03 Feb 2026 16:16:38 GMT
- Title: The Powers of Precision: Structure-Informed Detection in Complex Systems -- From Customer Churn to Seizure Onset
- Abstract summary: Emergent phenomena -- onset of epileptic seizures, sudden customer churn, or pandemic outbreaks -- often arise from hidden causal interactions in complex systems.<n>We propose a machine learning method for their early detection that addresses a core challenge: unveiling and harnessing a system's latent causal structure.
- Score: 11.431576667955268
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Emergent phenomena -- onset of epileptic seizures, sudden customer churn, or pandemic outbreaks -- often arise from hidden causal interactions in complex systems. We propose a machine learning method for their early detection that addresses a core challenge: unveiling and harnessing a system's latent causal structure despite the data-generating process being unknown and partially observed. The method learns an optimal feature representation from a one-parameter family of estimators -- powers of the empirical covariance or precision matrix -- offering a principled way to tune in to the underlying structure driving the emergence of critical events. A supervised learning module then classifies the learned representation. We prove structural consistency of the family and demonstrate the empirical soundness of our approach on seizure detection and churn prediction, attaining competitive results in both. Beyond prediction, and toward explainability, we ascertain that the optimal covariance power exhibits evidence of good identifiability while capturing structural signatures, thus reconciling predictive performance with interpretable statistical structure.
Related papers
- K-Models: a Flexible and Interpretable Method for Ordinal Clustering with Application to Antigen-Antibody Interaction Profiles [65.21921642886367]
K-Models is a novel framework that integrates ordinal constraints and estimates key underlying elements of the random process generating the observed functional profiles.<n>The proposed method is evaluated through simulations and real-world applications.
arXiv Detail & Related papers (2026-05-14T13:35:44Z) - Mask2Cause: Causal Discovery via Adjacency Constrained Causal Attention [0.13764085113103217]
We propose an end-to-end framework that recovers the underlying causal graph directly during the forecasting forward pass.<n>We show that inferred causal structures can be used to reduce parameter count of forecasting models by more than 70% on average.
arXiv Detail & Related papers (2026-05-08T05:43:47Z) - Towards Trustworthy Depression Estimation via Disentangled Evidential Learning [50.22167852149165]
We propose EviDep, an evidential learning framework that jointly quantifies depression severity.<n>EviDep enforces strict information integrity to guarantee robust evidence synthesis.<n>It achieves state-of-the-art predictive accuracy and superior uncertainty calibration, delivering a robust fail-safe mechanism for trustworthy clinical screening.
arXiv Detail & Related papers (2026-04-17T13:27:11Z) - Causal-INSIGHT: Probing Temporal Models to Extract Causal Structure [4.718641165826564]
Causal-INSIGHT is a model-agnostic, post-hoc interpretation framework for extracting model-implied (predictor-dependent) directed, time-lagged influence structure from trained temporal predictors.<n>We introduce Qbic, a sparsity-aware graph selection criterion that balances predictive fidelity and structural complexity without requiring ground-truth graph labels.
arXiv Detail & Related papers (2026-03-26T14:16:37Z) - Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention [14.165510655766944]
We develop a novel identifiability theorem, leveraging causal representation learning, to uncover disentangled representations of system parameters.<n>We instantiate system parameter identification as a variational inference problem, leveraging a sparsity-regularised transformer to uncover state-dependent causal structures.
arXiv Detail & Related papers (2026-03-15T17:03:34Z) - Early warning prediction: Onsager-Machlup vs Schrödinger [3.725029656031083]
Predicting critical transitions in complex systems, such as epileptic seizures in the brain, represents a major challenge in scientific research.<n>This study proposes a novel early-warning framework that integrates learning with dynamical system modeling.<n>A new Score Function (SF) indicator is defined by incorporating Schrdinger bridge theory to quantify the likelihood of significant state transitions in the system.
arXiv Detail & Related papers (2026-01-29T03:38:24Z) - Causal Structure and Representation Learning with Biomedical Applications [23.11061319442]
We outline a statistical and computational framework for causal structure and representation learning motivated by fundamental biomedical questions.<n>We show how to effectively use observational and perturbational data to perform causal discovery on observed causal variables.
arXiv Detail & Related papers (2025-11-06T20:17:58Z) - Information-theoretic Quantification of High-order Feature Effects in Classification Problems [0.19791587637442676]
We present an information-theoretic extension of the High-order interactions for Feature importance (Hi-Fi) method.<n>Our framework decomposes feature contributions into unique, synergistic, and redundant components.<n>Results indicate that the proposed estimator accurately recovers theoretical and expected findings.
arXiv Detail & Related papers (2025-07-06T11:50:30Z) - Interpretable, multi-dimensional Evaluation Framework for Causal Discovery from observational i.i.d. Data [3.8443430569753025]
causal discovery from observational data imposes strict identifiability assumptions on the formulation of structural equations utilized in the data generating process.<n>Motivated by the lack of unified performance assessment framework, we introduce an interpretable, six-dimensional evaluation metric, i.e., distance to optimal solution (DOS)<n>This is the first research to assess the performance of structure learning algorithms from seven different families on increasing percentage of non-identifiable, nonlinear causal patterns.
arXiv Detail & Related papers (2024-09-28T15:03:49Z) - Detecting and Identifying Selection Structure in Sequential Data [53.24493902162797]
We argue that the selective inclusion of data points based on latent objectives is common in practical situations, such as music sequences.
We show that selection structure is identifiable without any parametric assumptions or interventional experiments.
We also propose a provably correct algorithm to detect and identify selection structures as well as other types of dependencies.
arXiv Detail & Related papers (2024-06-29T20:56:34Z) - Identifiable Latent Neural Causal Models [82.14087963690561]
Causal representation learning seeks to uncover latent, high-level causal representations from low-level observed data.
We determine the types of distribution shifts that do contribute to the identifiability of causal representations.
We translate our findings into a practical algorithm, allowing for the acquisition of reliable latent causal representations.
arXiv Detail & Related papers (2024-03-23T04:13:55Z) - Nonlinearity, Feedback and Uniform Consistency in Causal Structural
Learning [0.8158530638728501]
Causal Discovery aims to find automated search methods for learning causal structures from observational data.
This thesis focuses on two questions in causal discovery: (i) providing an alternative definition of k-Triangle Faithfulness that (i) is weaker than strong faithfulness when applied to the Gaussian family of distributions, and (ii) under the assumption that the modified version of Strong Faithfulness holds.
arXiv Detail & Related papers (2023-08-15T01:23:42Z) - Deception by Omission: Using Adversarial Missingness to Poison Causal
Structure Learning [12.208616050090027]
Inference of causal structures from observational data is a key component of causal machine learning.
Prior work has demonstrated that adversarial perturbations of completely observed training data may be used to force the learning of inaccurate causal structural models.
This work introduces a novel attack methodology wherein the adversary deceptively omits a portion of the true training data to bias the learned causal structures.
arXiv Detail & Related papers (2023-05-31T17:14:20Z) - Identifying Weight-Variant Latent Causal Models [82.14087963690561]
We find that transitivity acts as a key role in impeding the identifiability of latent causal representations.
Under some mild assumptions, we can show that the latent causal representations can be identified up to trivial permutation and scaling.
We propose a novel method, termed Structural caUsAl Variational autoEncoder, which directly learns latent causal representations and causal relationships among them.
arXiv Detail & Related papers (2022-08-30T11:12:59Z) - Amortized Inference for Causal Structure Learning [72.84105256353801]
Learning causal structure poses a search problem that typically involves evaluating structures using a score or independence test.
We train a variational inference model to predict the causal structure from observational/interventional data.
Our models exhibit robust generalization capabilities under substantial distribution shift.
arXiv Detail & Related papers (2022-05-25T17:37:08Z) - Towards Robust and Adaptive Motion Forecasting: A Causal Representation
Perspective [72.55093886515824]
We introduce a causal formalism of motion forecasting, which casts the problem as a dynamic process with three groups of latent variables.
We devise a modular architecture that factorizes the representations of invariant mechanisms and style confounders to approximate a causal graph.
Experiment results on synthetic and real datasets show that our three proposed components significantly improve the robustness and reusability of the learned motion representations.
arXiv Detail & Related papers (2021-11-29T18:59:09Z) - The Hidden Uncertainty in a Neural Networks Activations [105.4223982696279]
The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data.
This work investigates whether this distribution correlates with a model's epistemic uncertainty, thus indicating its ability to generalise to novel inputs.
arXiv Detail & Related papers (2020-12-05T17:30:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.