Causal Interventional Prediction System for Robust and Explainable Effect Forecasting

• URL: http://arxiv.org/abs/2407.19688v1
• Date: Mon, 29 Jul 2024 04:16:45 GMT
• Title: Causal Interventional Prediction System for Robust and Explainable Effect Forecasting
• Authors: Zhixuan Chu, Hui Ding, Guang Zeng, Shiyu Wang, Yiming Li,
• Abstract summary: We explore the robustness and explainability of AI-based forecasting systems. We design a causal interventional prediction system (CIPS) based on a variational autoencoder and fully conditional specification of multiple imputations.
• Score: 14.104665282086339
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although the widespread use of AI systems in today's world is growing, many current AI systems are found vulnerable due to hidden bias and missing information, especially in the most commonly used forecasting system. In this work, we explore the robustness and explainability of AI-based forecasting systems. We provide an in-depth analysis of the underlying causality involved in the effect prediction task and further establish a causal graph based on treatment, adjustment variable, confounder, and outcome. Correspondingly, we design a causal interventional prediction system (CIPS) based on a variational autoencoder and fully conditional specification of multiple imputations. Extensive results demonstrate the superiority of our system over state-of-the-art methods and show remarkable versatility and extensibility in practice.

Related papers

• The Significance of Latent Data Divergence in Predicting System Degradation [1.2058600649065616]
  Condition-Based Maintenance is pivotal in enabling the early detection of potential failures in engineering systems. We introduce a novel methodology grounded in the analysis of statistical similarity within latent data from system components. We infer the similarity between systems by evaluating the divergence of these priors, offering a nuanced understanding of individual system behaviors.
  arXiv  Detail & Related papers  (2024-06-13T11:41:20Z)
• Towards an end-to-end artificial intelligence driven global weather forecasting system [57.5191940978886]
  We present an AI-based data assimilation model, i.e., Adas, for global weather variables. We demonstrate that Adas can assimilate global observations to produce high-quality analysis, enabling the system operate stably for long term. We are the first to apply the methods to real-world scenarios, which is more challenging and has considerable practical application potential.
  arXiv  Detail & Related papers  (2023-12-18T09:05:28Z)
• Performative Time-Series Forecasting [71.18553214204978]
  We formalize performative time-series forecasting (PeTS) from a machine-learning perspective. We propose a novel approach, Feature Performative-Shifting (FPS), which leverages the concept of delayed response to anticipate distribution shifts. We conduct comprehensive experiments using multiple time-series models on COVID-19 and traffic forecasting tasks.
  arXiv  Detail & Related papers  (2023-10-09T18:34:29Z)
• Unsupervised Quality Prediction for Improved Single-Frame and Weighted Sequential Visual Place Recognition [20.737660223671003]
  We present a new, training-free approach to predicting the likely quality of localization estimates. We use these predictions to bias a sequence-matching process to produce additional performance gains. Our system is lightweight, runs in real-time and is agnostic to the underlying VPR technique.
  arXiv  Detail & Related papers  (2023-07-04T03:53:05Z)
• Multi Agent System for Machine Learning Under Uncertainty in Cyber Physical Manufacturing System [78.60415450507706]
  Recent advancements in predictive machine learning has led to its application in various use cases in manufacturing. Most research focused on maximising predictive accuracy without addressing the uncertainty associated with it. In this paper, we determine the sources of uncertainty in machine learning and establish the success criteria of a machine learning system to function well under uncertainty.
  arXiv  Detail & Related papers  (2021-07-28T10:28:05Z)
• Beyond Predictions in Neural ODEs: Identification and Interventions [4.257168718582631]
  Given large amounts of observational data about a system, can we uncover the rules that govern its evolution? We show that combining simple regularization schemes with flexible neural ODEs can robustly recover the dynamics and causal structures from time-series data. We conclude by showing that we can also make accurate predictions under interventions on variables or the system itself.
  arXiv  Detail & Related papers  (2021-06-23T14:35:38Z)
• Learning Dependencies in Distributed Cloud Applications to Identify and Localize Anomalies [58.88325379746632]
  We present Arvalus and its variant D-Arvalus, a neural graph transformation method that models system components as nodes and their dependencies as edges to improve the identification and localization of anomalies. Given a series of metric, our method predicts the most likely system state - either normal or an anomaly class - and performs localization when an anomaly is detected. The evaluation shows the generally good prediction performance of Arvalus and reveals the advantage of D-Arvalus which incorporates information about system component dependencies.
  arXiv  Detail & Related papers  (2021-03-09T06:34:05Z)
• Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems [65.44033635330604]
  We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system. We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid.
  arXiv  Detail & Related papers  (2020-10-08T20:25:52Z)
• An Uncertainty-based Human-in-the-loop System for Industrial Tool Wear Analysis [68.8204255655161]
  We show that uncertainty measures based on Monte-Carlo dropout in the context of a human-in-the-loop system increase the system's transparency and performance. A simulation study demonstrates that the uncertainty-based human-in-the-loop system increases performance for different levels of human involvement.
  arXiv  Detail & Related papers  (2020-07-14T15:47:37Z)
• Predictability limit of partially observed systems [9.029961759984943]
  Applications from finance to epidemiology require accurate forecasts of dynamic phenomena, which are often only partially observed. We quantify the loss of predictability due to sampling, and show that it cannot be recovered by using external signals. We validate the generality of our theoretical findings in real-world partially observed systems representing infectious disease outbreaks, online discussions, and software development projects.
  arXiv  Detail & Related papers  (2020-01-17T22:06:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.