KnitCity: a machine learning-based, game-theoretical framework for prediction assessment and seismic risk policy design

• URL: http://arxiv.org/abs/2205.02679v1
• Date: Thu, 5 May 2022 14:38:03 GMT
• Title: KnitCity: a machine learning-based, game-theoretical framework for prediction assessment and seismic risk policy design
• Authors: Ad\`ele Douin, J. P. Bruneton, Fr\'ed\'eric Lechenault
• Abstract summary: We introduce a framework that allows to design, evaluate and compare not only predictors but also decision-making policies. We construct efficient policies using a reinforcement learning environment and various time-series predictors based on artificial neural networks.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Knitted fabric exhibits avalanche-like events when deformed: by analogy with eathquakes, we are interested in predicting these "knitquakes". However, as in most analogous seismic models, the peculiar statistics of the corresponding time-series severely jeopardize this endeavour, due to the time intermittence and scale-invariance of these events. But more importantly, such predictions are hard to {\it assess}: depending on the choice of what to predict, the results can be very different and not easily compared. Furthermore, forecasting models may be trained with various generic metrics which ignore some important specificities of the problem at hand, in our case seismic risk. Finally, these models often do not provide a clear strategy regarding the best way to use these predictions in practice. Here we introduce a framework that allows to design, evaluate and compare not only predictors but also decision-making policies: a model seismically active {\it city} subjected to the crackling dynamics observed in the mechanical response of knitted fabric. We thus proceed to study the population of KnitCity, introducing a policy through which the mayor of the town can decide to either keep people in, which in case of large events cause human loss, or evacuate the city, which costs a daily fee. The policy only relies on past seismic observations. We construct efficient policies using a reinforcement learning environment and various time-series predictors based on artificial neural networks. By inducing a physically motivated metric on the predictors, this mechanism allows quantitative assessment and comparison of their relevance in the decision-making process.

Related papers

• An Introduction to Deep Survival Analysis Models for Predicting Time-to-Event Outcomes [5.257719744958367]
  Time-to-event outcomes have been studied extensively within the field of survival analysis. Monograph aims to provide a reasonably self-contained modern introduction to survival analysis.
  arXiv  Detail & Related papers  (2024-10-01T21:29:17Z)
• Performative Time-Series Forecasting [71.18553214204978]
  We formalize performative time-series forecasting (PeTS) from a machine-learning perspective. We propose a novel approach, Feature Performative-Shifting (FPS), which leverages the concept of delayed response to anticipate distribution shifts. We conduct comprehensive experiments using multiple time-series models on COVID-19 and traffic forecasting tasks.
  arXiv  Detail & Related papers  (2023-10-09T18:34:29Z)
• Robustness Evaluation of Regression Tasks with Skewed Domain Preferences [3.42658286826597]
  We deal with two encapsulated problems simultaneously. First, assessing the performance of regression models when non-uniform preferences apply. Second, assessing the robustness of models when dealing with uncertainty regarding the actual underlying distribution of values relevant for such problems.
  arXiv  Detail & Related papers  (2022-12-15T00:37:41Z)
• Mining Causality from Continuous-time Dynamics Models: An Application to Tsunami Forecasting [22.434845478979604]
  We propose a mechanism for mining causal structures from continuous-time models. We train models to capture the causal structure by enforcing sparsity in the weights of the input layers of the dynamics models. We apply our method to a real-world problem, namely tsunami forecasting, where the exact causal-structures are difficult to characterize.
  arXiv  Detail & Related papers  (2022-10-10T18:53:13Z)
• Predictive Multiplicity in Probabilistic Classification [25.111463701666864]
  We present a framework for measuring predictive multiplicity in probabilistic classification. We demonstrate the incidence and prevalence of predictive multiplicity in real-world tasks. Our results emphasize the need to report predictive multiplicity more widely.
  arXiv  Detail & Related papers  (2022-06-02T16:25:29Z)
• Uncertainty estimation of pedestrian future trajectory using Bayesian approximation [137.00426219455116]
  Under dynamic traffic scenarios, planning based on deterministic predictions is not trustworthy. The authors propose to quantify uncertainty during forecasting using approximation which deterministic approaches fail to capture. The effect of dropout weights and long-term prediction on future state uncertainty has been studied.
  arXiv  Detail & Related papers  (2022-05-04T04:23:38Z)
• Dense Uncertainty Estimation [62.23555922631451]
  In this paper, we investigate neural networks and uncertainty estimation techniques to achieve both accurate deterministic prediction and reliable uncertainty estimation. We work on two types of uncertainty estimations solutions, namely ensemble based methods and generative model based methods, and explain their pros and cons while using them in fully/semi/weakly-supervised framework.
  arXiv  Detail & Related papers  (2021-10-13T01:23:48Z)
• Regularizing towards Causal Invariance: Linear Models with Proxies [7.953401800573514]
  We show that a single proxy can be used to create estimators that are prediction optimal under interventions of bounded strength. We show how to extend these estimators to scenarios where additional information about the "test time" intervention is available during training.
  arXiv  Detail & Related papers  (2021-03-03T15:39:35Z)
• Double Robust Representation Learning for Counterfactual Prediction [68.78210173955001]
  We propose a novel scalable method to learn double-robust representations for counterfactual predictions. We make robust and efficient counterfactual predictions for both individual and average treatment effects. The algorithm shows competitive performance with the state-of-the-art on real world and synthetic data.
  arXiv  Detail & Related papers  (2020-10-15T16:39:26Z)
• Counterfactual Predictions under Runtime Confounding [74.90756694584839]
  We study the counterfactual prediction task in the setting where all relevant factors are captured in the historical data. We propose a doubly-robust procedure for learning counterfactual prediction models in this setting.
  arXiv  Detail & Related papers  (2020-06-30T15:49:05Z)
• Performance metrics for intervention-triggering prediction models do not reflect an expected reduction in outcomes from using the model [71.9860741092209]
  Clinical researchers often select among and evaluate risk prediction models. Standard metrics calculated from retrospective data are only related to model utility under certain assumptions. When predictions are delivered repeatedly throughout time, the relationship between standard metrics and utility is further complicated.
  arXiv  Detail & Related papers  (2020-06-02T16:26:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.