Using a Local Surrogate Model to Interpret Temporal Shifts in Global Annual Data

• URL: http://arxiv.org/abs/2404.11874v1
• Date: Thu, 18 Apr 2024 03:17:45 GMT
• Title: Using a Local Surrogate Model to Interpret Temporal Shifts in Global Annual Data
• Authors: Shou Nakano, Yang Liu,
• Abstract summary: This paper focuses on explaining changes over time in globally-sourced, annual temporal data. We employ Local Interpretable Model-agnostic Explanations (LIME) to shed light on national happiness indices, economic freedom, and population metrics.
• Score: 5.669106489320257
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This paper focuses on explaining changes over time in globally-sourced, annual temporal data, with the specific objective of identifying pivotal factors that contribute to these temporal shifts. Leveraging such analytical frameworks can yield transformative impacts, including the informed refinement of public policy and the identification of key drivers affecting a country's economic evolution. We employ Local Interpretable Model-agnostic Explanations (LIME) to shed light on national happiness indices, economic freedom, and population metrics, spanning variable time frames. Acknowledging the presence of missing values, we employ three imputation approaches to generate robust multivariate time-series datasets apt for LIME's input requirements. Our methodology's efficacy is substantiated through a series of empirical evaluations involving multiple datasets. These evaluations include comparative analyses against random feature selection, correlation with real-world events as elucidated by LIME, and validation through Individual Conditional Expectation (ICE) plots, a state-of-the-art technique proficient in feature importance detection.

Related papers

• Context is Key: A Benchmark for Forecasting with Essential Textual Information [87.3175915185287]
  "Context is Key" (CiK) is a time series forecasting benchmark that pairs numerical data with diverse types of carefully crafted textual context. We evaluate a range of approaches, including statistical models, time series foundation models, and LLM-based forecasters. Our experiments highlight the importance of incorporating contextual information, demonstrate surprising performance when using LLM-based forecasting models, and also reveal some of their critical shortcomings.
  arXiv  Detail & Related papers  (2024-10-24T17:56:08Z)
• PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
  We propose a. Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
  arXiv  Detail & Related papers  (2024-06-04T13:51:08Z)
• Adaptive Global-Local Representation Learning and Selection for Cross-Domain Facial Expression Recognition [54.334773598942775]
  Domain shift poses a significant challenge in Cross-Domain Facial Expression Recognition (CD-FER) We propose an Adaptive Global-Local Representation Learning and Selection framework.
  arXiv  Detail & Related papers  (2024-01-20T02:21:41Z)
• TimeDRL: Disentangled Representation Learning for Multivariate Time-Series [10.99576829280084]
  TimeDRL is a generic time-series representation learning framework with disentangled dual-level embeddings. TimeDRL consistently surpasses existing representation learning approaches, achieving an average improvement of 58.02% in MSE and classification by 1.48% in accuracy.
  arXiv  Detail & Related papers  (2023-12-07T08:56:44Z)
• Robust Stance Detection: Understanding Public Perceptions in Social Media [15.460495567765362]
  stance detection identifies precise positions relative to a well-defined topic. Traditional stance detection models often lag in performance when applied to new domains and topics. A solution we present in this paper combines counterfactual data augmentation with contrastive learning to enhance the robustness of stance detection.
  arXiv  Detail & Related papers  (2023-09-26T18:19:51Z)
• Decoupling Local and Global Representations of Time Series [38.73548222141307]
  We propose a novel generative approach for learning representations for the global and local factors of variation in time series. In experiments, we demonstrate successful recovery of the true local and global variability factors on simulated data. We believe that the proposed way of defining representations is beneficial for data modelling and yields better insights into the complexity of real-world data.
  arXiv  Detail & Related papers  (2022-02-04T17:46:04Z)
• Stateful Offline Contextual Policy Evaluation and Learning [88.9134799076718]
  We study off-policy evaluation and learning from sequential data. We formalize the relevant causal structure of problems such as dynamic personalized pricing. We show improved out-of-sample policy performance in this class of relevant problems.
  arXiv  Detail & Related papers  (2021-10-19T16:15:56Z)
• An Information-theoretic Approach to Distribution Shifts [9.475039534437332]
  Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere. neural networks that are fit to a subset of the population might carry some selection bias into their decision process.
  arXiv  Detail & Related papers  (2021-06-07T16:44:21Z)
• Combating Temporal Drift in Crisis with Adapted Embeddings [58.4558720264897]
  Language usage changes over time, and this can impact the effectiveness of NLP systems. This work investigates methods for adapting to changing discourse during crisis events.
  arXiv  Detail & Related papers  (2021-04-17T13:11:41Z)
• Domain Adaptative Causality Encoder [52.779274858332656]
  We leverage the characteristics of dependency trees and adversarial learning to address the tasks of adaptive causality identification and localisation. We present a new causality dataset, namely MedCaus, which integrates all types of causality in the text.
  arXiv  Detail & Related papers  (2020-11-27T04:14:55Z)
• Statistical Analytics and Regional Representation Learning for COVID-19 Pandemic Understanding [4.731074162093199]
  The rapid spread of the novel coronavirus (COVID-19) has severely impacted almost all countries around the world. This paper combines and processes an extensive collection of publicly available datasets to provide a unified information source. A specific RNN-based inference pipeline called DoubleWindowLSTM-CP is proposed in this work for predictive event modeling.
  arXiv  Detail & Related papers  (2020-08-08T03:35:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.