Using a Local Surrogate Model to Interpret Temporal Shifts in Global Annual Data

• URL: http://arxiv.org/abs/2404.11874v1
• Date: Thu, 18 Apr 2024 03:17:45 GMT
• Title: Using a Local Surrogate Model to Interpret Temporal Shifts in Global Annual Data
• Authors: Shou Nakano, Yang Liu,
• Abstract summary: This paper focuses on explaining changes over time in globally-sourced, annual temporal data. We employ Local Interpretable Model-agnostic Explanations (LIME) to shed light on national happiness indices, economic freedom, and population metrics.
• Score: 5.669106489320257
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This paper focuses on explaining changes over time in globally-sourced, annual temporal data, with the specific objective of identifying pivotal factors that contribute to these temporal shifts. Leveraging such analytical frameworks can yield transformative impacts, including the informed refinement of public policy and the identification of key drivers affecting a country's economic evolution. We employ Local Interpretable Model-agnostic Explanations (LIME) to shed light on national happiness indices, economic freedom, and population metrics, spanning variable time frames. Acknowledging the presence of missing values, we employ three imputation approaches to generate robust multivariate time-series datasets apt for LIME's input requirements. Our methodology's efficacy is substantiated through a series of empirical evaluations involving multiple datasets. These evaluations include comparative analyses against random feature selection, correlation with real-world events as elucidated by LIME, and validation through Individual Conditional Expectation (ICE) plots, a state-of-the-art technique proficient in feature importance detection.

Related papers

• Explaining Categorical Feature Interactions Using Graph Covariance and LLMs [18.44675735926458]
  This paper focuses on the global synthetic dataset from the Counter Trafficking Data Collaborative. It contains over 200,000 anonymized records spanning from 2002 to 2022 with numerous categorical features for each record. We propose a fast and scalable method for analyzing and extracting significant categorical feature interactions.
  arXiv  Detail & Related papers  (2025-01-24T21:41:26Z)
• PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
  We propose a. Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
  arXiv  Detail & Related papers  (2024-06-04T13:51:08Z)
• On the Identification of Temporally Causal Representation with Instantaneous Dependence [50.14432597910128]
  Temporally causal representation learning aims to identify the latent causal process from time series observations. Most methods require the assumption that the latent causal processes do not have instantaneous relations. We propose an textbfIDentification framework for instantanetextbfOus textbfLatent dynamics.
  arXiv  Detail & Related papers  (2024-05-24T08:08:05Z)
• Adaptive Global-Local Representation Learning and Selection for Cross-Domain Facial Expression Recognition [54.334773598942775]
  Domain shift poses a significant challenge in Cross-Domain Facial Expression Recognition (CD-FER) We propose an Adaptive Global-Local Representation Learning and Selection framework.
  arXiv  Detail & Related papers  (2024-01-20T02:21:41Z)
• Robust Stance Detection: Understanding Public Perceptions in Social Media [15.460495567765362]
  stance detection identifies precise positions relative to a well-defined topic. Traditional stance detection models often lag in performance when applied to new domains and topics. A solution we present in this paper combines counterfactual data augmentation with contrastive learning to enhance the robustness of stance detection.
  arXiv  Detail & Related papers  (2023-09-26T18:19:51Z)
• Decoupling Local and Global Representations of Time Series [38.73548222141307]
  We propose a novel generative approach for learning representations for the global and local factors of variation in time series. In experiments, we demonstrate successful recovery of the true local and global variability factors on simulated data. We believe that the proposed way of defining representations is beneficial for data modelling and yields better insights into the complexity of real-world data.
  arXiv  Detail & Related papers  (2022-02-04T17:46:04Z)
• Stateful Offline Contextual Policy Evaluation and Learning [88.9134799076718]
  We study off-policy evaluation and learning from sequential data. We formalize the relevant causal structure of problems such as dynamic personalized pricing. We show improved out-of-sample policy performance in this class of relevant problems.
  arXiv  Detail & Related papers  (2021-10-19T16:15:56Z)
• An Information-theoretic Approach to Distribution Shifts [9.475039534437332]
  Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere. neural networks that are fit to a subset of the population might carry some selection bias into their decision process.
  arXiv  Detail & Related papers  (2021-06-07T16:44:21Z)
• Combating Temporal Drift in Crisis with Adapted Embeddings [58.4558720264897]
  Language usage changes over time, and this can impact the effectiveness of NLP systems. This work investigates methods for adapting to changing discourse during crisis events.
  arXiv  Detail & Related papers  (2021-04-17T13:11:41Z)
• Domain Adaptative Causality Encoder [52.779274858332656]
  We leverage the characteristics of dependency trees and adversarial learning to address the tasks of adaptive causality identification and localisation. We present a new causality dataset, namely MedCaus, which integrates all types of causality in the text.
  arXiv  Detail & Related papers  (2020-11-27T04:14:55Z)
• Statistical Analytics and Regional Representation Learning for COVID-19 Pandemic Understanding [4.731074162093199]
  The rapid spread of the novel coronavirus (COVID-19) has severely impacted almost all countries around the world. This paper combines and processes an extensive collection of publicly available datasets to provide a unified information source. A specific RNN-based inference pipeline called DoubleWindowLSTM-CP is proposed in this work for predictive event modeling.
  arXiv  Detail & Related papers  (2020-08-08T03:35:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.