Causal Structure Learning with Recommendation System
- URL: http://arxiv.org/abs/2210.10256v1
- Date: Wed, 19 Oct 2022 02:31:47 GMT
- Title: Causal Structure Learning with Recommendation System
- Authors: Shuyuan Xu, Da Xu, Evren Korpeoglu, Sushant Kumar, Stephen Guo, Kannan
Achan, Yongfeng Zhang
- Abstract summary: We first formulate the underlying causal mechanism as a causal structural model and describe a general causal structure learning framework grounded in the real-world working mechanism of recommendation systems.
We then derive the learning objective from our framework and propose an augmented Lagrangian solver for efficient optimization.
- Score: 46.90516308311924
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A fundamental challenge of recommendation systems (RS) is understanding the
causal dynamics underlying users' decision making. Most existing literature
addresses this problem by using causal structures inferred from domain
knowledge. However, there are numerous phenomenons where domain knowledge is
insufficient, and the causal mechanisms must be learnt from the feedback data.
Discovering the causal mechanism from RS feedback data is both novel and
challenging, since RS itself is a source of intervention that can influence
both the users' exposure and their willingness to interact. Also for this
reason, most existing solutions become inappropriate since they require data
collected free from any RS. In this paper, we first formulate the underlying
causal mechanism as a causal structural model and describe a general causal
structure learning framework grounded in the real-world working mechanism of
RS. The essence of our approach is to acknowledge the unknown nature of RS
intervention. We then derive the learning objective from our framework and
propose an augmented Lagrangian solver for efficient optimization. We conduct
both simulation and real-world experiments to demonstrate how our approach
compares favorably to existing solutions, together with the empirical analysis
from sensitivity and ablation studies.
Related papers
- Revisiting Spurious Correlation in Domain Generalization [12.745076668687748]
We build a structural causal model (SCM) to describe the causality within data generation process.
We further conduct a thorough analysis of the mechanisms underlying spurious correlation.
In this regard, we propose to control confounding bias in OOD generalization by introducing a propensity score weighted estimator.
arXiv Detail & Related papers (2024-06-17T13:22:00Z) - RealTCD: Temporal Causal Discovery from Interventional Data with Large Language Model [15.416325455014462]
Temporal causal discovery aims to identify temporal causal relationships between variables directly from observations.
Existing methods mainly focus on synthetic datasets with heavy reliance on intervention targets.
We propose the RealTCD framework, which is able to leverage domain knowledge to discover temporal causal relationships without interventional targets.
arXiv Detail & Related papers (2024-04-23T06:52:40Z) - Learning by Doing: An Online Causal Reinforcement Learning Framework
with Causal-Aware Policy [40.33036146207819]
We consider explicitly modeling the generation process of states with the graphical causal model.
We formulate the causal structure updating into the RL interaction process with active intervention learning of the environment.
arXiv Detail & Related papers (2024-02-07T14:09:34Z) - Multi-modal Causal Structure Learning and Root Cause Analysis [67.67578590390907]
We propose Mulan, a unified multi-modal causal structure learning method for root cause localization.
We leverage a log-tailored language model to facilitate log representation learning, converting log sequences into time-series data.
We also introduce a novel key performance indicator-aware attention mechanism for assessing modality reliability and co-learning a final causal graph.
arXiv Detail & Related papers (2024-02-04T05:50:38Z) - Targeted Reduction of Causal Models [55.11778726095353]
Causal Representation Learning offers a promising avenue to uncover interpretable causal patterns in simulations.
We introduce Targeted Causal Reduction (TCR), a method for condensing complex intervenable models into a concise set of causal factors.
Its ability to generate interpretable high-level explanations from complex models is demonstrated on toy and mechanical systems.
arXiv Detail & Related papers (2023-11-30T15:46:22Z) - Confounder Identification-free Causal Visual Feature Learning [84.28462256571822]
We propose a novel Confounder Identification-free Causal Visual Feature Learning (CICF) method, which obviates the need for identifying confounders.
CICF models the interventions among different samples based on front-door criterion, and then approximates the global-scope intervening effect upon the instance-level interventions.
We uncover the relation between CICF and the popular meta-learning strategy MAML, and provide an interpretation of why MAML works from the theoretical perspective.
arXiv Detail & Related papers (2021-11-26T10:57:47Z) - Learning Neural Causal Models with Active Interventions [83.44636110899742]
We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process.
Our method significantly reduces the required number of interactions compared with random intervention targeting.
We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
arXiv Detail & Related papers (2021-09-06T13:10:37Z) - Systematic Evaluation of Causal Discovery in Visual Model Based
Reinforcement Learning [76.00395335702572]
A central goal for AI and causality is the joint discovery of abstract representations and causal structure.
Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs.
In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
arXiv Detail & Related papers (2021-07-02T05:44:56Z) - Causal Reinforcement Learning using Observational and Interventional
Data [14.856472820492364]
Learning efficiently a causal model of the environment is a key challenge of model RL agents operating in POMDPs.
We consider a scenario where the learning agent has the ability to collect online experiences through direct interactions with the environment.
We then ask the following questions: can the online and offline experiences be safely combined for learning a causal model.
arXiv Detail & Related papers (2021-06-28T06:58:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.