CMA-R:Causal Mediation Analysis for Explaining Rumour Detection
- URL: http://arxiv.org/abs/2402.08155v1
- Date: Tue, 13 Feb 2024 01:31:08 GMT
- Title: CMA-R:Causal Mediation Analysis for Explaining Rumour Detection
- Authors: Lin Tian, Xiuzhen Zhang, Jey Han Lau
- Abstract summary: We apply causal mediation analysis to explain the decision-making process of neural models for rumour detection on Twitter.
We find that our approach CMA-R identifies salient tweets that explain model predictions and show strong agreement with human judgements for critical tweets determining the truthfulness of stories.
- Score: 33.47709912852258
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We apply causal mediation analysis to explain the decision-making process of
neural models for rumour detection on Twitter. Interventions at the input and
network level reveal the causal impacts of tweets and words in the model
output. We find that our approach CMA-R -- Causal Mediation Analysis for Rumour
detection -- identifies salient tweets that explain model predictions and show
strong agreement with human judgements for critical tweets determining the
truthfulness of stories. CMA-R can further highlight causally impactful words
in the salient tweets, providing another layer of interpretability and
transparency into these blackbox rumour detection systems. Code is available
at: https://github.com/ltian678/cma-r.
Related papers
- Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights [50.89022445197919]
We propose a speech-specific risk taxonomy, covering 8 risk categories under hostility (malicious sarcasm and threats), malicious imitation (age, gender, ethnicity), and stereotypical biases (age, gender, ethnicity)
Based on the taxonomy, we create a small-scale dataset for evaluating current LMMs capability in detecting these categories of risk.
arXiv Detail & Related papers (2024-06-25T10:08:45Z) - Rumor Detection with a novel graph neural network approach [12.42658463552019]
We propose a new detection model, that jointly learns the representations of user correlation and information propagation to detect rumors on social media.
Specifically, we leverage graph neural networks to learn the representations of user correlation from a bipartite graph.
We show that it requires a high cost for attackers to subvert user correlation pattern, demonstrating the importance of considering user correlation for rumor detection.
arXiv Detail & Related papers (2024-03-24T15:59:47Z) - Exploring the Jungle of Bias: Political Bias Attribution in Language Models via Dependency Analysis [86.49858739347412]
Large Language Models (LLMs) have sparked intense debate regarding the prevalence of bias in these models and its mitigation.
We propose a prompt-based method for the extraction of confounding and mediating attributes which contribute to the decision process.
We find that the observed disparate treatment can at least in part be attributed to confounding and mitigating attributes and model misalignment.
arXiv Detail & Related papers (2023-11-15T00:02:25Z) - Rumor Detection with Diverse Counterfactual Evidence [32.746912322365525]
Social media has exacerbated the threat of fake news to individuals and communities.
prevailing approaches resort to graph neural networks (GNNs) to exploit the post-propagation patterns of the rumor-spreading process.
We propose Diverse Counterfactual Evidence framework for Rumor Detection (DCE-RD)
arXiv Detail & Related papers (2023-07-18T14:37:23Z) - What goes on inside rumour and non-rumour tweets and their reactions: A
Psycholinguistic Analyses [58.75684238003408]
psycho-linguistics analyses of social media text are vital for drawing meaningful conclusions to mitigate misinformation.
This research contributes by performing an in-depth psycholinguistic analysis of rumours related to various kinds of events.
arXiv Detail & Related papers (2021-11-09T07:45:11Z) - Misleading the Covid-19 vaccination discourse on Twitter: An exploratory
study of infodemic around the pandemic [0.45593531937154413]
We collect a moderate-sized representative corpus of tweets (200,000 approx.) pertaining to Covid-19 vaccination over a period of seven months (September 2020 - March 2021)
Following a Transfer Learning approach, we utilize the pre-trained Transformer-based XLNet model to classify tweets as Misleading or Non-Misleading.
We build on this to study and contrast the characteristics of tweets in the corpus that are misleading in nature against non-misleading ones.
Several ML models are employed for prediction, with up to 90% accuracy, and the importance of each feature is explained using SHAP Explainable AI (X
arXiv Detail & Related papers (2021-08-16T17:02:18Z) - Machine Learning Explanations to Prevent Overtrust in Fake News
Detection [64.46876057393703]
This research investigates the effects of an Explainable AI assistant embedded in news review platforms for combating the propagation of fake news.
We design a news reviewing and sharing interface, create a dataset of news stories, and train four interpretable fake news detection algorithms.
For a deeper understanding of Explainable AI systems, we discuss interactions between user engagement, mental model, trust, and performance measures in the process of explaining.
arXiv Detail & Related papers (2020-07-24T05:42:29Z) - Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals [53.484562601127195]
We point out the inability to infer behavioral conclusions from probing results.
We offer an alternative method that focuses on how the information is being used, rather than on what information is encoded.
arXiv Detail & Related papers (2020-06-01T15:00:11Z) - Analysing the Extent of Misinformation in Cancer Related Tweets [6.409065843327199]
We present a dataset regarding tweets which talk specifically about cancer.
We propose an attention-based deep learning model for automated detection of misinformation along with its spread.
This analysis helps us gather relevant insights on various social aspects related to misinformed tweets.
arXiv Detail & Related papers (2020-03-30T17:44:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.