Explainable Tsetlin Machine framework for fake news detection with credibility score assessment

• URL: http://arxiv.org/abs/2105.09114v1
• Date: Wed, 19 May 2021 13:18:02 GMT
• Title: Explainable Tsetlin Machine framework for fake news detection with credibility score assessment
• Authors: Bimal Bhattarai, Ole-Christoffer Granmo, Lei Jiao
• Abstract summary: We propose a novel interpretable fake news detection framework based on the recently introduced Tsetlin Machine (TM) We use the conjunctive clauses of the TM to capture lexical and semantic properties of both true and fake news text. For evaluation, we conduct experiments on two publicly available datasets, PolitiFact and GossipCop, and demonstrate that the TM framework significantly outperforms previously published baselines by at least $5%$ in terms of accuracy.
• Score: 16.457778420360537
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The proliferation of fake news, i.e., news intentionally spread for misinformation, poses a threat to individuals and society. Despite various fact-checking websites such as PolitiFact, robust detection techniques are required to deal with the increase in fake news. Several deep learning models show promising results for fake news classification, however, their black-box nature makes it difficult to explain their classification decisions and quality-assure the models. We here address this problem by proposing a novel interpretable fake news detection framework based on the recently introduced Tsetlin Machine (TM). In brief, we utilize the conjunctive clauses of the TM to capture lexical and semantic properties of both true and fake news text. Further, we use the clause ensembles to calculate the credibility of fake news. For evaluation, we conduct experiments on two publicly available datasets, PolitiFact and GossipCop, and demonstrate that the TM framework significantly outperforms previously published baselines by at least $5\%$ in terms of accuracy, with the added benefit of an interpretable logic-based representation. Further, our approach provides higher F1-score than BERT and XLNet, however, we obtain slightly lower accuracy. We finally present a case study on our model's explainability, demonstrating how it decomposes into meaningful words and their negations.

Related papers

• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection [50.07850264495737]
  "Prompt-and-Align" (P&A) is a novel prompt-based paradigm for few-shot fake news detection. We show that P&A sets new states-of-the-art for few-shot fake news detection performance by significant margins.
  arXiv  Detail & Related papers  (2023-09-28T13:19:43Z)
• Nothing Stands Alone: Relational Fake News Detection with Hypergraph Neural Networks [49.29141811578359]
  We propose to leverage a hypergraph to represent group-wise interaction among news, while focusing on important news relations with its dual-level attention mechanism. Our approach yields remarkable performance and maintains the high performance even with a small subset of labeled news data.
  arXiv  Detail & Related papers  (2022-12-24T00:19:32Z)
• Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
  Multiverse is a new feature based on multilingual evidence that can be used for fake news detection. The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
  arXiv  Detail & Related papers  (2022-11-25T18:24:17Z)
• A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection [15.517424861844317]
  Existing fake news detection methods aim to classify a piece of news as true or false and provide explanations, achieving remarkable performances. When a piece of news has not yet been fact-checked or debunked, certain amounts of relevant raw reports are usually disseminated on various media outlets. We propose a novel Coarse-to-fine Cascaded Evidence-Distillation (CofCED) neural network for explainable fake news detection based on such raw reports.
  arXiv  Detail & Related papers  (2022-09-29T09:05:47Z)
• A Multi-Policy Framework for Deep Learning-Based Fake News Detection [0.31498833540989407]
  This work introduces Multi-Policy Statement Checker (MPSC), a framework that automates fake news detection. MPSC uses deep learning techniques to analyze a statement itself and its related news articles, predicting whether it is seemingly credible or suspicious.
  arXiv  Detail & Related papers  (2022-06-01T21:25:21Z)
• Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generation [105.20743048379387]
  We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda. Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles. Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
  arXiv  Detail & Related papers  (2022-03-10T14:24:19Z)
• An Adversarial Benchmark for Fake News Detection Models [0.065268245109828]
  We formulate adversarial attacks that target three aspects of "understanding" We test our benchmark using BERT classifiers fine-tuned on the LIAR arXiv:arch-ive/1705648 and Kaggle Fake-News datasets.
  arXiv  Detail & Related papers  (2022-01-03T23:51:55Z)
• User Preference-aware Fake News Detection [61.86175081368782]
  Existing fake news detection algorithms focus on mining news content for deceptive signals. We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling.
  arXiv  Detail & Related papers  (2021-04-25T21:19:24Z)
• Connecting the Dots Between Fact Verification and Fake News Detection [21.564628184287173]
  We propose a simple yet effective approach to connect the dots between fact verification and fake news detection. Our approach makes use of the recent success of fact verification models and enables zero-shot fake news detection.
  arXiv  Detail & Related papers  (2020-10-11T09:28:52Z)
• Weak Supervision for Fake News Detection via Reinforcement Learning [34.448503443582396]
  We propose a weakly-supervised fake news detection framework, i.e., WeFEND. The proposed framework consists of three main components: the annotator, the reinforced selector and the fake news detector. We tested the proposed framework on a large collection of news articles published via WeChat official accounts and associated user reports.
  arXiv  Detail & Related papers  (2019-12-28T21:20:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.