Evaluation of Fake News Detection with Knowledge-Enhanced Language Models

• URL: http://arxiv.org/abs/2204.00458v1
• Date: Fri, 1 Apr 2022 14:14:46 GMT
• Title: Evaluation of Fake News Detection with Knowledge-Enhanced Language Models
• Authors: Chenxi Whitehouse, Tillman Weyde, Pranava Madhyastha, Nikos Komninos
• Abstract summary: Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs) The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. The use of existing knowledge bases (KBs) with rich human-curated factual information has thus the potential to make fake news detection more effective and robust.
• Score: 10.45851991054367
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs). The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. However, large-scale PLMs are generally not trained on structured factual data and hence may not possess priors that are grounded in factually accurate knowledge. The use of existing knowledge bases (KBs) with rich human-curated factual information has thus the potential to make fake news detection more effective and robust. In this paper, we investigate the impact of knowledge integration into PLMs for fake news detection. We study several state-of-the-art approaches for knowledge integration, mostly using Wikidata as KB, on two popular fake news datasets - LIAR, a politics-based dataset, and COVID-19, a dataset of messages posted on social media relating to the COVID-19 pandemic. Our experiments show that knowledge-enhanced models can significantly improve fake news detection on LIAR where the KB is relevant and up-to-date. The mixed results on COVID-19 highlight the reliance on stylistic features and the importance of domain specific and current KBs.

Related papers

• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection [50.07850264495737]
  "Prompt-and-Align" (P&A) is a novel prompt-based paradigm for few-shot fake news detection. We show that P&A sets new states-of-the-art for few-shot fake news detection performance by significant margins.
  arXiv  Detail & Related papers  (2023-09-28T13:19:43Z)
• fakenewsbr: A Fake News Detection Platform for Brazilian Portuguese [0.6775616141339018]
  This paper presents a comprehensive study on detecting fake news in Brazilian Portuguese. We propose a machine learning-based approach that leverages natural language processing techniques, including TF-IDF and Word2Vec. We develop a user-friendly web platform, fakenewsbr.com, to facilitate the verification of news articles' veracity.
  arXiv  Detail & Related papers  (2023-09-20T04:10:03Z)
• Unsupervised Domain-agnostic Fake News Detection using Multi-modal Weak Signals [19.22829945777267]
  This work proposes an effective framework for unsupervised fake news detection, which first embeds the knowledge available in four modalities in news records. Also, we propose a novel technique to construct news datasets minimizing the latent biases in existing news datasets. We trained the proposed unsupervised framework using LUND-COVID to exploit the potential of large datasets.
  arXiv  Detail & Related papers  (2023-05-18T23:49:31Z)
• Nothing Stands Alone: Relational Fake News Detection with Hypergraph Neural Networks [49.29141811578359]
  We propose to leverage a hypergraph to represent group-wise interaction among news, while focusing on important news relations with its dual-level attention mechanism. Our approach yields remarkable performance and maintains the high performance even with a small subset of labeled news data.
  arXiv  Detail & Related papers  (2022-12-24T00:19:32Z)
• Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
  Multiverse is a new feature based on multilingual evidence that can be used for fake news detection. The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
  arXiv  Detail & Related papers  (2022-11-25T18:24:17Z)
• Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generation [105.20743048379387]
  We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda. Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles. Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
  arXiv  Detail & Related papers  (2022-03-10T14:24:19Z)
• User Preference-aware Fake News Detection [61.86175081368782]
  Existing fake news detection algorithms focus on mining news content for deceptive signals. We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling.
  arXiv  Detail & Related papers  (2021-04-25T21:19:24Z)
• Adversarial Active Learning based Heterogeneous Graph Neural Network for Fake News Detection [18.847254074201953]
  We propose a novel fake news detection framework, namely Adversarial Active Learning-based Heterogeneous Graph Neural Network (AA-HGNN) AA-HGNN utilizes an active learning framework to enhance learning performance, especially when facing the paucity of labeled data. Experiments with two real-world fake news datasets show that our model can outperform text-based models and other graph-based models.
  arXiv  Detail & Related papers  (2021-01-27T05:05:25Z)
• ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information [1.6752182911522522]
  Social media platforms are vulnerable to fake news dissemination. This paper analyzes the impact of incorporating content information, prior knowledge, and credibility of sources into models for the early detection of fake news.
  arXiv  Detail & Related papers  (2021-01-14T08:39:50Z)
• Connecting the Dots Between Fact Verification and Fake News Detection [21.564628184287173]
  We propose a simple yet effective approach to connect the dots between fact verification and fake news detection. Our approach makes use of the recent success of fact verification models and enables zero-shot fake news detection.
  arXiv  Detail & Related papers  (2020-10-11T09:28:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.