Fake news detection using parallel BERT deep neural networks
- URL: http://arxiv.org/abs/2204.04793v2
- Date: Tue, 17 Oct 2023 16:02:42 GMT
- Title: Fake news detection using parallel BERT deep neural networks
- Authors: Mahmood Farokhian, Vahid Rafe, Hadi Veisi
- Abstract summary: We introduce MWPBert, which uses two parallel BERT networks to perform veracity detection on full-text news articles.
Experiment results showed that the proposed model outperformed previous models in terms of accuracy and other performance measures.
- Score: 1.0359008237358598
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Fake news is a growing challenge for social networks and media. Detection of
fake news always has been a problem for many years, but after the evolution of
social networks and increasing speed of news dissemination in recent years has
been considered again. There are several approaches to solving this problem,
one of which is to detect fake news based on its text style using deep neural
networks. In recent years, one of the most used forms of deep neural networks
for natural language processing is transfer learning with transformers. BERT is
one of the most promising transformers who outperforms other models in many NLP
benchmarks. This article, we introduce MWPBert, which uses two parallel BERT
networks to perform veracity detection on full-text news articles. One of the
BERT networks encodes news headline, and another encodes news body. Since the
input length of the BERT network is limited and constant and the news body is
usually a long text, we cannot fed the whole news text into the BERT.
Therefore, using the MaxWorth algorithm, we selected the part of the news text
that is more valuable for fact-checking, and fed it into the BERT network.
Finally, we encode the output of the two BERT networks to an output network to
classify the news. The experiment results showed that the proposed model
outperformed previous models in terms of accuracy and other performance
measures.
Related papers
- Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news.
Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
arXiv Detail & Related papers (2023-11-02T08:39:45Z) - Nothing Stands Alone: Relational Fake News Detection with Hypergraph
Neural Networks [49.29141811578359]
We propose to leverage a hypergraph to represent group-wise interaction among news, while focusing on important news relations with its dual-level attention mechanism.
Our approach yields remarkable performance and maintains the high performance even with a small subset of labeled news data.
arXiv Detail & Related papers (2022-12-24T00:19:32Z) - Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
Multiverse is a new feature based on multilingual evidence that can be used for fake news detection.
The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
arXiv Detail & Related papers (2022-11-25T18:24:17Z) - Fake News Quick Detection on Dynamic Heterogeneous Information Networks [3.599616699656401]
We propose a novel Dynamic Heterogeneous Graph Neural Network (DHGNN) for fake news quick detection.
We first implement BERT and fine-tuned BERT to get a semantic representation of the news article contents and author profiles.
Then, we construct the heterogeneous news-author graph to reflect contextual information and relationships.
arXiv Detail & Related papers (2022-05-14T11:23:25Z) - The use of Data Augmentation as a technique for improving neural network
accuracy in detecting fake news about COVID-19 [0.0]
This paper aims to present how the application of Natural Language Processing (NLP) and data augmentation techniques can improve the performance of a neural network for better detection of fake news in the Portuguese language.
arXiv Detail & Related papers (2022-05-01T11:52:53Z) - Faking Fake News for Real Fake News Detection: Propaganda-loaded
Training Data Generation [105.20743048379387]
We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda.
Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles.
Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
arXiv Detail & Related papers (2022-03-10T14:24:19Z) - User Preference-aware Fake News Detection [61.86175081368782]
Existing fake news detection algorithms focus on mining news content for deceptive signals.
We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling.
arXiv Detail & Related papers (2021-04-25T21:19:24Z) - Connecting the Dots Between Fact Verification and Fake News Detection [21.564628184287173]
We propose a simple yet effective approach to connect the dots between fact verification and fake news detection.
Our approach makes use of the recent success of fact verification models and enables zero-shot fake news detection.
arXiv Detail & Related papers (2020-10-11T09:28:52Z) - Similarity Detection Pipeline for Crawling a Topic Related Fake News
Corpus [0.0]
We propose a new, publicly available German topic related corpus for fake news detection.
We also develop a pipeline for crawling similar news articles.
As our third contribution, we conduct different learning experiments to detect fake news.
arXiv Detail & Related papers (2020-09-28T14:35:31Z) - Incorporating BERT into Neural Machine Translation [251.54280200353674]
We propose a new algorithm named BERT-fused model, in which we first use BERT to extract representations for an input sequence.
We conduct experiments on supervised (including sentence-level and document-level translations), semi-supervised and unsupervised machine translation, and achieve state-of-the-art results on seven benchmark datasets.
arXiv Detail & Related papers (2020-02-17T08:13:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.