A Heuristic-driven Uncertainty based Ensemble Framework for Fake News
Detection in Tweets and News Articles
- URL: http://arxiv.org/abs/2104.01791v1
- Date: Mon, 5 Apr 2021 06:35:30 GMT
- Title: A Heuristic-driven Uncertainty based Ensemble Framework for Fake News
Detection in Tweets and News Articles
- Authors: Sourya Dipta Das, Ayan Basak, Saikat Dutta
- Abstract summary: We describe a novel Fake News Detection system that automatically identifies whether a news item is "real" or "fake"
We have used an ensemble model consisting of pre-trained models followed by a statistical feature fusion network.
Our proposed framework have also quantified reliable predictive uncertainty along with proper class output confidence level for the classification task.
- Score: 5.979726271522835
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The significance of social media has increased manifold in the past few
decades as it helps people from even the most remote corners of the world to
stay connected. With the advent of technology, digital media has become more
relevant and widely used than ever before and along with this, there has been a
resurgence in the circulation of fake news and tweets that demand immediate
attention. In this paper, we describe a novel Fake News Detection system that
automatically identifies whether a news item is "real" or "fake", as an
extension of our work in the CONSTRAINT COVID-19 Fake News Detection in English
challenge. We have used an ensemble model consisting of pre-trained models
followed by a statistical feature fusion network , along with a novel heuristic
algorithm by incorporating various attributes present in news items or tweets
like source, username handles, URL domains and authors as statistical feature.
Our proposed framework have also quantified reliable predictive uncertainty
along with proper class output confidence level for the classification task. We
have evaluated our results on the COVID-19 Fake News dataset and FakeNewsNet
dataset to show the effectiveness of the proposed algorithm on detecting fake
news in short news content as well as in news articles. We obtained a best
F1-score of 0.9892 on the COVID-19 dataset, and an F1-score of 0.9073 on the
FakeNewsNet dataset.
Related papers
- Nothing Stands Alone: Relational Fake News Detection with Hypergraph
Neural Networks [49.29141811578359]
We propose to leverage a hypergraph to represent group-wise interaction among news, while focusing on important news relations with its dual-level attention mechanism.
Our approach yields remarkable performance and maintains the high performance even with a small subset of labeled news data.
arXiv Detail & Related papers (2022-12-24T00:19:32Z) - FNDaaS: Content-agnostic Detection of Fake News sites [3.936965297430477]
We propose FND, the first automatic, content-agnostic fake news detection method.
It considers new and unstudied features such as network and structural characteristics per news website.
It can achieve an AUC score of up to 0.967 on past sites, and up to 77-92% accuracy on newly-flagged ones.
arXiv Detail & Related papers (2022-12-13T11:17:32Z) - Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
Multiverse is a new feature based on multilingual evidence that can be used for fake news detection.
The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
arXiv Detail & Related papers (2022-11-25T18:24:17Z) - Combination Of Convolution Neural Networks And Deep Neural Networks For
Fake News Detection [0.0]
We have described the Fake News Challenge stage #1 dataset and given an overview of the competitive attempts to build a fake news detection system.
The proposed system detects all the categories with high accuracy except the disagree category.
As a result, the system achieves up to 84.6 % accuracy, classifying it as the second ranking based on other competitive studies.
arXiv Detail & Related papers (2022-10-15T16:32:51Z) - Modelling Social Context for Fake News Detection: A Graph Neural Network
Based Approach [0.39146761527401425]
Detection of fake news is crucial to ensure the authenticity of information and maintain the news ecosystems reliability.
This paper has analyzed the social context of fake news detection with a hybrid graph neural network based approach.
arXiv Detail & Related papers (2022-07-27T12:58:33Z) - UrduFake@FIRE2020: Shared Track on Fake News Identification in Urdu [62.6928395368204]
This paper gives the overview of the first shared task at FIRE 2020 on fake news detection in the Urdu language.
The goal is to identify fake news using a dataset composed of 900 annotated news articles for training and 400 news articles for testing.
The dataset contains news in five domains: (i) Health, (ii) Sports, (iii) Showbiz, (iv) Technology, and (v) Business.
arXiv Detail & Related papers (2022-07-25T03:46:51Z) - Faking Fake News for Real Fake News Detection: Propaganda-loaded
Training Data Generation [105.20743048379387]
We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda.
Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles.
Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
arXiv Detail & Related papers (2022-03-10T14:24:19Z) - DEAP-FAKED: Knowledge Graph based Approach for Fake News Detection [0.04834203844100679]
We propose a knowleDgE grAPh FAKe nEws Detection framework for identifying Fake News.
Our approach is a combination of the NLP -- where we encode the news content, and the GNN technique -- where we encode the Knowledge Graph.
We evaluate our framework using two publicly available datasets containing articles from domains such as politics, business, technology, and healthcare.
arXiv Detail & Related papers (2021-07-04T07:09:59Z) - User Preference-aware Fake News Detection [61.86175081368782]
Existing fake news detection algorithms focus on mining news content for deceptive signals.
We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling.
arXiv Detail & Related papers (2021-04-25T21:19:24Z) - A Heuristic-driven Ensemble Framework for COVID-19 Fake News Detection [5.979726271522835]
We describe our Fake News Detection system that automatically identifies whether a tweet related to COVID-19 is "real" or "fake"
We have used an ensemble model consisting of pre-trained models that has helped us achieve a joint 8th position on the leader board.
We have been able to drastically improve our system by incorporating a novel algorithm based on username handles and link domains in tweets fetching an F1-score of 0.9883.
arXiv Detail & Related papers (2021-01-10T13:21:08Z) - A Deep Learning Approach for Automatic Detection of Fake News [47.00462375817434]
We propose two models based on deep learning for solving fake news detection problem in online news contents of multiple domains.
We evaluate our techniques on the two recently released datasets, namely FakeNews AMT and Celebrity for fake news detection.
arXiv Detail & Related papers (2020-05-11T09:07:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.