NoFake at CheckThat! 2021: Fake News Detection Using BERT
- URL: http://arxiv.org/abs/2108.05419v1
- Date: Wed, 11 Aug 2021 19:13:04 GMT
- Title: NoFake at CheckThat! 2021: Fake News Detection Using BERT
- Authors: Sushma Kumari
- Abstract summary: We have presented BERT based classification model to predict the domain and classification.
We have achieved a macro F1 score of 83.76 % for Task 3Aand 85.55 % for Task 3B using the additional training data.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Much research has been done for debunking and analysing fake news. Many
researchers study fake news detection in the last year, but many are limited to
social media data. Currently, multiples fact-checkers are publishing their
results in various formats. Also, multiple fact-checkers use different labels
for the fake news, making it difficult to make a generalisable classifier. With
the merge classes, the performance of the machine model can be enhanced. This
domain categorisation will help group the article, which will help save the
manual effort in assigning the claim verification. In this paper, we have
presented BERT based classification model to predict the domain and
classification. We have also used additional data from fact-checked articles.
We have achieved a macro F1 score of 83.76 % for Task 3Aand 85.55 % for Task 3B
using the additional training data.
Related papers
- Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news.
Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
arXiv Detail & Related papers (2023-11-02T08:39:45Z) - Machine Learning Technique Based Fake News Detection [0.0]
We have trained a model to classify fake and true news by utilizing the 1876 news data from our collected dataset.
Our research conducts 3 popular Machine Learning (Stochastic gradient descent, Na"ive Bayes, Logistic Regression,) and 2 Deep Learning (Long-Short Term Memory, ASGD Weight-Dropped LSTM, or AWD-LSTM) algorithms.
arXiv Detail & Related papers (2023-09-18T19:26:54Z) - Findings of Factify 2: Multimodal Fake News Detection [36.34201719103715]
We present the outcome of the Factify 2 shared task, which provides a multi-modal fact verification and satire news dataset.
The data calls for a comparison based approach to the task by pairing social media claims with supporting documents, with both text and image, divided into 5 classes based on multi-modal relations.
The highest F1 score averaged for all five classes was 81.82%.
arXiv Detail & Related papers (2023-07-19T22:14:49Z) - Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
Multiverse is a new feature based on multilingual evidence that can be used for fake news detection.
The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
arXiv Detail & Related papers (2022-11-25T18:24:17Z) - Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2020 [62.6928395368204]
Task was posed as a binary classification task, in which the goal is to differentiate between real and fake news.
We provided a dataset divided into 900 annotated news articles for training and 400 news articles for testing.
42 teams from 6 different countries (India, China, Egypt, Germany, Pakistan, and the UK) registered for the task.
arXiv Detail & Related papers (2022-07-25T03:41:32Z) - Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2021 [55.41644538483948]
The goal of the shared task is to motivate the community to come up with efficient methods for solving this vital problem.
The training set contains 1300 annotated news articles -- 750 real news, 550 fake news, while the testing set contains 300 news articles -- 200 real, 100 fake news.
The best performing system obtained an F1-macro score of 0.679, which is lower than the past year's best result of 0.907 F1-macro.
arXiv Detail & Related papers (2022-07-11T18:58:36Z) - Faking Fake News for Real Fake News Detection: Propaganda-loaded
Training Data Generation [105.20743048379387]
We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda.
Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles.
Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
arXiv Detail & Related papers (2022-03-10T14:24:19Z) - Development of Fake News Model using Machine Learning through Natural
Language Processing [0.7120858995754653]
We use machine learning algorithms and for identification of fake news.
Simple classification is not completely correct in fake news detection.
With the integration of machine learning and text-based processing, we can detect fake news.
arXiv Detail & Related papers (2022-01-19T09:26:15Z) - Automated Evidence Collection for Fake News Detection [11.324403127916877]
We propose a novel approach that improves over the current automatic fake news detection approaches.
Our approach extracts supporting evidence from the web articles and then selects appropriate text to be treated as evidence sets.
Our experiments, using both machine learning and deep learning-based methods, help perform an extensive evaluation of our approach.
arXiv Detail & Related papers (2021-12-13T09:38:41Z) - Explainable Tsetlin Machine framework for fake news detection with
credibility score assessment [16.457778420360537]
We propose a novel interpretable fake news detection framework based on the recently introduced Tsetlin Machine (TM)
We use the conjunctive clauses of the TM to capture lexical and semantic properties of both true and fake news text.
For evaluation, we conduct experiments on two publicly available datasets, PolitiFact and GossipCop, and demonstrate that the TM framework significantly outperforms previously published baselines by at least $5%$ in terms of accuracy.
arXiv Detail & Related papers (2021-05-19T13:18:02Z) - User Preference-aware Fake News Detection [61.86175081368782]
Existing fake news detection algorithms focus on mining news content for deceptive signals.
We propose a new framework, UPFD, which simultaneously captures various signals from user preferences by joint content and graph modeling.
arXiv Detail & Related papers (2021-04-25T21:19:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.