UrduFake@FIRE2020: Shared Track on Fake News Identification in Urdu
- URL: http://arxiv.org/abs/2207.12406v1
- Date: Mon, 25 Jul 2022 03:46:51 GMT
- Title: UrduFake@FIRE2020: Shared Track on Fake News Identification in Urdu
- Authors: Maaz Amjad, Grigori Sidorov, Alisa Zhila, Alexander Gelbukh and Paolo
Rosso
- Abstract summary: This paper gives the overview of the first shared task at FIRE 2020 on fake news detection in the Urdu language.
The goal is to identify fake news using a dataset composed of 900 annotated news articles for training and 400 news articles for testing.
The dataset contains news in five domains: (i) Health, (ii) Sports, (iii) Showbiz, (iv) Technology, and (v) Business.
- Score: 62.6928395368204
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper gives the overview of the first shared task at FIRE 2020 on fake
news detection in the Urdu language. This is a binary classification task in
which the goal is to identify fake news using a dataset composed of 900
annotated news articles for training and 400 news articles for testing. The
dataset contains news in five domains: (i) Health, (ii) Sports, (iii) Showbiz,
(iv) Technology, and (v) Business. 42 teams from 6 different countries (India,
China, Egypt, Germany, Pakistan, and the UK) registered for the task. 9 teams
submitted their experimental results. The participants used various machine
learning methods ranging from feature-based traditional machine learning to
neural network techniques. The best performing system achieved an F-score value
of 0.90, showing that the BERT-based approach outperforms other machine
learning classifiers.
Related papers
- Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
Multiverse is a new feature based on multilingual evidence that can be used for fake news detection.
The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
arXiv Detail & Related papers (2022-11-25T18:24:17Z) - Combination Of Convolution Neural Networks And Deep Neural Networks For
Fake News Detection [0.0]
We have described the Fake News Challenge stage #1 dataset and given an overview of the competitive attempts to build a fake news detection system.
The proposed system detects all the categories with high accuracy except the disagree category.
As a result, the system achieves up to 84.6 % accuracy, classifying it as the second ranking based on other competitive studies.
arXiv Detail & Related papers (2022-10-15T16:32:51Z) - Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2020 [62.6928395368204]
Task was posed as a binary classification task, in which the goal is to differentiate between real and fake news.
We provided a dataset divided into 900 annotated news articles for training and 400 news articles for testing.
42 teams from 6 different countries (India, China, Egypt, Germany, Pakistan, and the UK) registered for the task.
arXiv Detail & Related papers (2022-07-25T03:41:32Z) - UrduFake@FIRE2021: Shared Track on Fake News Identification in Urdu [55.41644538483948]
This study reports the second shared task named as UrduFake@FIRE2021 on identifying fake news detection in Urdu language.
The proposed systems were based on various count-based features and used different classifiers as well as neural network architectures.
The gradient descent (SGD) algorithm outperformed other classifiers and achieved 0.679 F-score.
arXiv Detail & Related papers (2022-07-11T19:15:04Z) - Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2021 [55.41644538483948]
The goal of the shared task is to motivate the community to come up with efficient methods for solving this vital problem.
The training set contains 1300 annotated news articles -- 750 real news, 550 fake news, while the testing set contains 300 news articles -- 200 real, 100 fake news.
The best performing system obtained an F1-macro score of 0.679, which is lower than the past year's best result of 0.907 F1-macro.
arXiv Detail & Related papers (2022-07-11T18:58:36Z) - Faking Fake News for Real Fake News Detection: Propaganda-loaded
Training Data Generation [105.20743048379387]
We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda.
Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles.
Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
arXiv Detail & Related papers (2022-03-10T14:24:19Z) - BanFakeNews: A Dataset for Detecting Fake News in Bangla [1.4170999534105675]
We propose an annotated dataset of 50K news that can be used for building automated fake news detection systems.
We develop a benchmark system with state of the art NLP techniques to identify Bangla fake news.
arXiv Detail & Related papers (2020-04-19T07:42:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.