SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles

• URL: http://arxiv.org/abs/2009.02696v1
• Date: Sun, 6 Sep 2020 10:05:43 GMT
• Title: SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles
• Authors: G. Da San Martino, A. Barr\'on-Cede\~no, H. Wachsmuth, R. Petrov, P. Nakov
• Abstract summary: We present the results of SemEval-2020 Task 11 on Detection of Propaganda Techniques in News Articles. The task featured two subtasks: Span Identification and Technique Classification. For both subtasks, the best systems used pre-trained Transformers and ensembles.
• Score: 0.6999740786886536
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present the results and the main findings of SemEval-2020 Task 11 on Detection of Propaganda Techniques in News Articles. The task featured two subtasks. Subtask SI is about Span Identification: given a plain-text document, spot the specific text fragments containing propaganda. Subtask TC is about Technique Classification: given a specific text fragment, in the context of a full document, determine the propaganda technique it uses, choosing from an inventory of 14 possible propaganda techniques. The task attracted a large number of participants: 250 teams signed up to participate and 44 made a submission on the test set. In this paper, we present the task, analyze the results, and discuss the system submissions and the methods they used. For both subtasks, the best systems used pre-trained Transformers and ensembles.

Related papers

• SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection [68.858931667807]
  Subtask A is a binary classification task determining whether a text is written by a human or generated by a machine. Subtask B is to detect the exact source of a text, discerning whether it is written by a human or generated by a specific LLM. Subtask C aims to identify the changing point within a text, at which the authorship transitions from human to machine.
  arXiv  Detail & Related papers  (2024-04-22T13:56:07Z)
• Findings of the WMT 2022 Shared Task on Translation Suggestion [63.457874930232926]
  We report the result of the first edition of the WMT shared task on Translation Suggestion. The task aims to provide alternatives for specific words or phrases given the entire documents generated by machine translation (MT) It consists two sub-tasks, namely, the naive translation suggestion and translation suggestion with hints.
  arXiv  Detail & Related papers  (2022-11-30T03:48:36Z)
• CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing [90.58269243992318]
  This paper introduces the shared task of summarizing documents in several creative domains, namely literary texts, movie scripts, and television scripts. We introduce four sub-tasks and their corresponding datasets, focusing on summarizing books, movie scripts, primetime television scripts, and daytime soap opera scripts. As part of the CREATIVESUMM workshop at COLING 2022, the shared task attracted 18 submissions in total.
  arXiv  Detail & Related papers  (2022-11-10T21:31:03Z)
• Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2020 [62.6928395368204]
  Task was posed as a binary classification task, in which the goal is to differentiate between real and fake news. We provided a dataset divided into 900 annotated news articles for training and 400 news articles for testing. 42 teams from 6 different countries (India, China, Egypt, Germany, Pakistan, and the UK) registered for the task.
  arXiv  Detail & Related papers  (2022-07-25T03:41:32Z)
• Solomon at SemEval-2020 Task 11: Ensemble Architecture for Fine-Tuned Propaganda Detection in News Articles [0.3232625980782302]
  This paper describes our system (Solomon) details and results of participation in the SemEval 2020 Task 11 "Detection of Propaganda Techniques in News Articles" We used RoBERTa based transformer architecture for fine-tuning on the propaganda dataset. Compared to the other participating systems, our submission is ranked 4th on the leaderboard.
  arXiv  Detail & Related papers  (2020-09-16T05:00:40Z)
• UPB at SemEval-2020 Task 11: Propaganda Detection with Domain-Specific Trained BERT [0.3437656066916039]
  This paper describes our participation in the SemEval-2020, Task 11: Detection of Propaganda Techniques in News Articles competition. Our approach considers specializing a pre-trained BERT model on propagandistic and hyperpartisan news articles. Our proposed system achieved a F1-score of 46.060% in subtask SI, ranking 5th in the leaderboard from 36 teams and a micro-averaged F1 score of 54.302% for subtask TC, ranking 19th from 32 teams.
  arXiv  Detail & Related papers  (2020-09-11T08:44:14Z)
• DUTH at SemEval-2020 Task 11: BERT with Entity Mapping for Propaganda Classification [1.5469452301122173]
  This report describes the methods employed by the Democritus University of Thrace (DUTH) team for participating in SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles.
  arXiv  Detail & Related papers  (2020-08-22T18:18:02Z)
• LTIatCMU at SemEval-2020 Task 11: Incorporating Multi-Level Features for Multi-Granular Propaganda Span Identification [70.1903083747775]
  This paper describes our submission for the task of Propaganda Span Identification in news articles. We introduce a BERT-BiLSTM based span-level propaganda classification model that identifies which token spans within the sentence are indicative of propaganda.
  arXiv  Detail & Related papers  (2020-08-11T16:14:47Z)
• SemEval-2020 Task 10: Emphasis Selection for Written Text in Visual Media [50.29389719723529]
  We present the main findings and compare the results of SemEval-2020 Task 10, Emphasis Selection for Written Text in Visual Media. The goal of this shared task is to design automatic methods for emphasis selection. The analysis of systems submitted to the task indicates that BERT and RoBERTa were the most common choice of pre-trained models used.
  arXiv  Detail & Related papers  (2020-08-07T17:24:53Z)
• newsSweeper at SemEval-2020 Task 11: Context-Aware Rich Feature Representations For Propaganda Classification [2.0491741153610334]
  This paper describes our submissions to SemEval 2020 Task 11: Detection of Propaganda Techniques in News Articles. We make use of pre-trained BERT language model enhanced with tagging techniques developed for the task of Named Entity Recognition. For the second subtask, we incorporate contextual features in a pre-trained RoBERTa model for the classification of propaganda techniques.
  arXiv  Detail & Related papers  (2020-07-21T14:06:59Z)
• BPGC at SemEval-2020 Task 11: Propaganda Detection in News Articles with Multi-Granularity Knowledge Sharing and Linguistic Features based Ensemble Learning [2.8913142991383114]
  SemEval 2020 Task-11 aims to design automated systems for news propaganda detection. Task-11 consists of two sub-tasks, namely, Span Identification and Technique Classification.
  arXiv  Detail & Related papers  (2020-05-31T19:35:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.