SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization

• URL: http://arxiv.org/abs/2604.06817v1
• Date: Wed, 08 Apr 2026 08:34:55 GMT
• Title: SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization
• Abstract summary: We present SemEval-2026 Task 9, a shared task on online polarization detection, covering 22 languages and comprising over 110K annotated instances.<n>Participants were asked to predict labels in three sub-tasks: (1) detecting the presence of polarization, (2) identifying the type of polarization, and (3) recognizing the polarization manifestation.<n>We report the baseline results and analyze the performance of the best-performing systems, highlighting the most common approaches and the most effective methods across different subtasks and languages.
• Score: 47.011443052131376
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present SemEval-2026 Task 9, a shared task on online polarization detection, covering 22 languages and comprising over 110K annotated instances. Each data instance is multi-labeled with the presence of polarization, polarization type, and polarization manifestation. Participants were asked to predict labels in three sub-tasks: (1) detecting the presence of polarization, (2) identifying the type of polarization, and (3) recognizing the polarization manifestation. The three tasks attracted over 1,000 participants worldwide and more than 10k submission on Codabench. We received final submissions from 67 teams and 73 system description papers. We report the baseline results and analyze the performance of the best-performing systems, highlighting the most common approaches and the most effective methods across different subtasks and languages. The dataset of this task is publicly available.

Related papers

• Lingo_Research_Group at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection [1.921560550802477]
  We present a submission for SemEval-2026 Task 9: Multilingual Text Classification Challenge - Polarization Detection.<n>It covers all three subtasks: (1) binary polarization detection, (2) polarization type classification and (3) polarization manifestation identification.<n>We adopt a systematic approach of research on short designed prompts by considering twelve designed prompts that are different in terminology clarity.
  arXiv  Detail & Related papers  (2026-06-02T08:41:54Z)
• YEZE at SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization via Heterogeneous Ensembling [3.3438708071539445]
  We propose a heterogeneous ensemble of multilingual pretrained models, combining XLM-RoBERTa-large and mDeBERTa-v3-base.<n>We investigate techniques such as multi-task learning, translation-based data augmentation, and class weighting to improve classification performance under severe label imbalance.
  arXiv  Detail & Related papers  (2026-05-07T13:21:40Z)
• SemEval-2026 Task 7: Everyday Knowledge Across Diverse Languages and Cultures [93.36078244548077]
  The task data consist of an extended version of our manually constructed BLEnD benchmark (Myung et al. 2024), covering more than 30 language-culture pairs.<n>As the task is designed strictly for evaluation, participants were not permitted to use the data for training, fine-tuning, few-shot learning, or any other form of model modification.<n>We report the results and present an analysis of the best-performing systems and the most commonly adopted approaches.
  arXiv  Detail & Related papers  (2026-05-04T13:49:44Z)
• Not All Pretraining are Created Equal: Threshold Tuning and Class Weighting for Imbalanced Polarization Tasks in Low-Resource Settings [0.0]
  This paper describes my submission to the Polarization Shared Task at SemEval-2025, which addresses polarization detection and classification in social media text.<n>I develop Transformer-based systems for English and Swahili across three subtasks: binary polarization detection, multi-label target type classification, and multi-label manifestation identification.
  arXiv  Detail & Related papers  (2026-03-08T15:50:37Z)
• POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization [7.747535418644144]
  POLAR is a multilingual, multicultural, and multievent dataset with over 23k instances in seven languages.<n>We fine-tune six multilingual pretrained language models in both monolingual and cross-lingual setups.<n>We evaluate a range of open and closed large language models (LLMs) in few-shot and zero-shot scenarios.
  arXiv  Detail & Related papers  (2025-05-27T02:04:58Z)
• JNLP at SemEval-2025 Task 11: Cross-Lingual Multi-Label Emotion Detection Using Generative Models [3.1605924602008373]
  This study addresses SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection.<n>Our paper focuses on two sub-tracks of this task: (1) Track A: Multi-label emotion detection, and (2) Track B: Emotion intensity.<n>We propose two methods for handling multi-label classification: the base method, which maps an input directly to all its corresponding emotion labels, and the pairwise method, which models the relationship between the input text and each emotion category individually.
  arXiv  Detail & Related papers  (2025-05-19T15:24:53Z)
• SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection [76.18321723846616]
  Task covers more than 30 languages from seven distinct language families.<n>Data instances are multi-labeled with six emotional classes, with additional datasets in 11 languages annotated for emotion intensity.<n>Participants were asked to predict labels in three tracks: (a) multilabel emotion detection, (b) emotion intensity score detection, and (c) cross-lingual emotion detection.
  arXiv  Detail & Related papers  (2025-03-10T12:49:31Z)
• BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages [93.92804151830744]
  We present BRIGHTER, a collection of multi-labeled, emotion-annotated datasets in 28 different languages.<n>We highlight the challenges related to the data collection and annotation processes.<n>We show that the BRIGHTER datasets represent a meaningful step towards addressing the gap in text-based emotion recognition.
  arXiv  Detail & Related papers  (2025-02-17T15:39:50Z)
• SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes [48.83290963506378]
  This paper presents the results of the SHROOM, a shared task focused on detecting hallucinations. We observe a number of key trends in how this approach was tackled. While a majority of the teams did outperform our proposed baseline system, the performances of top-scoring systems are still consistent with a random handling of the more challenging items.
  arXiv  Detail & Related papers  (2024-03-12T15:06:22Z)
• Multimodal Fusion Interactions: A Study of Human and Automatic Quantification [116.55145773123132]
  We study how humans annotate two categorizations of multimodal interactions. We propose a method to automatically convert annotations of partial and counterfactual labels to information decomposition.
  arXiv  Detail & Related papers  (2023-06-07T03:44:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.