Lingo_Research_Group at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection

• URL: http://arxiv.org/abs/2606.03334v1
• Date: Tue, 02 Jun 2026 08:41:54 GMT
• Title: Lingo_Research_Group at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection
• Abstract summary: We present a submission for SemEval-2026 Task 9: Multilingual Text Classification Challenge - Polarization Detection.<n>It covers all three subtasks: (1) binary polarization detection, (2) polarization type classification and (3) polarization manifestation identification.<n>We adopt a systematic approach of research on short designed prompts by considering twelve designed prompts that are different in terminology clarity.
• Score: 1.921560550802477
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Our submission presented in this paper is for SemEval-2026 Task 9: Multilingual Text Classification Challenge - Polarization Detection and it covers all three subtasks: (1) binary polarization detection, (2) polarization type classification and (3) polarization manifestation identification. We adopt a systematic approach of research on short designed prompts by considering twelve designed prompts that are different in terminology clarity, detail of the definition, guidance of reasoning and in-context examples use. The experiments are conducted using aya-101 and Gemma3-27B, with the latter chosen for the submission at the end of the development through performance considerations. Our system has an average macro level F1-score of 0.762 on Subtask 1, 0.587 on Subtask 2 and 0.444 on Subtask 3 with the average accuracy of 0.819, 0.678 and 0.498, respectively, on the official test set averaged among 22 languages, respectively. With cross-task and cross-lingual analysis, we demonstrate that prompt-based approaches can be used effectively to detect coarse grained polarization but encounter more and more difficulties as far as fine-grained and multi-label sociolinguistic classification is concerned.

Related papers

• Multilingual Polarization Detection Using Transformer-Based Models with Class Weighting and Threshold Tuning [0.0]
  We address binary polarization detection, polarization type classification, and manifestation identification for English and Swahili.<n>Our approach leverages transformer-based models with class-weighted loss functions to address severe label imbalance.<n>Our error analysis reveals that models struggle with dehumanization detection and lack of empathy.
  arXiv  Detail & Related papers  (2026-06-29T19:42:52Z)
• From Errors to Rules: Iterative Prompt Optimization for Text Classification [2.952559770088323]
  Error-Guided Optimization (ERGO) is an error-driven method that diagnoses classification failures and generates targeted decision rules.<n>ERGO achieves the best accuracy on tasks where errors concentrate in specific confused label pairs.<n>We provide a complementarity framework linking task characteristics to optimal paradigm selection, offering practical guidance for practitioners.
  arXiv  Detail & Related papers  (2026-06-15T23:39:06Z)
• YEZE at SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization via Heterogeneous Ensembling [3.3438708071539445]
  We propose a heterogeneous ensemble of multilingual pretrained models, combining XLM-RoBERTa-large and mDeBERTa-v3-base.<n>We investigate techniques such as multi-task learning, translation-based data augmentation, and class weighting to improve classification performance under severe label imbalance.
  arXiv  Detail & Related papers  (2026-05-07T13:21:40Z)
• SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization [47.011443052131376]
  We present SemEval-2026 Task 9, a shared task on online polarization detection, covering 22 languages and comprising over 110K annotated instances.<n>Participants were asked to predict labels in three sub-tasks: (1) detecting the presence of polarization, (2) identifying the type of polarization, and (3) recognizing the polarization manifestation.<n>We report the baseline results and analyze the performance of the best-performing systems, highlighting the most common approaches and the most effective methods across different subtasks and languages.
  arXiv  Detail & Related papers  (2026-04-08T08:34:55Z)
• Not All Pretraining are Created Equal: Threshold Tuning and Class Weighting for Imbalanced Polarization Tasks in Low-Resource Settings [0.0]
  This paper describes my submission to the Polarization Shared Task at SemEval-2025, which addresses polarization detection and classification in social media text.<n>I develop Transformer-based systems for English and Swahili across three subtasks: binary polarization detection, multi-label target type classification, and multi-label manifestation identification.
  arXiv  Detail & Related papers  (2026-03-08T15:50:37Z)
• Mario at EXIST 2025: A Simple Gateway to Effective Multilingual Sexism Detection [8.40042895828361]
  EXIST 2025 Task 1 addresses text-based sexism detection in English and Spanish tweets through hierarchical Low-Rank Adaptation (LoRA) of Llama 3.1 8B.<n>Our method introduces conditional adapter routing that explicitly models dependencies across three hierarchically structured subtasks.<n>Our approach reduces training time by 75% and model storage by 98%, while achieving competitive performance across all subtasks.
  arXiv  Detail & Related papers  (2025-07-15T05:30:32Z)
• Syntactic Control of Language Models by Posterior Inference [53.823006836309695]
  Controlling the syntactic structure of text generated by language models is valuable for applications requiring clarity, stylistic consistency, or interpretability.<n>We argue that sampling algorithms based on the posterior inference can effectively enforce a target constituency structure during generation.<n>Our approach combines sequential Monte Carlo, which estimates the posterior distribution by sampling from a proposal distribution, with a syntactic tagger that ensures that each generated token aligns with the desired syntactic structure.
  arXiv  Detail & Related papers  (2025-06-08T14:01:34Z)
• Less is More: Efficient Black-box Attribution via Minimal Interpretable Subset Selection [52.716143424856185]
  We propose LiMA (Less input is More faithful for Attribution), which reformulates the attribution of important regions as an optimization problem for submodular subset selection.<n>LiMA identifies both the most and least important samples while ensuring an optimal attribution boundary that minimizes errors.<n>Our method also outperforms the greedy search in attribution efficiency, being 1.6 times faster.
  arXiv  Detail & Related papers  (2025-04-01T06:58:15Z)
• SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection [76.18321723846616]
  Task covers more than 30 languages from seven distinct language families.<n>Data instances are multi-labeled with six emotional classes, with additional datasets in 11 languages annotated for emotion intensity.<n>Participants were asked to predict labels in three tracks: (a) multilabel emotion detection, (b) emotion intensity score detection, and (c) cross-lingual emotion detection.
  arXiv  Detail & Related papers  (2025-03-10T12:49:31Z)
• Ambiguity-Resistant Semi-Supervised Learning for Dense Object Detection [98.66771688028426]
  We propose a Ambiguity-Resistant Semi-supervised Learning (ARSL) for one-stage detectors. Joint-Confidence Estimation (JCE) is proposed to quantifies the classification and localization quality of pseudo labels. ARSL effectively mitigates the ambiguities and achieves state-of-the-art SSOD performance on MS COCO and PASCAL VOC.
  arXiv  Detail & Related papers  (2023-03-27T07:46:58Z)
• Assessing Data Efficiency in Task-Oriented Semantic Parsing [54.87705549021248]
  We introduce a four-stage protocol which gives an approximate measure of how much in-domain "target" data a requires to achieve a certain quality bar. We apply our protocol in two real-world case studies illustrating its flexibility and applicability to practitioners in task-oriented semantic parsing.
  arXiv  Detail & Related papers  (2021-07-10T02:43:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.