Polarization Detection: A Hybrid Approach with AfroXLMR-Social and DeBERTa for Low- and High-Resource Settings

• URL: http://arxiv.org/abs/2607.10312v1
• Date: Sat, 11 Jul 2026 13:37:55 GMT
• Title: Polarization Detection: A Hybrid Approach with AfroXLMR-Social and DeBERTa for Low- and High-Resource Settings
• Abstract summary: This paper presents our system description for the POLAR Task 2026, focusing on the detection and characterization of polarized discourse in English and Hausa.<n>We propose a hybrid modeling strategy for English binary detection, we leverage the monolingual strength of textbfDeBERTa.<n>We report competitive results across all three subtasks, demonstrating that model selection tailored to specific subtask requirements yields the best balance of performance.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rapid proliferation of online polarization threatens social cohesion, necessitating robust automated detection systems that operate effectively across diverse linguistic contexts. This paper presents our system description for the POLAR Shared Task 2026, focusing on the detection and characterization of polarized discourse in English and Hausa. We propose a hybrid modeling strategy: for English binary detection, we leverage the monolingual strength of \textbf{DeBERTa}, while for Hausa and all fine-grained subtasks (Types and Manifestations), we utilize \textbf{AfroXLMR-Social}. This domain-adapted multilingual model proved critical for capturing the nuances of polarization in social media text. To further address computational constraints and data scarcity, we implement Low-Rank Adaptation (LoRA) and textual data augmentation via \texttt{nlpaug}. We report competitive results across all three subtasks, demonstrating that model selection tailored to specific subtask requirements yields the best balance of performance.

Related papers

• Convex Low-resource Accent-Robust Language Detection in Speech Recognition [47.409626500688866]
  Current spoken dialogue systems frequently fail on under-represented dialects and accents.<n>We propose Convex Language Detection (CLD), a novel framework that integrates theoretically grounded convex optimization techniques into the spoken dialogue systems pipeline.
  arXiv  Detail & Related papers  (2026-05-22T05:06:44Z)
• YEZE at SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization via Heterogeneous Ensembling [3.3438708071539445]
  We propose a heterogeneous ensemble of multilingual pretrained models, combining XLM-RoBERTa-large and mDeBERTa-v3-base.<n>We investigate techniques such as multi-task learning, translation-based data augmentation, and class weighting to improve classification performance under severe label imbalance.
  arXiv  Detail & Related papers  (2026-05-07T13:21:40Z)
• mdok-style at SemEval-2026 Task 9: Finetuning LLMs for Multilingual Polarization Detection [5.3677118215189585]
  SemEval-2026 Task 9 is focused on multilingual polarization detection.<n>It covers the identification of multilingual, multicultural and multievent polarization along three axes, namely detection, type, and manifestation.<n>We have coped with this SemEval task by finetuning mid-size LLMs for the sequence-classification task using the QLoRA parameter-efficient finetuning technique.<n>The training data augmented the multilingual (22 languages) training sets by anonymized, lower-cased, upper-cased, and homoglyphied counterparts, making the detection more robust.
  arXiv  Detail & Related papers  (2026-05-04T15:08:24Z)
• All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG [87.74635133954975]
  We show that current Multilingual Retrieval-Augmented Generation (mRAG) systems suffer from a language bias during reranking.<n>We propose textittextbfLanguage-textbfAgnostic textbfUtility-driven textbfReranker textbfAlignment (LAURA), which aligns multilingual evidence ranking with downstream generative utility.
  arXiv  Detail & Related papers  (2026-04-22T05:33:06Z)
• BITS Pilani at SemEval-2026 Task 9: Structured Supervised Fine-Tuning with DPO Refinement for Polarization Detection [2.2588605422113606]
  We present a two-stage approach for detecting political polarization in social media text.<n>We fine-tune Qwen 2.5-7B-Instruct with LoRA using an interpretable slot-filling template.<n>Experiments on the SemEval 2026 POLAR shared task dataset show that preference-based refinement improves both accuracy and decreases false negatives without extra annotation.
  arXiv  Detail & Related papers  (2026-04-13T07:35:17Z)
• Solar Open Technical Report [65.93022715874504]
  Solar Open demonstrates a systematic methodology for building competitive LLMs.<n>We synthesize 4.5T tokens of high-quality, domain-specific, and RL-oriented data.<n>We apply our proposed framework SnapPO for efficient optimization.
  arXiv  Detail & Related papers  (2026-01-11T18:33:09Z)
• A fully automated and scalable Parallel Data Augmentation for Low Resource Languages using Image and Text Analytics [2.943391000885789]
  This paper presents a novel scalable and fully automated methodology to extract bilingual parallel corpora from newspaper articles.<n>We validate our approach by building parallel data corpus for two different language combinations and demonstrate the value of this dataset through a downstream task of machine translation.
  arXiv  Detail & Related papers  (2025-10-15T06:57:23Z)
• POLAR: A Benchmark for Multilingual, Multicultural, and Multi-Event Online Polarization [7.747535418644144]
  POLAR is a multilingual, multicultural, and multievent dataset with over 23k instances in seven languages.<n>We fine-tune six multilingual pretrained language models in both monolingual and cross-lingual setups.<n>We evaluate a range of open and closed large language models (LLMs) in few-shot and zero-shot scenarios.
  arXiv  Detail & Related papers  (2025-05-27T02:04:58Z)
• Extreme Speech Classification in the Era of LLMs: Exploring Open-Source and Proprietary Models [0.30693357740321775]
  ChatGPT has drawn global attention to the potential applications of Large Language Models (LLMs)<n>We leverage the Indian subset of the extreme speech dataset from Maronikolakis et al. (2022) to develop an effective classification framework using LLMs.<n>We evaluate open-source Llama models against closed-source OpenAI models, finding that while pre-trained LLMs show moderate efficacy, fine-tuning with domain-specific data significantly enhances performance.
  arXiv  Detail & Related papers  (2025-02-21T02:31:05Z)
• DPP-Based Adversarial Prompt Searching for Lanugage Models [56.73828162194457]
  Auto-regressive Selective Replacement Ascent (ASRA) is a discrete optimization algorithm that selects prompts based on both quality and similarity with determinantal point process (DPP) Experimental results on six different pre-trained language models demonstrate the efficacy of ASRA for eliciting toxic content.
  arXiv  Detail & Related papers  (2024-03-01T05:28:06Z)
• Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue [71.15186328127409]
  Paralinguistics-enhanced Generative Pretrained Transformer (ParalinGPT) Model takes the conversational context of text, speech embeddings, and paralinguistic attributes as input prompts within a serialized multitasking framework. We utilize the Switchboard-1 corpus, including its sentiment labels as the paralinguistic attribute, as our spoken dialogue dataset.
  arXiv  Detail & Related papers  (2023-12-23T18:14:56Z)
• Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation [103.90963418039473]
  Bi-ACL is a framework that uses only target-side monolingual data and a bilingual dictionary to improve the performance of the MNMT model. We show that Bi-ACL is more effective both in long-tail languages and in high-resource languages.
  arXiv  Detail & Related papers  (2023-05-22T07:31:08Z)
• Joint Contextual Modeling for ASR Correction and Language Understanding [60.230013453699975]
  We propose multi-task neural approaches to perform contextual language correction on ASR outputs jointly with language understanding (LU) We show that the error rates of off the shelf ASR and following LU systems can be reduced significantly by 14% relative with joint models trained using small amounts of in-domain data.
  arXiv  Detail & Related papers  (2020-01-28T22:09:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.