NADI 2020: The First Nuanced Arabic Dialect Identification Shared Task

• URL: http://arxiv.org/abs/2010.11334v3
• Date: Mon, 9 Nov 2020 19:18:33 GMT
• Title: NADI 2020: The First Nuanced Arabic Dialect Identification Shared Task
• Authors: Muhammad Abdul-Mageed, Chiyu Zhang, Houda Bouamor and Nizar Habash
• Abstract summary: We present the results and findings of the First Nuanced Arabic Dialect Identification Shared Task (NADI) Data for the shared task covers a total of 100 provinces from 21 Arab countries and are collected from the Twitter domain. NADI is the first shared task to target naturally-occurring fine-grained dialectal text at the sub-country level.
• Score: 18.23153068720659
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present the results and findings of the First Nuanced Arabic Dialect Identification Shared Task (NADI). This Shared Task includes two subtasks: country-level dialect identification (Subtask 1) and province-level sub-dialect identification (Subtask 2). The data for the shared task covers a total of 100 provinces from 21 Arab countries and are collected from the Twitter domain. As such, NADI is the first shared task to target naturally-occurring fine-grained dialectal text at the sub-country level. A total of 61 teams from 25 countries registered to participate in the tasks, thus reflecting the interest of the community in this area. We received 47 submissions for Subtask 1 from 18 teams and 9 submissions for Subtask 2 from 9 teams.

Related papers

• Findings of the IWSLT 2024 Evaluation Campaign [102.7608597658451]
  The paper reports on the shared tasks organized by the 21st IWSLT Conference. The shared tasks address 7 scientific challenges in spoken language translation.
  arXiv  Detail & Related papers  (2024-11-07T19:11:55Z)
• NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task [28.40134178913119]
  We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024) NADI 2024 targeted both dialect identification cast as a multi-label task and identification of the Arabic level of dialectness. Winning teams achieved 50.57 Ftextsubscript1 on Subtask1, 0.1403 RMSE for Subtask2, and 20.44 BLEU in Subtask3, respectively.
  arXiv  Detail & Related papers  (2024-07-06T01:18:58Z)
• SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection [68.858931667807]
  Subtask A is a binary classification task determining whether a text is written by a human or generated by a machine. Subtask B is to detect the exact source of a text, discerning whether it is written by a human or generated by a specific LLM. Subtask C aims to identify the changing point within a text, at which the authorship transitions from human to machine.
  arXiv  Detail & Related papers  (2024-04-22T13:56:07Z)
• SemEval 2024 -- Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF) [61.49972925493912]
  SemEval-2024 Task 10 is a shared task centred on identifying emotions in code-mixed dialogues. This task comprises three distinct subtasks - emotion recognition in conversation for code-mixed dialogues, emotion flip reasoning for code-mixed dialogues, and emotion flip reasoning for English dialogues. A total of 84 participants engaged in this task, with the most adept systems attaining F1-scores of 0.70, 0.79, and 0.76 for the respective subtasks.
  arXiv  Detail & Related papers  (2024-02-29T08:20:06Z)
• NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Task [28.986040897360336]
  We describe the findings of the fourth Nuanced Arabic Dialect Identification Shared Task (NADI 2023) NADI 2023 targeted both dialect identification (Subtask 1) and dialect-to-MSA machine translation (Subtask 2 and Subtask 3). We describe the methods employed by the participating teams and briefly offer an outlook for NADI.
  arXiv  Detail & Related papers  (2023-10-24T18:41:24Z)
• Findings of the WMT 2022 Shared Task on Translation Suggestion [63.457874930232926]
  We report the result of the first edition of the WMT shared task on Translation Suggestion. The task aims to provide alternatives for specific words or phrases given the entire documents generated by machine translation (MT) It consists two sub-tasks, namely, the naive translation suggestion and translation suggestion with hints.
  arXiv  Detail & Related papers  (2022-11-30T03:48:36Z)
• NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Task [16.688997360734472]
  Third Nuanced Arabic Dialect Identification Shared Task (NADI 2022) NADI 2022 targeted both dialect identification (Subtask 1) and dialectal sentiment analysis (Subtask 2) at the country level. Winning team achieved 27.06 F1 on Subtask 1 and F1=75.16 on Subtask 2.
  arXiv  Detail & Related papers  (2022-10-18T04:31:05Z)
• Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021 [50.591267188664666]
  We present two shared tasks of abusive and threatening language detection for the Urdu language. We present two manually annotated datasets containing tweets labelled as (i) Abusive and Non-Abusive, and (ii) Threatening and Non-Threatening. For both subtasks, m-Bert based transformer model showed the best performance.
  arXiv  Detail & Related papers  (2022-07-14T07:38:13Z)
• UrduFake@FIRE2021: Shared Track on Fake News Identification in Urdu [55.41644538483948]
  This study reports the second shared task named as UrduFake@FIRE2021 on identifying fake news detection in Urdu language. The proposed systems were based on various count-based features and used different classifiers as well as neural network architectures. The gradient descent (SGD) algorithm outperformed other classifiers and achieved 0.679 F-score.
  arXiv  Detail & Related papers  (2022-07-11T19:15:04Z)
• NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Task [20.34810224205086]
  This Shared Task includes four subtasks: country-level Modern Standard Arabic (MSA) identification (Subtask 1.1), country-level dialect identification (Subtask 1.2), and province-level sub-dialect identification (Subtask 2.1) The dataset covers a total of 100 provinces from 21 Arab countries, collected from the Twitter domain. A total of 53 teams from 23 countries registered to participate in the tasks, thus reflecting the interest of the community in this area.
  arXiv  Detail & Related papers  (2021-03-04T04:59:37Z)
• Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT [0.0]
  This paper presents our approach to address the EACL WANLP-2021 Shared Task 1: Nuanced Arabic Dialect Identification (NADI) The task is aimed at developing a system that identifies the geographical location(country/province) from where an Arabic tweet in the form of modern standard Arabic or dialect comes from.
  arXiv  Detail & Related papers  (2021-02-19T05:39:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.