WojoodNER 2023: The First Arabic Named Entity Recognition Shared Task

• URL: http://arxiv.org/abs/2310.16153v1
• Date: Tue, 24 Oct 2023 19:50:07 GMT
• Title: WojoodNER 2023: The First Arabic Named Entity Recognition Shared Task
• Authors: Mustafa Jarrar, Muhammad Abdul-Mageed, Mohammed Khalilia, Bashar Talafha, AbdelRahim Elmadany, Nagham Hamad, Alaa' Omar
• Abstract summary: We present WojoodNER-2023, the first Arabic Named Entity Recognition (NER) Shared Task. WojoodNER-2023 encompassed two Subtasks: FlatNER and NestedNER. A total of 45 unique teams registered for this shared task, with 11 of them actively participating in the test phase.
• Score: 13.55190646427114
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present WojoodNER-2023, the first Arabic Named Entity Recognition (NER) Shared Task. The primary focus of WojoodNER-2023 is on Arabic NER, offering novel NER datasets (i.e., Wojood) and the definition of subtasks designed to facilitate meaningful comparisons between different NER approaches. WojoodNER-2023 encompassed two Subtasks: FlatNER and NestedNER. A total of 45 unique teams registered for this shared task, with 11 of them actively participating in the test phase. Specifically, 11 teams participated in FlatNER, while $8$ teams tackled NestedNER. The winning teams achieved F1 scores of 91.96 and 93.73 in FlatNER and NestedNER, respectively.

Related papers

• mucAI at WojoodNER 2024: Arabic Named Entity Recognition with Nearest Neighbor Search [0.0]
  We introduce Arabic KNN-NER, our submission to the Wojood NER Shared Task 2024 (ArabicNLP 2024) In this paper, we tackle fine-grained flat-entity recognition for Arabic text, where we identify a single main entity and possibly zero or multiple sub-entities for each word. Our submission achieved 91% on the test set on the WojoodFine dataset, placing Arabic KNN-NER on top of the leaderboard for the shared task.
  arXiv  Detail & Related papers  (2024-08-07T09:34:55Z)
• WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Task [13.55190646427114]
  WojoodNER-2024 encompassed three subtasks: (i) Closed-Track Flat Fine-Grained NER, (ii) Closed-Track Nested Fine-Grained NER, and (iii) an Open-Track NER for the Israeli War on Gaza. The winning teams achieved F-1 scores of 91% and 92% in the Flat Fine-Grained and Nested Fine-Grained Subtasks, respectively.
  arXiv  Detail & Related papers  (2024-07-13T16:17:08Z)
• NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Task [28.986040897360336]
  We describe the findings of the fourth Nuanced Arabic Dialect Identification Shared Task (NADI 2023) NADI 2023 targeted both dialect identification (Subtask 1) and dialect-to-MSA machine translation (Subtask 2 and Subtask 3). We describe the methods employed by the participating teams and briefly offer an outlook for NADI.
  arXiv  Detail & Related papers  (2023-10-24T18:41:24Z)
• NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval [49.827932299460514]
  We argue that capabilities provided by large language models are not the end of NER research, but rather an exciting beginning. We present three variants of the NER task, together with a dataset to support them. We provide a large, silver-annotated corpus of 4 million paragraphs covering 500 entity types.
  arXiv  Detail & Related papers  (2023-10-22T12:23:00Z)
• Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach [50.12455129619845]
  Named Entity Recognition (NER) aims to extract and classify entity mentions in the text into pre-defined types. We propose to incorporate the label dependencies among entity types into a multi-task learning framework for better MRC-based NER.
  arXiv  Detail & Related papers  (2023-09-20T03:15:05Z)
• DMNER: Biomedical Entity Recognition by Detection and Matching [4.183810138241028]
  Biomedical named entity recognition (BNER) serves as the foundation for numerous biomedical text mining tasks. We propose a novel BNER framework called DMNER to tackle BNER as a two-step process: entity boundary detection and biomedical entity matching. DMNER exhibits applicability across multiple NER scenarios.
  arXiv  Detail & Related papers  (2023-06-27T18:32:07Z)
• Gaussian Prior Reinforcement Learning for Nested Named Entity Recognition [52.46740830977898]
  We propose a novel seq2seq model named GPRL, which formulates the nested NER task as an entity triplet sequence generation process. Experiments on three nested NER datasets demonstrate that GPRL outperforms previous nested NER models.
  arXiv  Detail & Related papers  (2023-05-12T05:55:34Z)
• $k$NN-NER: Named Entity Recognition with Nearest Neighbor Search [47.901071142524906]
  $k$ nearest neighbor NER ($k$NN-NER) framework augments the distribution of entity labels by assigning $k$ nearest neighbors retrieved from the training set. $k$NN-NER requires no additional operation during the training phase, and by interpolating $k$ nearest neighbors search into the vanilla NER model, $k$NN-NER consistently outperforms its vanilla counterparts.
  arXiv  Detail & Related papers  (2022-03-31T15:21:43Z)
• AISHELL-NER: Named Entity Recognition from Chinese Speech [54.434118596263126]
  We introduce a new dataset AISEHLL-NER for NER from Chinese speech. The results demonstrate that the performance could be improved by combining-aware ASR and pretrained NER tagger.
  arXiv  Detail & Related papers  (2022-02-17T09:18:48Z)
• NEREL: A Russian Dataset with Nested Named Entities and Relations [55.69103749079697]
  We present NEREL, a Russian dataset for named entity recognition and relation extraction. It contains 56K annotated named entities and 39K annotated relations.
  arXiv  Detail & Related papers  (2021-08-30T10:40:20Z)
• A Unified Generative Framework for Various NER Subtasks [39.78805705711495]
  We propose to formulate the NER subtasks as an entity span sequence generation task. Based on our unified framework, we can leverage the pre-trained Seq2Seq model to solve all three kinds of NER subtasks. Our proposed framework is easy-to-implement and achieves state-of-the-art (SoTA) or near SoTA performance on eight English NER datasets.
  arXiv  Detail & Related papers  (2021-06-02T15:19:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.