HistNERo: Historical Named Entity Recognition for the Romanian Language

• URL: http://arxiv.org/abs/2405.00155v1
• Date: Tue, 30 Apr 2024 19:05:22 GMT
• Title: HistNERo: Historical Named Entity Recognition for the Romanian Language
• Abstract summary: HistNERo is the first Romanian corpus for Named Entity Recognition in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century. Eight native Romanian speakers annotated the dataset with five named entities.
• Score: 1.5924012820163407
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work introduces HistNERo, the first Romanian corpus for Named Entity Recognition (NER) in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of the 20th century (i.e., 1990). Eight native Romanian speakers annotated the dataset with five named entities. The samples belong to one of the following four historical regions of Romania, namely Bessarabia, Moldavia, Transylvania, and Wallachia. We employed this proposed dataset to perform several experiments for NER using Romanian pre-trained language models. Our results show that the best model achieved a strict F1-score of 55.69%. Also, by reducing the discrepancies between regions through a novel domain adaption technique, we improved the performance on this corpus to a strict F1-score of 66.80%, representing an absolute gain of more than 10%.

Related papers

• Open Source State-Of-the-Art Solution for Romanian Speech Recognition [47.27624927463166]
  We present a new Romanian Automatic Speech Recognition (ASR) system based on NVIDIA's FastConformer architecture.<n>We train our model on a large corpus of weakly supervised transcriptions, totaling over 2,600 hours of speech.<n>Our system achieves state-of-the-art performance across all Romanian evaluation benchmarks.
  arXiv  Detail & Related papers  (2025-11-05T11:02:16Z)
• Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval [49.1574468325115]
  We introduce Amharic-specific dense retrieval models based on pre-trained Amharic BERT and RoBERTa backbones.<n>Our proposed RoBERTa-Base-Amharic-Embed model (110M parameters) achieves a 17.6% relative improvement in MRR@10.<n>More compact variants, such as RoBERTa-Medium-Amharic-Embed (42M) remain competitive while being over 13x smaller.
  arXiv  Detail & Related papers  (2025-05-25T23:06:20Z)
• Low-Resource Transliteration for Roman-Urdu and Urdu Using Transformer-Based Models [0.6554326244334868]
  Transliteration between Urdu and its Romanized form, Roman Urdu, remains underexplored. We propose a transformer-based approach using the m2m100 multilingual translation model. Our model achieves strong transliteration performance, with Char-BLEU scores of 96.37 for Urdu->Roman-Urdu and 97.44 for Roman-Urdu->Urdu.
  arXiv  Detail & Related papers  (2025-03-27T14:18:50Z)
• Reddit is all you need: Authorship profiling for Romanian [49.1574468325115]
  Authorship profiling is the process of identifying an author's characteristics based on their writings. In this paper, we introduce a corpus of short texts in the Romanian language, annotated with certain author characteristic keywords.
  arXiv  Detail & Related papers  (2024-10-13T16:27:31Z)
• Exploring Fine-tuned Generative Models for Keyphrase Selection: A Case Study for Russian [1.565361244756411]
  We explored how to apply fine-tuned generative transformer-based models to the specific task of keyphrase selection within Russian scientific texts. Experiments were conducted on the texts of Russian scientific abstracts from four domains: mathematics & computer science, history, medicine, and linguistics. The use of generative models, namely mBART, led to gains in in-domain performance (up to 4.9% in BERTScore, 9.0% in ROUGE-1, and 12.2% in F1-score) over three keyphrase extraction baselines for the Russian language.
  arXiv  Detail & Related papers  (2024-09-16T18:15:28Z)
• A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference Corpus [71.77214818319054]
  Natural language inference is a proxy for natural language understanding. There is no publicly available NLI corpus for the Romanian language. We introduce the first Romanian NLI corpus (RoNLI) comprising 58K training sentence pairs.
  arXiv  Detail & Related papers  (2024-05-20T08:41:15Z)
• RoDia: A New Dataset for Romanian Dialect Identification from Speech [28.458975585210947]
  RoDia is the first dataset for Romanian dialect identification from speech. Includes speech samples from five distinct regions of Romania, covering both urban and rural environments. Top scoring model achieves a macro F1 score of 59.83% and a micro F1 score of 62.08%, indicating that the task is challenging.
  arXiv  Detail & Related papers  (2023-09-06T21:56:24Z)
• LyricSIM: A novel Dataset and Benchmark for Similarity Detection in Spanish Song LyricS [52.77024349608834]
  We present a new dataset and benchmark tailored to the task of semantic similarity in song lyrics. Our dataset, originally consisting of 2775 pairs of Spanish songs, was annotated in a collective annotation experiment by 63 native annotators.
  arXiv  Detail & Related papers  (2023-06-02T07:48:20Z)
• Ensemble Transfer Learning for Multilingual Coreference Resolution [60.409789753164944]
  A problem that frequently occurs when working with a non-English language is the scarcity of annotated training data. We design a simple but effective ensemble-based framework that combines various transfer learning techniques. We also propose a low-cost TL method that bootstraps coreference resolution models by utilizing Wikipedia anchor texts.
  arXiv  Detail & Related papers  (2023-01-22T18:22:55Z)
• Evaluation of Transfer Learning for Polish with a Text-to-Text Model [54.81823151748415]
  We introduce a new benchmark for assessing the quality of text-to-text models for Polish. The benchmark consists of diverse tasks and datasets: KLEJ benchmark adapted for text-to-text, en-pl translation, summarization, and question answering. We present plT5 - a general-purpose text-to-text model for Polish that can be fine-tuned on various Natural Language Processing (NLP) tasks with a single training objective.
  arXiv  Detail & Related papers  (2022-05-18T09:17:14Z)
• Improving Persian Relation Extraction Models by Data Augmentation [0.0]
  We present our augmented dataset and the results and findings of our system. We use PERLEX as the base dataset and enhance it by applying some text preprocessing steps. We then employ two different models including ParsBERT and multilingual BERT for relation extraction on the augmented PERLEX dataset.
  arXiv  Detail & Related papers  (2022-03-29T08:08:47Z)
• AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages [75.08199398141744]
  We present AmericasNLI, an extension of XNLI (Conneau et al.), to 10 indigenous languages of the Americas. We conduct experiments with XLM-R, testing multiple zero-shot and translation-based approaches. We find that XLM-R's zero-shot performance is poor for all 10 languages, with an average performance of 38.62%.
  arXiv  Detail & Related papers  (2021-04-18T05:32:28Z)
• A Precisely Xtreme-Multi Channel Hybrid Approach For Roman Urdu Sentiment Analysis [0.8812173669205371]
  This paper provides 3 neural word embeddings prepared using most widely used approaches namely Word2vec, FastText, and Glove. Considering the lack of publicly available benchmark datasets, it provides a first-ever Roman Urdu dataset which consists of 3241 sentiments annotated against positive, negative and neutral classes. It proposes a novel precisely extreme multi-channel hybrid methodology which outperforms state-of-the-art adapted machine and deep learning approaches by the figure of 9%, and 4% in terms of F1-score.
  arXiv  Detail & Related papers  (2020-03-11T04:08:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.