New Textual Corpora for Serbian Language Modeling

• URL: http://arxiv.org/abs/2405.09250v1
• Date: Wed, 15 May 2024 11:05:16 GMT
• Title: New Textual Corpora for Serbian Language Modeling
• Authors: Mihailo Škorić, Nikola Janković,
• Abstract summary: The uniqueness of both old and new corpora will be accessed via frequency-based stylometric methods. The paper will introduce three new corpora: a new umbrella web corpus of Serbo-Croatian, a new high-quality corpus based on the doctoral dissertations stored within National Repository of Doctoral dissertations from all Universities in Serbia, and a parallel corpus of abstract translation from the same source.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper will present textual corpora for Serbian (and Serbo-Croatian), usable for the training of large language models and publicly available at one of the several notable online repositories. Each corpus will be classified using multiple methods and its characteristics will be detailed. Additionally, the paper will introduce three new corpora: a new umbrella web corpus of Serbo-Croatian, a new high-quality corpus based on the doctoral dissertations stored within National Repository of Doctoral Dissertations from all Universities in Serbia, and a parallel corpus of abstract translation from the same source. The uniqueness of both old and new corpora will be accessed via frequency-based stylometric methods, and the results will be briefly discussed.

Related papers

• A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference Corpus [71.77214818319054]
  Natural language inference is a proxy for natural language understanding. There is no publicly available NLI corpus for the Romanian language. We introduce the first Romanian NLI corpus (RoNLI) comprising 58K training sentence pairs.
  arXiv  Detail & Related papers  (2024-05-20T08:41:15Z)
• CLASSLA-web: Comparable Web Corpora of South Slavic Languages Enriched with Linguistic and Genre Annotation [4.450536872346658]
  This paper presents a collection of highly comparable web corpora of Slovenian, Croatian, Bosnian, Montenegrin, Serbian, Macedonian, and Bulgarian. The collection of these corpora comprises a total of 13 billion tokens of texts from 26 million documents. All the corpora were linguistically annotated with the state-of-the-art CLASSLA-Stanza linguistic processing pipeline.
  arXiv  Detail & Related papers  (2024-03-19T13:30:47Z)
• Novi jezi\v{c}ki modeli za srpski jezik [0.0]
  The paper will briefly present the development history of transformer-based language models for the Serbian language. Ten selected vectorization models for Serbian, including two new ones, will be compared on four natural language processing tasks.
  arXiv  Detail & Related papers  (2024-02-22T08:48:21Z)
• Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research [139.69207791947738]
  Dolma is a three-trillion-token English corpus built from a diverse mixture of web content, scientific papers, code, public-domain books, social media, and encyclopedic materials. We document Dolma, including its design principles, details about its construction, and a summary of its contents. We present analyses and experimental results on intermediate states of Dolma to share what we have learned about important data curation practices.
  arXiv  Detail & Related papers  (2024-01-31T20:29:50Z)
• Carolina: a General Corpus of Contemporary Brazilian Portuguese with Provenance, Typology and Versioning Information [0.629199190108771]
  Carolina is a large open corpus of Brazilian Portuguese texts under construction using web-as-corpus methodology. Carolina's first public version has $653,322,577$ tokens, distributed over $7$ broad types.
  arXiv  Detail & Related papers  (2023-03-28T16:09:40Z)
• Creating a morphological and syntactic tagged corpus for the Uzbek language [0.0]
  We develop a novel Part Of Speech (POS) and syntactic tagset for creating the syntactic and morphologically tagged corpus of the Uzbek language. Based on the developed annotation tool and the software, we share our experience results of the first stage of tagged corpus creation.
  arXiv  Detail & Related papers  (2022-10-27T07:44:12Z)
• A Bilingual Parallel Corpus with Discourse Annotations [82.07304301996562]
  This paper describes BWB, a large parallel corpus first introduced in Jiang et al. (2022), along with an annotated test set. The BWB corpus consists of Chinese novels translated by experts into English, and the annotated test set is designed to probe the ability of machine translation systems to model various discourse phenomena.
  arXiv  Detail & Related papers  (2022-10-26T12:33:53Z)
• The Open corpus of the Veps and Karelian languages: overview and applications [52.77024349608834]
  The Open Corpus of the Veps and Karelian Languages (VepKar) is an extension of the Veps created in 2009. The VepKar corpus comprises texts in Karelian and Veps, multifunctional dictionaries linked to them, and software with an advanced system of search. Future plans include developing a speech module for working with audio recordings and a syntactic tagging module using morphological analysis outputs.
  arXiv  Detail & Related papers  (2022-06-08T13:05:50Z)
• Models and Datasets for Cross-Lingual Summarisation [78.56238251185214]
  We present a cross-lingual summarisation corpus with long documents in a source language associated with multi-sentence summaries in a target language. The corpus covers twelve language pairs and directions for four European languages, namely Czech, English, French and German. We derive cross-lingual document-summary instances from Wikipedia by combining lead paragraphs and articles' bodies from language aligned Wikipedia titles.
  arXiv  Detail & Related papers  (2022-02-19T11:55:40Z)
• What's New? Summarizing Contributions in Scientific Literature [85.95906677964815]
  We introduce a new task of disentangled paper summarization, which seeks to generate separate summaries for the paper contributions and the context of the work. We extend the S2ORC corpus of academic articles by adding disentangled "contribution" and "context" reference labels. We propose a comprehensive automatic evaluation protocol which reports the relevance, novelty, and disentanglement of generated outputs.
  arXiv  Detail & Related papers  (2020-11-06T02:23:01Z)
• Know thy corpus! Robust methods for digital curation of Web corpora [0.0]
  This paper proposes a novel framework for digital curation of Web corpora. It provides robust estimation of their parameters, such as their composition and the lexicon.
  arXiv  Detail & Related papers  (2020-03-13T17:21:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.