Creating Lexical Resources for Endangered Languages

• URL: http://arxiv.org/abs/2208.03876v1
• Date: Mon, 8 Aug 2022 02:31:28 GMT
• Title: Creating Lexical Resources for Endangered Languages
• Authors: Khang Nhut Lam, Feras Al Tarouti and Jugal Kalita
• Abstract summary: Our algorithms construct bilingual dictionaries and multilingual thesauruses using public Wordnets and a machine translator (MT) Since our work relies on only one bilingual dictionary between an endangered language and an "intermediate helper" language, it is applicable to languages that lack many existing resources.
• Score: 2.363388546004777
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This paper examines approaches to generate lexical resources for endangered languages. Our algorithms construct bilingual dictionaries and multilingual thesauruses using public Wordnets and a machine translator (MT). Since our work relies on only one bilingual dictionary between an endangered language and an "intermediate helper" language, it is applicable to languages that lack many existing resources.

Related papers

• Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon [78.12363425794214]
  We focus on zero-shot sentiment analysis tasks across 34 languages, including 6 high/medium-resource languages, 25 low-resource languages, and 3 code-switching datasets. We demonstrate that pretraining using multilingual lexicons, without using any sentence-level sentiment data, achieves superior zero-shot performance compared to models fine-tuned on English sentiment datasets.
  arXiv  Detail & Related papers  (2024-02-03T10:41:05Z)
• Multilingual Word Embeddings for Low-Resource Languages using Anchors and a Chain of Related Languages [54.832599498774464]
  We propose to build multilingual word embeddings (MWEs) via a novel language chain-based approach. We build MWEs one language at a time by starting from the resource rich source and sequentially adding each language in the chain till we reach the target. We evaluate our method on bilingual lexicon induction for 4 language families, involving 4 very low-resource (5M tokens) and 4 moderately low-resource (50M) target languages.
  arXiv  Detail & Related papers  (2023-11-21T09:59:29Z)
• Automatically Creating a Large Number of New Bilingual Dictionaries [2.363388546004777]
  This paper proposes approaches to automatically create a large number of new bilingual dictionaries for low-resource languages. Our algorithms produce translations of words in a source language to plentiful target languages using available Wordnets and a machine translator.
  arXiv  Detail & Related papers  (2022-08-12T04:25:23Z)
• Creating Reverse Bilingual Dictionaries [2.792030485253753]
  We propose algorithms for creation of new reverse bilingual dictionaries from existing bilingual dictionaries. Our algorithms exploit the similarity between word-concept pairs using the English Wordnet to produce reverse dictionary entries.
  arXiv  Detail & Related papers  (2022-08-08T01:41:55Z)
• When Word Embeddings Become Endangered [0.685316573653194]
  We present a method for constructing word embeddings for endangered languages using existing word embeddings of different resource-rich languages and translation dictionaries of resource-poor languages. All our cross-lingual word embeddings and the sentiment analysis model have been released openly via an easy-to-use Python library.
  arXiv  Detail & Related papers  (2021-03-24T15:42:53Z)
• Revisiting Language Encoding in Learning Multilingual Representations [70.01772581545103]
  We propose a new approach called Cross-lingual Language Projection (XLP) to replace language embedding. XLP projects the word embeddings into language-specific semantic space, and then the projected embeddings will be fed into the Transformer model. Experiments show that XLP can freely and significantly boost the model performance on extensive multilingual benchmark datasets.
  arXiv  Detail & Related papers  (2021-02-16T18:47:10Z)
• Anchor-based Bilingual Word Embeddings for Low-Resource Languages [76.48625630211943]
  Good quality monolingual word embeddings (MWEs) can be built for languages which have large amounts of unlabeled text. MWEs can be aligned to bilingual spaces using only a few thousand word translation pairs. This paper proposes a new approach for building BWEs in which the vector space of the high resource source language is used as a starting point.
  arXiv  Detail & Related papers  (2020-10-23T19:17:00Z)
• Discovering Bilingual Lexicons in Polyglot Word Embeddings [32.53342453685406]
  In this work, we utilize a single Skip-gram model trained on a multilingual corpus yielding polyglot word embeddings. We present a novel finding that a surprisingly simple constrained nearest-neighbor sampling technique can retrieve bilingual lexicons. Across three European language pairs, we observe that polyglot word embeddings indeed learn a rich semantic representation of words.
  arXiv  Detail & Related papers  (2020-08-31T03:57:50Z)
• Bridging Linguistic Typology and Multilingual Machine Translation with Multi-View Language Representations [83.27475281544868]
  We use singular vector canonical correlation analysis to study what kind of information is induced from each source. We observe that our representations embed typology and strengthen correlations with language relationships. We then take advantage of our multi-view language vector space for multilingual machine translation, where we achieve competitive overall translation accuracy.
  arXiv  Detail & Related papers  (2020-04-30T16:25:39Z)
• Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity [67.36239720463657]
  Multi-SimLex is a large-scale lexical resource and evaluation benchmark covering datasets for 12 diverse languages. Each language dataset is annotated for the lexical relation of semantic similarity and contains 1,888 semantically aligned concept pairs. Owing to the alignment of concepts across languages, we provide a suite of 66 cross-lingual semantic similarity datasets.
  arXiv  Detail & Related papers  (2020-03-10T17:17:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.