BhashaSetu: A Data-Centric Approach to Low-Resource Machine Translation

• URL: http://arxiv.org/abs/2605.27050v1
• Date: Tue, 26 May 2026 14:03:20 GMT
• Title: BhashaSetu: A Data-Centric Approach to Low-Resource Machine Translation
• Abstract summary: BhashaSetu is a linguistically enriched English--Marathi parallel dataset addressing persistent data limitations in low-resource neural machine translation (NMT)<n>Our dataset comprises 2.78 million sentence pairs from heterogeneous sources including news, politics, healthcare, literature, and culture, with stemmed and lemmatized representations to support morphology-aware analysis.
• Score: 1.2546133965241097
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We present BhashaSetu, a linguistically enriched English--Marathi parallel dataset addressing persistent data limitations in low-resource neural machine translation (NMT). Marathi, spoken by over 95 million people, remains underrepresented in high-quality parallel corpora across diverse domains. Our dataset comprises 2.78 million sentence pairs from heterogeneous sources including news, politics, healthcare, literature, and culture, with stemmed and lemmatized representations to support morphology-aware analysis. We benchmark multiple state-of-the-art translation models using BLEU, spBLEU, chrF++, and TER metrics, and conduct parameter-efficient fine-tuning of NLLB-200-distilled-600M using LoRA. A key finding from our ablation: corpus-level deduplication is the single largest preprocessing contributor to downstream quality (removing it reduces performance by 1.17 BLEU and 2.21 chrF++), demonstrating that disciplined cross-source corpus hygiene is a low-cost, high-impact intervention for low-resource, morphologically rich languages. The dataset is publicly released to promote reproducible and linguistically informed low-resource NMT research.

Related papers

• Omnilingual MT: Machine Translation for 1,600 Languages [58.66170104105936]
  We present Omnilingual Machine Translation (OMT), the first machine translation system supporting more than 1,600 languages.<n>This scale is enabled by a comprehensive data strategy that integrates large public multilingual corpora with newly created datasets.<n>OMT models improve in cross-lingual transfer, being close to solving the "understanding" part of the puzzle in MT for the 1,600 evaluated.
  arXiv  Detail & Related papers  (2026-03-17T09:43:42Z)
• NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data [6.689013010749215]
  NagaNLP is a comprehensive open-source toolkit for Nagamese.<n>It relies on LLM-driven but human-validated synthetic data generation.<n>We train both discriminative and generative models.
  arXiv  Detail & Related papers  (2025-12-14T04:08:26Z)
• Leveraging the Cross-Domain & Cross-Linguistic Corpus for Low Resource NMT: A Case Study On Bhili-Hindi-English Parallel Corpus [3.435561406656216]
  The linguistic diversity of India poses significant machine translation challenges, especially for underrepresented tribal languages like Bhili.<n>This paper introduces Bhili-Hindi-English Parallel Corpus (BH EPC), the first and largest parallel corpus worldwide comprising 110,000 meticulously curated sentences across Bhili, Hindi, and English.<n>BH EPC spans critical domains such as education, administration, and news, establishing a valuable benchmark for research in low resource machine translation.
  arXiv  Detail & Related papers  (2025-11-01T10:39:56Z)
• Data Augmentation With Back translation for Low Resource languages: A case of English and Luganda [0.0]
  We explore the application of Back translation as a semi-supervised technique to enhance Neural Machine Translation models for the English-Luganda language pair.<n>Our methodology involves developing custom NMT models using both publicly available and web-crawled data, and applying Iterative and Incremental Back translation techniques.<n>The results of our study show significant improvements, with translation performance for the English-Luganda pair exceeding previous benchmarks by more than 10 BLEU score units across all translation directions.
  arXiv  Detail & Related papers  (2025-05-05T08:47:52Z)
• Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu [53.437954702561065]
  In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT.<n>This study systematically investigates how each type of resource, e.g., dictionary, grammar book, and retrieved parallel examples, affect the translation performance.<n>Our results indicate that high-quality dictionaries and good parallel examples are very helpful, while grammars hardly help.
  arXiv  Detail & Related papers  (2025-02-17T14:53:49Z)
• From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation [3.666125285899499]
  Many languages have insufficient data to train high-performing general neural machine translation (NMT) models.<n>Many of the world's languages have insufficient data to train high-performing general neural machine translation (NMT) models.
  arXiv  Detail & Related papers  (2024-12-01T21:06:08Z)
• When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale [73.69252847606212]
  We examine how denoising autoencoding (DAE) and backtranslation (BT) impact machine translation (MMT) We find that monolingual data generally helps MMT, but models are surprisingly brittle to domain mismatches, especially at smaller model scales. As scale increases, DAE transitions from underperforming the parallel-only baseline at 90M to converging with BT performance at 1.6B, and even surpassing it in low-resource.
  arXiv  Detail & Related papers  (2023-05-23T14:48:42Z)
• Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation [103.90963418039473]
  Bi-ACL is a framework that uses only target-side monolingual data and a bilingual dictionary to improve the performance of the MNMT model. We show that Bi-ACL is more effective both in long-tail languages and in high-resource languages.
  arXiv  Detail & Related papers  (2023-05-22T07:31:08Z)
• OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval [91.76575626229824]
  We present OneAligner, an alignment model specially designed for sentence retrieval tasks. When trained with all language pairs of a large-scale parallel multilingual corpus (OPUS-100), this model achieves the state-of-the-art result. We conclude through empirical results and analyses that the performance of the sentence alignment task depends mostly on the monolingual and parallel data size.
  arXiv  Detail & Related papers  (2022-05-17T19:52:42Z)
• AUGVIC: Exploiting BiText Vicinity for Low-Resource NMT [9.797319790710711]
  AUGVIC is a novel data augmentation framework for low-resource NMT. It exploits the vicinal samples of the given bitext without using any extra monolingual data explicitly. We show that AUGVIC helps to attenuate the discrepancies between relevant and distant-domain monolingual data in traditional back-translation.
  arXiv  Detail & Related papers  (2021-06-09T15:29:18Z)
• Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation [54.52971020087777]
  Using monolingual data significantly boosts the translation quality of low-resource languages in multilingual models. Self-supervision improves zero-shot translation quality in multilingual models. We get up to 33 BLEU on ro-en translation without any parallel data or back-translation.
  arXiv  Detail & Related papers  (2020-05-11T00:20:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.