Samasāmayik: A Parallel Dataset for Hindi-Sanskrit Machine Translation

• URL: http://arxiv.org/abs/2603.24307v1
• Date: Wed, 25 Mar 2026 13:48:34 GMT
• Title: Samasāmayik: A Parallel Dataset for Hindi-Sanskrit Machine Translation
• Abstract summary: Samasmayik is a novel, meticulously curated, large-scale Hindi-Sanskrit corpus, comprising 92,196 parallel sentences.<n>We benchmark this new dataset by fine-tuning three complementary models - ByT5, NLLB and IndicTrans-v2 to demonstrate its utility.<n>Our experiments demonstrate that models trained on the Samasamayik corpus achieve significant performance gains on in-domain test data, while achieving comparable performance on other widely used test sets.
• Score: 12.522148604600341
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: We release Samasāmayik, a novel, meticulously curated, large-scale Hindi-Sanskrit corpus, comprising 92,196 parallel sentences. Unlike most data available in Sanskrit, which focuses on classical era text and poetry, this corpus aggregates data from diverse sources covering contemporary materials, including spoken tutorials, children's magazines, radio conversations, and instruction materials. We benchmark this new dataset by fine-tuning three complementary models - ByT5, NLLB and IndicTrans-v2, to demonstrate its utility. Our experiments demonstrate that models trained on the Samasamayik corpus achieve significant performance gains on in-domain test data, while achieving comparable performance on other widely used test sets, establishing a strong new performance baseline for contemporary Hindi-Sanskrit translation. Furthermore, a comparative analysis against existing corpora reveals minimal semantic and lexical overlap, confirming the novelty and non-redundancy of our dataset as a robust new resource for low-resource Indic language MT.

Related papers

• Mitrasamgraha: A Comprehensive Classical Sanskrit Machine Translation Dataset [26.899919193282944]
  Mitrasamgraha is a high-quality Sanskrit-to-English machine translation dataset consisting of 391,548 bitext pairs.<n>It covers a time period of more than three millennia and a broad range of historical Sanskrit domains.<n>We conduct experiments benchmarking commercial and open models on this dataset and fine-tune NLLB and Gemma models on the dataset.
  arXiv  Detail & Related papers  (2026-01-12T08:37:15Z)
• End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data [5.950263765640278]
  This paper explores the hypothesis that weakly labeled data can be used to build speech-to-text translation models.<n>We constructed datasets with the help of bitext mining using state-of-the-art sentence encoders.<n>Results demonstrate that ST systems can be built using weakly labeled data, with performance comparable to massive multi-modal multilingual baselines.
  arXiv  Detail & Related papers  (2025-06-19T12:11:01Z)
• Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsing [68.47787275021567]
  Cross-lingual semantic parsing transfers parsing capability from a high-resource language (e.g., English) to low-resource languages with scarce training data. We propose a new approach to cross-lingual semantic parsing by explicitly minimizing cross-lingual divergence between latent variables using Optimal Transport.
  arXiv  Detail & Related papers  (2023-07-09T04:52:31Z)
• Sāmayik: A Benchmark and Dataset for English-Sanskrit Translation [30.315293326789828]
  S=amayik is a dataset of around 53,000 parallel English-Sanskrit sentences, written in contemporary prose. S=amayik is curated from a diverse range of domains, including language instruction material, textual teaching pedagogy, and online tutorials.
  arXiv  Detail & Related papers  (2023-05-23T12:32:24Z)
• Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus [82.07304301996562]
  This paper presents a new dataset with rich discourse annotations, built upon the large-scale parallel corpus BWB introduced in Jiang et al. We investigate the similarities and differences between the discourse structures of source and target languages. We discover that MT outputs differ fundamentally from human translations in terms of their latent discourse structures.
  arXiv  Detail & Related papers  (2023-05-18T17:36:41Z)
• Unified Model Learning for Various Neural Machine Translation [63.320005222549646]
  Existing machine translation (NMT) studies mainly focus on developing dataset-specific models. We propose a versatile'' model, i.e., the Unified Model Learning for NMT (UMLNMT) that works with data from different tasks. OurNMT results in substantial improvements over dataset-specific models with significantly reduced model deployment costs.
  arXiv  Detail & Related papers  (2023-05-04T12:21:52Z)
• Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation [53.342921374639346]
  Multimodal machine translation aims to improve translation quality by incorporating information from other modalities, such as vision. Previous MMT systems mainly focus on better access and use of visual information and tend to validate their methods on image-related datasets. This paper establishes new methods and new datasets for MMT.
  arXiv  Detail & Related papers  (2022-12-20T15:02:38Z)
• Extract, Integrate, Compete: Towards Verification Style Reading Comprehension [66.2551168928688]
  We present a new verification style reading comprehension dataset named VGaokao from Chinese Language tests of Gaokao. To address the challenges in VGaokao, we propose a novel Extract-Integrate-Compete approach.
  arXiv  Detail & Related papers  (2021-09-11T01:34:59Z)
• Learning Contextualised Cross-lingual Word Embeddings and Alignments for Extremely Low-Resource Languages Using Parallel Corpora [63.5286019659504]
  We propose a new approach for learning contextualised cross-lingual word embeddings based on a small parallel corpus. Our method obtains word embeddings via an LSTM encoder-decoder model that simultaneously translates and reconstructs an input sentence.
  arXiv  Detail & Related papers  (2020-10-27T22:24:01Z)
• A Corpus for English-Japanese Multimodal Neural Machine Translation with Comparable Sentences [21.43163704217968]
  We propose a new multimodal English-Japanese corpus with comparable sentences that are compiled from existing image captioning datasets. Due to low translation scores in our baseline experiments, we believe that current multimodal NMT models are not designed to effectively utilize comparable sentence data.
  arXiv  Detail & Related papers  (2020-10-17T06:12:25Z)
• An Augmented Translation Technique for low Resource language pair: Sanskrit to Hindi translation [0.0]
  In this work, Zero Shot Translation (ZST) is inspected for a low resource language pair. The same architecture is tested for Sanskrit to Hindi translation for which data is sparse. Dimensionality reduction of word embedding is performed to reduce the memory usage for data storage.
  arXiv  Detail & Related papers  (2020-06-09T17:01:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.