Align and Shine: Building High-Quality Sentence-Aligned Corpora for Multilingual Text Simplification

• URL: http://arxiv.org/abs/2605.09476v1
• Date: Sun, 10 May 2026 11:07:24 GMT
• Title: Align and Shine: Building High-Quality Sentence-Aligned Corpora for Multilingual Text Simplification
• Abstract summary: Text simplification plays a crucial role in improving the accessibility and comprehensibility of written information for diverse audiences.<n>Despite its importance, large-scale, high-quality datasets for training and evaluating text simplification models remain scarce for languages other than English.<n>This paper reports an experimental study on the collection and processing of crowd-sourced simplification data from comparable corpora to construct a corpus suitable for both training and testing text simplification systems across multiple languages.
• Score: 1.7569235627175406
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Text simplification plays a crucial role in improving the accessibility and comprehensibility of written information for diverse audiences, including language learners and readers with limited literacy. Despite its importance, large-scale, high-quality datasets for training and evaluating text simplification models remain scarce for languages other than English. This paper reports an experimental study on the collection and processing of crowd-sourced simplification data from comparable corpora to construct a corpus suitable for both training and testing text simplification systems across multiple languages (Catalan, English, French, Italian and Spanish). We report mechanisms for sentence-level alignment from document-level data. The resulting dataset of the aligned sentence pairs is publicly available.

Related papers

• Improving Semantic Proximity in Information Retrieval through Cross-Lingual Alignment [26.443216883777882]
  Cross-Lingual Information Retrieval (CLIR) has emerged as an important research area.<n>Most multilingual retrievers tend to prioritize unrelated English documents over the related document written in the same language as the query.<n>We propose a novel training strategy aimed at enhancing cross-lingual alignment.
  arXiv  Detail & Related papers  (2026-04-07T10:35:52Z)
• BhashaKritika: Building Synthetic Pretraining Data at Scale for Indic Languages [4.279942349440352]
  We present a systematic study on the generation and evaluation of synthetic multilingual pretraining data for Indic languages.<n>We construct a large-scale synthetic dataset BhashaKritika, comprising 540B tokens using 5 different techniques for 10 languages.<n>We analyze how language choice, both in the prompt instructions and document grounding, affects data quality.
  arXiv  Detail & Related papers  (2025-11-13T14:12:44Z)
• LangGPS: Language Separability Guided Data Pre-Selection for Joint Multilingual Instruction Tuning [49.22807995935406]
  Joint multilingual instruction tuning is a widely adopted approach to improve the multilingual instruction-following ability and downstream performance of large language models (LLMs)<n>Existing selection methods, often based on features like text quality, diversity, or task relevance, typically overlook the intrinsic linguistic structure of multilingual data.<n>We propose LangGPS, a lightweight two-stage pre-selection framework guided by language separability which quantifies how well samples in different languages can be distinguished in the model's representation space.
  arXiv  Detail & Related papers  (2025-11-13T12:02:32Z)
• Aligning Sentence Simplification with ESL Learner's Proficiency for Language Acquisition [11.700462697630696]
  This study aims to facilitate English as a Second Language learners' language acquisition by simplification.<n>We propose simplifying complex sentences to appropriate levels for learners while also increasing vocabulary coverage of the target level in the simplifications.<n>Our method employs token-level and sentence-level rewards, and iteratively trains the model on its self-generated outputs to guide the model to search for simplification hypotheses that satisfy the target attributes.
  arXiv  Detail & Related papers  (2025-02-17T05:32:56Z)
• Decomposed Prompting: Probing Multilingual Linguistic Structure Knowledge in Large Language Models [54.58989938395976]
  We introduce a decomposed prompting approach for sequence labeling tasks.<n>We test our method on the Universal Dependencies part-of-speech tagging dataset for 38 languages.
  arXiv  Detail & Related papers  (2024-02-28T15:15:39Z)
• A Novel Dataset for Financial Education Text Simplification in Spanish [4.475176409401273]
  In Spanish, there are few datasets that can be used to create text simplification systems. We created a dataset with 5,314 complex and simplified sentence pairs using established simplification rules.
  arXiv  Detail & Related papers  (2023-12-15T15:47:08Z)
• The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants [80.4837840962273]
  We present Belebele, a dataset spanning 122 language variants. This dataset enables the evaluation of text models in high-, medium-, and low-resource languages.
  arXiv  Detail & Related papers  (2023-08-31T17:43:08Z)
• A New Dataset and Empirical Study for Sentence Simplification in Chinese [50.0624778757462]
  This paper introduces CSS, a new dataset for assessing sentence simplification in Chinese. We collect manual simplifications from human annotators and perform data analysis to show the difference between English and Chinese sentence simplifications. In the end, we explore whether Large Language Models can serve as high-quality Chinese sentence simplification systems by evaluating them on CSS.
  arXiv  Detail & Related papers  (2023-06-07T06:47:34Z)
• Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings? [18.968571816913208]
  We provide a systematic comparison of methods to produce document-level representations from sentences based on LASER, LaBSE, and Sentence BERT pre-trained multilingual models. We show that a clever combination of sentence embeddings is usually better than encoding the full document as a single unit.
  arXiv  Detail & Related papers  (2023-04-28T12:11:21Z)
• Understanding Translationese in Cross-Lingual Summarization [106.69566000567598]
  Cross-lingual summarization (MS) aims at generating a concise summary in a different target language. To collect large-scale CLS data, existing datasets typically involve translation in their creation. In this paper, we first confirm that different approaches of constructing CLS datasets will lead to different degrees of translationese.
  arXiv  Detail & Related papers  (2022-12-14T13:41:49Z)
• Self-Supervised Representations Improve End-to-End Speech Translation [57.641761472372814]
  We show that self-supervised pre-trained features can consistently improve the translation performance. Cross-lingual transfer allows to extend to a variety of languages without or with little tuning.
  arXiv  Detail & Related papers  (2020-06-22T10:28:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.