Multilingual Reasoning Cascades Need More Context

• URL: http://arxiv.org/abs/2606.27306v1
• Date: Thu, 25 Jun 2026 17:26:46 GMT
• Title: Multilingual Reasoning Cascades Need More Context
• Abstract summary: We show that a context-aware translation cascade provides the original question, the English translated question, and the reasoning trace to the context of the final translation module.<n>Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation.
• Score: 36.84122814591169
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English translated question, and the reasoning trace to the context of the final translation module. We evaluate gains across nine multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.

Related papers

• Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning [75.46846056993418]
  Reasoning language models primarily reason in English regardless of the language they are prompted in.<n>This is inaccessible for non-English-speaking users, risks losing the intent of the original question, and forgoes knowledge more readily expressed in the target language.<n>In this work, we advance L2 reasoning, the ability of a model to reason consistently in the language of the user's prompt, thus building an in-language bridge between the prompt and the answer.
  arXiv  Detail & Related papers  (2026-09-09T16:56:25Z)
• Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering [48.94279718429342]
  We introduce Syfer, a framework for multilingual multi-hop question answering.<n>Syfer defers translation rather than applying it by default.<n> Experiments across multiple languages show that Syfer attains competitive accuracy.
  arXiv  Detail & Related papers  (2026-08-13T12:25:59Z)
• Learning When to Translate for Multilingual Reasoning [20.51941069559769]
  Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, but still exhibit substantial multilingual reasoning gaps.<n>English translation can mitigate these failures by expressing non-English inputs in a form that RLMs can more reliably interpret.<n>We propose Luar, a Language Understanding Boundary-aware Reinforcement Learning framework that trains RLMs to selectively invoke translation when direct understanding is unreliable.
  arXiv  Detail & Related papers  (2026-06-01T16:37:18Z)
• Align to the Pivot: Dual Alignment with Self-Feedback for Multilingual Math Reasoning [71.4175109189942]
  We present Pivot-Aligned Self-Feedback Multilingual Reasoning (PASMR)<n>This approach designates the model's primary language as the pivot language.<n>It establishes a cross-lingual self-feedback mechanism without relying on external correct answers or reward models.
  arXiv  Detail & Related papers  (2026-01-25T03:20:00Z)
• Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models? [18.99223776816893]
  Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still suffer from a multilingual reasoning gap.<n>This paper shows that the multilingual reasoning gap largely stems from failures in language understanding.<n>We propose Selective Translation, a simple yet effective strategy that translates the multilingual input into English only when an understanding failure is detected.
  arXiv  Detail & Related papers  (2025-10-31T08:17:59Z)
• The Translation Barrier Hypothesis: Multilingual Generation with Large Language Models Suffers from Implicit Translation Failure [47.37347291981968]
  We show that the failure of the translation stage, despite task-solving success, is an important culprit for the observed low quality of final outputs.<n>We quantify the extent to which either stage is responsible for final failure for a word translation task across 108 language pairs.
  arXiv  Detail & Related papers  (2025-06-28T02:09:21Z)
• Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Models [44.94287386776289]
  We identify textbfCross-lingual Collapse, a systematic drift in which a multilingual language model reverts to its dominant pre-training language.<n>Our experiments reveal three key findings: (i) GRPO rapidly amplifies pre-training language imbalances, leading to the erosion of low-resource languages within just a few hundred updates; (ii) language consistency reward mitigates this drift but does so at the expense of an almost 5 - 10 pp drop in accuracy.
  arXiv  Detail & Related papers  (2025-06-06T08:08:48Z)
• IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages [87.5457337866383]
  We introduce the Image-Grounded Language Understanding Evaluation benchmark. IGLUE brings together visual question answering, cross-modal retrieval, grounded reasoning, and grounded entailment tasks across 20 diverse languages. We find that translate-test transfer is superior to zero-shot transfer and that few-shot learning is hard to harness for many tasks.
  arXiv  Detail & Related papers  (2022-01-27T18:53:22Z)
• Multilingual Answer Sentence Reranking via Automatically Translated Data [97.98885151955467]
  We present a study on the design of multilingual Answer Sentence Selection (AS2) models, which are a core component of modern Question Answering (QA) systems. The main idea is to transfer data, created from one resource rich language, e.g., English, to other languages, less rich in terms of resources.
  arXiv  Detail & Related papers  (2021-02-20T03:52:08Z)
• XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning [68.57658225995966]
  Cross-lingual Choice of Plausible Alternatives (XCOPA) is a typologically diverse multilingual dataset for causal commonsense reasoning in 11 languages. We evaluate a range of state-of-the-art models on this novel dataset, revealing that the performance of current methods falls short compared to translation-based transfer.
  arXiv  Detail & Related papers  (2020-05-01T12:22:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.