The Illusion of Cross-Lingual Safety in Low-Resource Languages

• URL: http://arxiv.org/abs/2608.11146v1
• Date: Tue, 11 Aug 2026 17:05:26 GMT
• Title: The Illusion of Cross-Lingual Safety in Low-Resource Languages
• Abstract summary: Safety alignment in large language models (LLMs) is largely developed in English, assuming these safeguards generalize across multilingual settings.<n>We investigate cross-lingual safety transfer in four African languages, Twi, Hausa, Amharic, and Swahili, using LoDNA, a new safety dataset that pairs literal translations with culturally localized prompts.<n>Our experimental results show that cross-lingual safety transfer is severely limited; harmful prompts retain less than 10% of the English refusal signal across most language-model pairs.
• Score: 7.471112976694495
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Safety alignment in large language models (LLMs) is largely developed in English, assuming these safeguards generalize across multilingual settings. However, this assumption remains underexplored and exposes a vulnerability in low-resource languages. We investigate cross-lingual safety transfer in four African languages, Twi, Hausa, Amharic, and Swahili, using LoDNA, a new safety dataset that pairs literal translations with culturally localized prompts. To move beyond generation-based evaluation, we propose a latent geometric framework that probes hidden-state refusal representations in LLMs. Our experimental results show that cross-lingual safety transfer is severely limited; harmful prompts retain less than 10% of the English refusal signal across most language-model pairs. Literal and localized prompts are semantically aligned (cosine 0.95-0.996) but drift across layers, suggesting models encode the concepts without routing them to safety mechanisms. These findings demonstrate that current multilingual safety alignment is superficial, providing strong evidence against the assumption of a universal, language-agnostic harm manifold within the specific low-resource languages studied. Warning: This paper contains example data that may be offensive or harmful.

Related papers

• LLM Safety Alignment in Low-Resource Languages: A Systematic Literature Review [9.895109697164283]
  Large Language Models (LLMs) have achieved substantial progress in safety alignment.<n>Their safety guarantees remain significantly weaker in low-resource and multilingual settings.
  arXiv  Detail & Related papers  (2026-07-20T21:11:00Z)
• Schützen: Evaluating LLM Safety in Bulgarian and German Contexts [53.865251738592605]
  This paper introduces Schtzen: a German--Bulgarian safety dataset designed to assess model answerability under risk.<n> Experiments with multilingual and language-specific LLMs reveal pronounced cross-language differences in safety behavior.
  arXiv  Detail & Related papers  (2026-06-09T18:01:19Z)
• Why Do Safety Guardrails Degrade Across Languages? [21.521293656854183]
  Large language models exhibit safety degradation in non-English languages.<n>We introduce a latent variable model, a Multi-Group Item Response Theory (IRT) framework, that decouples safety-driving factors.<n>We evaluate the safety robustness of 61 model configurations across 5 closed-model families and 10 languages of varying resource.
  arXiv  Detail & Related papers  (2026-05-16T22:08:54Z)
• Multilingual Safety Alignment via Self-Distillation [17.94152626632751]
  Large language models (LLMs) exhibit severe multilingual safety misalignment.<n>We propose a cross-lingual safeguard transfer framework named Multilingual Self-Distillation (MSD)<n>Our framework is flexible and can be integrated with different self-distillation strategies.
  arXiv  Detail & Related papers  (2026-05-03T14:22:49Z)
• LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety [88.98698230989186]
  Large language models (LLMs) often demonstrate strong safety performance in high-resource languages, yet exhibit severe vulnerabilities in low-resource languages.<n>We attribute this gap to a mismatch between language-agnostic semantic understanding ability and language-dominant safety alignment biased toward high-resource languages.<n>We propose Language-Agnostic Semantic Alignment (LASA), which anchors safety alignment directly in semantic bottlenecks.
  arXiv  Detail & Related papers  (2026-04-13T15:59:50Z)
• Precise Shield: Explaining and Aligning VLLM Safety via Neuron-Level Guidance [64.18179414483966]
  In real-world deployments, Vision-Language Large Models (VLLMs) face critical challenges from multilingual and multimodal composite attacks.<n>We propose Precise Shield, a two-stage framework that first identifies safety neurons by contrasting activation patterns between harmful and benign inputs.<n>This strategy substantially improves safety while preserving multilingual and multimodal generalization.
  arXiv  Detail & Related papers  (2026-04-10T02:42:52Z)
• IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia [0.6978180153516672]
  We present the first systematic evaluation of large language models (LLMs) safety across 12 Indic languages.<n>Cross-language agreement is just 12.8%, and textttSAFE rate variance exceeds 17% across languages.<n>We release textscIndicSafe, the first benchmark to enable culturally informed safety evaluation for Indic deployments.
  arXiv  Detail & Related papers  (2026-03-18T16:54:07Z)
• Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages [57.059267233093465]
  Large Language Models (LLMs) have transformed natural language processing, but their safety mechanisms remain under-explored in low-resource, multilingual settings.<n>We introduce textsfSGToxicGuard, a novel dataset and evaluation framework for benchmarking LLM safety in Singapore's diverse linguistic context.<n>We conduct extensive experiments with state-of-the-art multilingual LLMs, and the results uncover critical gaps in their safety guardrails.
  arXiv  Detail & Related papers  (2025-09-18T08:14:34Z)
• Refusal Direction is Universal Across Safety-Aligned Languages [66.64709923081745]
  In this paper, we investigate the refusal behavior in large language models (LLMs) across 14 languages using PolyRefuse.<n>We uncover the surprising cross-lingual universality of the refusal direction: a vector extracted from English can bypass refusals in other languages with near-perfect effectiveness.<n>We attribute this transferability to the parallelism of refusal vectors across languages in the embedding space and identify the underlying mechanism behind cross-lingual jailbreaks.
  arXiv  Detail & Related papers  (2025-05-22T21:54:46Z)
• MrGuard: A Multilingual Reasoning Guardrail for Universal LLM Safety [56.77103365251923]
  Large Language Models (LLMs) are susceptible to adversarial attacks such as jailbreaking.<n>This vulnerability is exacerbated in multilingual settings, where multilingual safety-aligned data is often limited.<n>We introduce a multilingual guardrail with reasoning for prompt classification.
  arXiv  Detail & Related papers  (2025-04-21T17:15:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.