The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It

• URL: http://arxiv.org/abs/2505.24119v1
• Date: Fri, 30 May 2025 01:32:44 GMT
• Title: The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It
• Authors: Zheng-Xin Yong, Beyza Ermis, Marzieh Fadaee, Stephen H. Bach, Julia Kreutzer,
• Abstract summary: We review nearly 300 publications from 2020--2024 across major NLP conferences and workshops at *ACL.<n>We observe that non-English languages are rarely studied as a standalone language and that English safety research exhibits poor language documentation practice.<n>Based on our survey and proposed directions, the field can develop more robust, inclusive AI safety practices for diverse global populations.
• Score: 21.6479207553511
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper presents a comprehensive analysis of the linguistic diversity of LLM safety research, highlighting the English-centric nature of the field. Through a systematic review of nearly 300 publications from 2020--2024 across major NLP conferences and workshops at *ACL, we identify a significant and growing language gap in LLM safety research, with even high-resource non-English languages receiving minimal attention. We further observe that non-English languages are rarely studied as a standalone language and that English safety research exhibits poor language documentation practice. To motivate future research into multilingual safety, we make several recommendations based on our survey, and we then pose three concrete future directions on safety evaluation, training data generation, and crosslingual safety generalization. Based on our survey and proposed directions, the field can develop more robust, inclusive AI safety practices for diverse global populations.

Related papers

• Beyond Weaponization: NLP Security for Medium and Lower-Resourced Languages in Their Own Right [0.0]
  This work examines the security of LMs for lower- and medium-resourced languages.<n>We extend existing adversarial attacks for up to 70 languages to evaluate the security of monolingual and multilingual LMs for these languages.
  arXiv  Detail & Related papers  (2025-07-04T10:54:04Z)
• The Multilingual Divide and Its Impact on Global AI Safety [27.639490480528337]
  This paper provides researchers, policymakers and governance experts with an overview of key challenges to bridging the "language gap" in AI.<n>We provide an analysis of why the language gap in AI exists and grows, and how it creates disparities in global AI safety.
  arXiv  Detail & Related papers  (2025-05-27T15:37:32Z)
• MPO: Multilingual Safety Alignment via Reward Gap Optimization [88.76638442683391]
  Large language models (LLMs) have become increasingly central to AI applications worldwide.<n>Existing preference learning methods for safety alignment, such as RLHF and DPO, are primarily monolingual and struggle with noisy multilingual data.<n>We introduce Multilingual reward gaP Optimization (MPO), a novel approach that leverages the well-aligned safety capabilities of the dominant language (English) to improve safety alignment across multiple languages.
  arXiv  Detail & Related papers  (2025-05-22T16:24:51Z)
• MrGuard: A Multilingual Reasoning Guardrail for Universal LLM Safety [56.79292318645454]
  Large Language Models (LLMs) are susceptible to adversarial attacks such as jailbreaking.<n>This vulnerability is exacerbated in multilingual settings, where multilingual safety-aligned data is often limited.<n>We introduce a multilingual guardrail with reasoning for prompt classification.
  arXiv  Detail & Related papers  (2025-04-21T17:15:06Z)
• LLMs Lost in Translation: M-ALERT uncovers Cross-Linguistic Safety Gaps [63.10843814055688]
  M-ALERT is a benchmark that evaluates the safety of Large Language Models in five languages: English, French, German, Italian, and Spanish.<n>M-ALERT includes 15k high-quality prompts per language, totaling 75k, following the detailed ALERT taxonomy.
  arXiv  Detail & Related papers  (2024-12-19T16:46:54Z)
• Multilingual Blending: LLM Safety Alignment Evaluation with Language Mixture [6.17896401271963]
  We introduce Multilingual Blending, a mixed-language query-response scheme designed to evaluate the safety alignment of various large language models. We investigate language patterns such as language availability, morphology, and language family that could impact the effectiveness of Multilingual Blending.
  arXiv  Detail & Related papers  (2024-07-10T03:26:15Z)
• A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers [51.8203871494146]
  The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing.<n>Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient.<n>This survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs.
  arXiv  Detail & Related papers  (2024-05-17T17:47:39Z)
• Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers [81.47046536073682]
  We present a review and provide a unified perspective to summarize the recent progress as well as emerging trends in multilingual large language models (MLLMs) literature. We hope our work can provide the community with quick access and spur breakthrough research in MLLMs.
  arXiv  Detail & Related papers  (2024-04-07T11:52:44Z)
• All Languages Matter: On the Multilingual Safety of Large Language Models [96.47607891042523]
  We build the first multilingual safety benchmark for large language models (LLMs) XSafety covers 14 kinds of commonly used safety issues across 10 languages that span several language families. We propose several simple and effective prompting methods to improve the multilingual safety of ChatGPT.
  arXiv  Detail & Related papers  (2023-10-02T05:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.