On The Conceptualization and Societal Impact of Cross-Cultural Bias

• URL: http://arxiv.org/abs/2512.21809v1
• Date: Fri, 26 Dec 2025 00:27:53 GMT
• Title: On The Conceptualization and Societal Impact of Cross-Cultural Bias
• Abstract summary: I set out to analyse recent literature about identifying and evaluating cultural bias in Natural Language Processing (NLP)<n>I picked out 20 papers published in 2025 about cultural bias and came up with a set of observations to allow NLP researchers in the future to conceptualize bias concretely and evaluate its harms effectively.<n>My aim is to advocate for a robust assessment of the societal impact of language technologies exhibiting cross-cultural bias.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Research has shown that while large language models (LLMs) can generate their responses based on cultural context, they are not perfect and tend to generalize across cultures. However, when evaluating the cultural bias of a language technology on any dataset, researchers may choose not to engage with stakeholders actually using that technology in real life, which evades the very fundamental problem they set out to address. Inspired by the work done by arXiv:2005.14050v2, I set out to analyse recent literature about identifying and evaluating cultural bias in Natural Language Processing (NLP). I picked out 20 papers published in 2025 about cultural bias and came up with a set of observations to allow NLP researchers in the future to conceptualize bias concretely and evaluate its harms effectively. My aim is to advocate for a robust assessment of the societal impact of language technologies exhibiting cross-cultural bias.

Related papers

• LLMs Infer Cultural Context but Fail to Apply It When Responding [17.31205603254047]
  We introduce Cultural and Pragmatic Response Inference (CAPRI), a dataset of conversations with varying levels of cultural cues.<n> Experiments with state-of-the-art LLMs show that models can infer cultural background and recall relevant conventions, but often fail to utilize the information.<n>We find that models increasingly adapt their answers as cultural cues accumulate, but their priors are not culture-neutral, sometimes aligning with the model's country of origin.
  arXiv  Detail & Related papers  (2026-06-16T08:53:24Z)
• Whose Norms? Disentangling Cultural and Personal Alignment in Large Language Models [66.34115263472931]
  Large language models are increasingly used for social decision-making situations that require balancing cultural norms with personal preferences.<n>We introduce PACT, the Personal-Preference and Cultural-Norm Trade-off framework, which evaluates whether models choose to follow a cultural norm or allow personal preferences.<n>Our five-country human study on PACT shows that culture-following in humans is mainly driven by scenario country, with the lowest agreement when participants judge their own cultural contexts.
  arXiv  Detail & Related papers  (2026-06-05T22:20:30Z)
• Identity-Aware Large Language Models require Cultural Reasoning [3.1866496693431934]
  We define cultural reasoning as the capacity of a model to recognise culture-specific knowledge values and social norms.<n>Because culture shapes interpretation, emotional resonance, and acceptable behaviour, cultural reasoning is essential for identity-aware AI.<n>We argue that cultural reasoning must be treated as a foundational capability alongside factual accuracy and linguistic coherence.
  arXiv  Detail & Related papers  (2025-10-21T10:50:51Z)
• Culture is Everywhere: A Call for Intentionally Cultural Evaluation [36.20861746863831]
  We argue for textbfintentionally cultural evaluation: an approach that systematically examines the cultural assumptions embedded in all aspects of evaluation.<n>We discuss implications and future directions for moving beyond current benchmarking practices.
  arXiv  Detail & Related papers  (2025-09-01T09:39:21Z)
• CAIRe: Cultural Attribution of Images by Retrieval-Augmented Evaluation [61.130639734982395]
  We introduce CAIRe, a novel evaluation metric that assesses the degree of cultural relevance of an image.<n>Our framework grounds entities and concepts in the image to a knowledge base and uses factual information to give independent graded judgments for each culture label.
  arXiv  Detail & Related papers  (2025-06-10T17:16:23Z)
• Research Borderlands: Analysing Writing Across Research Cultures [9.863675790023589]
  We take a human-centered approach to discover and measure language-based cultural norms.<n>We focus on a single kind of culture, research cultures, and a single task, adapting writing across research cultures.
  arXiv  Detail & Related papers  (2025-06-01T02:23:55Z)
• From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test [50.51344198689069]
  We extend the human-centered word association test (WAT) to assess the alignment of large language models with cross-cultural cognition.<n>To address culture preference, we propose CultureSteer, an innovative approach by embedding cultural-specific semantic associations directly within the model's internal representation space.
  arXiv  Detail & Related papers  (2025-05-24T07:05:10Z)
• From Surveys to Narratives: Rethinking Cultural Value Adaptation in LLMs [62.9861554207279]
  Adapting cultural values in Large Language Models (LLMs) presents significant challenges.<n>Prior work primarily aligns LLMs with different cultural values using World Values Survey (WVS) data.<n>We investigate WVS-based training for cultural value adaptation and find that relying solely on survey data cane cultural norms and interfere with factual knowledge.
  arXiv  Detail & Related papers  (2025-05-22T09:00:01Z)
• Risks of Cultural Erasure in Large Language Models [4.613949381428196]
  We argue for the need of metricizable evaluations of language technologies that interrogate and account for historical power inequities.<n>We probe representations that a language model produces about different places around the world when asked to describe these contexts.<n>We analyze the cultures represented in the travel recommendations produced by a set of language model applications.
  arXiv  Detail & Related papers  (2025-01-02T04:57:50Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models [59.22460740026037]
  "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset is designed to evaluate the social and cultural variation of Large Language Models (LLMs) We create a hand-crafted, multilingual dataset of value-laden prompts which address specific socially sensitive topics, including LGBTQI rights, social welfare, immigration, disability rights, and surrogacy.
  arXiv  Detail & Related papers  (2024-05-22T20:19:10Z)
• Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking [48.21982147529661]
  This paper introduces a novel approach for massively multicultural knowledge acquisition. Our method strategically navigates from densely informative Wikipedia documents on cultural topics to an extensive network of linked pages. Our work marks an important step towards deeper understanding and bridging the gaps of cultural disparities in AI.
  arXiv  Detail & Related papers  (2024-02-14T18:16:54Z)
• Cultural Bias and Cultural Alignment of Large Language Models [0.9374652839580183]
  We conduct a disaggregated evaluation of cultural bias for five widely used large language models. All models exhibit cultural values resembling English-speaking and Protestant European countries. We suggest using cultural prompting and ongoing evaluation to reduce cultural bias in the output of generative AI.
  arXiv  Detail & Related papers  (2023-11-23T16:45:56Z)
• Unmasking Nationality Bias: A Study of Human Perception of Nationalities in AI-Generated Articles [10.8637226966191]
  We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Our study employs a two-step mixed-methods approach to identify and understand the impact of nationality bias in a text generation model. Our findings reveal that biased NLP models tend to replicate and amplify existing societal biases, which can translate to harm if used in a sociotechnical setting.
  arXiv  Detail & Related papers  (2023-08-08T15:46:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.