Characterizing Cultural Localization in AI-Generated Stories

• URL: http://arxiv.org/abs/2606.14626v1
• Date: Fri, 12 Jun 2026 16:51:52 GMT
• Title: Characterizing Cultural Localization in AI-Generated Stories
• Abstract summary: We propose a method to measure the degree to which content was generated through templated localization.<n>We identify the lexical tokens that distinguish stories across nationalities and measure the similarity of the narratives that remain after removing them.<n>We characterize the cultural markers for their stereotypicality and offensiveness, finding that markers from 19 countries, mostly located in the Global South, are on average offensive.
• Score: 46.04734349145654
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The global use of artificial intelligence has increased interest in assessing the ability to generate culturally localized content, including stories. Cultural localization in stories often occurs through either templated localization -- the use of cultural markers (e.g., names, locations) in a generic narrative -- or holistic localization -- the variation of plots, values, and themes, in addition to cultural markers. We propose a method to measure the degree to which content was generated through templated localization. Specifically, we identify the lexical tokens that distinguish stories across nationalities and measure the similarity of the narratives that remain after removing them. In stories generated by five models on 125 topics for 193 nationalities, our method is able to detect that only a small subset (9-17%) of the vocabulary accounts for the variation across nationalities and that the narratives that remain after removing them contain repeated multi-word sequences, suggesting the presence of a shared culturally-agnostic narrative template. Finally, we characterize the cultural markers for their stereotypicality and offensiveness, finding that markers from 19 countries, mostly located in the Global South, are on average offensive.

Related papers

• When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Models [6.821769033209393]
  "Cultural Ghosting" is the systematic erasure of linguistic markers unique to non-native English varieties during text processing.<n>We quantify this phenomenon using two novel metrics: Identity Erasure Rate (IER) & Semantic Preservation Score (SPS)<n>Our experiments demonstrate that explicit cultural-preservation prompts reduce erasure by 29% without sacrificing semantic quality.
  arXiv  Detail & Related papers  (2026-02-25T17:54:42Z)
• AmharicStoryQA: A Multicultural Story Question Answering Benchmark in Amharic [25.361090310093072]
  We argue that evaluations overlook meaningful cultural variation that exists within a single language.<n>We introduce textbftextitAmharicStoryQA, a benchmark grounded in culturally diverse narratives from Amharic-speaking regions.
  arXiv  Detail & Related papers  (2026-02-02T20:28:19Z)
• TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories [24.375203423945816]
  We present TALES, an evaluation of cultural misrepresentations in LLM-generated stories for diverse Indian cultural identities.<n>We develop TALES-Tax, a taxonomy of cultural misrepresentations by collating insights from participants with lived experiences in India.<n>We transform the annotations into TALES-QA, a standalone question bank to evaluate the cultural knowledge of foundational models.
  arXiv  Detail & Related papers  (2025-11-26T12:07:32Z)
• Do You Know About My Nation? Investigating Multilingual Language Models' Cultural Literacy Through Factual Knowledge [68.6805229085352]
  Most multilingual question-answering benchmarks do not factor in regional diversity in the information they capture.<n>XNationQA encompasses a total of 49,280 questions on the geography, culture, and history of nine countries, presented in seven languages.<n>We benchmark eight standard multilingual LLMs on XNationQA and evaluate them using two novel transference metrics.
  arXiv  Detail & Related papers  (2025-11-01T18:41:34Z)
• CAIRe: Cultural Attribution of Images by Retrieval-Augmented Evaluation [61.130639734982395]
  We introduce CAIRe, a novel evaluation metric that assesses the degree of cultural relevance of an image.<n>Our framework grounds entities and concepts in the image to a knowledge base and uses factual information to give independent graded judgments for each culture label.
  arXiv  Detail & Related papers  (2025-06-10T17:16:23Z)
• GlobalMood: A cross-cultural benchmark for music emotion recognition [10.490374578193773]
  'GlobalMood' is a novel cross-cultural benchmark dataset comprising 1,180 songs sampled from 59 countries.<n>We implement a bottom-up, participant-driven approach to elicit culturally specific music-related emotion terms.
  arXiv  Detail & Related papers  (2025-05-14T16:32:45Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting [73.94059188347582]
  We uncover culture perceptions of three SOTA models on 110 countries and regions on 8 culture-related topics through culture-conditioned generations. We discover that culture-conditioned generation consist of linguistic "markers" that distinguish marginalized cultures apart from default cultures.
  arXiv  Detail & Related papers  (2024-04-16T00:50:43Z)
• Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking [48.21982147529661]
  This paper introduces a novel approach for massively multicultural knowledge acquisition. Our method strategically navigates from densely informative Wikipedia documents on cultural topics to an extensive network of linked pages. Our work marks an important step towards deeper understanding and bridging the gaps of cultural disparities in AI.
  arXiv  Detail & Related papers  (2024-02-14T18:16:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.