Human Experts' Evaluation of Generative AI for Contextualizing STEAM Education in the Global South

• URL: http://arxiv.org/abs/2511.19482v3
• Date: Thu, 27 Nov 2025 02:39:35 GMT
• Title: Human Experts' Evaluation of Generative AI for Contextualizing STEAM Education in the Global South
• Abstract summary: STEAM education in many parts of the Global South remains abstract and weakly connected to learners sociocultural realities.<n>This study examines how human experts evaluate the capacity of Generative AI (GenAI) to contextualize STEAM instruction in these settings.
• Score: 0.639147752530381
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: STEAM education in many parts of the Global South remains abstract and weakly connected to learners sociocultural realities. This study examines how human experts evaluate the capacity of Generative AI (GenAI) to contextualize STEAM instruction in these settings. Using a convergent mixed-methods design grounded in human-centered and culturally responsive pedagogy, four STEAM education experts reviewed standardized Ghana NaCCA lesson plans and GenAI-generated lessons created with a customized Culturally Responsive Lesson Planner (CRLP). Quantitative data were collected with a validated 25-item Culturally Responsive Pedagogy Rubric assessing bias awareness, cultural representation, contextual relevance, linguistic responsiveness, and teacher agency. Qualitative reflections provided additional insight into the pedagogical and cultural dynamics of each lesson. Findings show that GenAI, especially through the CRLP, improved connections between abstract standards and learners lived experiences. Teacher Agency was the strongest domain, while Cultural Representation was the weakest. CRLP-generated lessons were rated as more culturally grounded and pedagogically engaging. However, GenAI struggled to represent Ghana's cultural diversity, often producing surface-level references, especially in Mathematics and Computing. Experts stressed the need for teacher mediation, community input, and culturally informed refinement of AI outputs. Future work should involve classroom trials, broader expert participation, and fine-tuning with Indigenous corpora.

Related papers

• Cultural Perspectives and Expectations for Generative AI: A Global Survey Approach [8.047044692353998]
  This paper assesses understandings and beliefs about culture as it relates to GenAI from a large-scale global survey.<n>We distill working definitions of culture directly from these communities to build an understanding of its conceptual complexities.<n>We conclude with a set of recommendations for Culture and GenAI development.
  arXiv  Detail & Related papers  (2026-03-05T22:25:31Z)
• CultureScope: A Dimensional Lens for Probing Cultural Understanding in LLMs [57.653830744706305]
  CultureScope is the most comprehensive evaluation framework to date for assessing cultural understanding in large language models.<n>Inspired by the cultural iceberg theory, we design a novel dimensional schema for cultural knowledge classification.<n> Experimental results demonstrate that our method can effectively evaluate cultural understanding.
  arXiv  Detail & Related papers  (2025-09-19T17:47:48Z)
• Bridging Cultural Distance Between Models Default and Local Classroom Demands: How Global Teachers Adopt GenAI to Support Everyday Teaching Practices [11.261543931082814]
  Generative AI (GenAI) is rapidly entering K-12 classrooms, offering teachers new ways for teaching practices.<n>Yet GenAI models are often trained on culturally uneven datasets, embedding a "default culture" that often misaligns with local classrooms.<n>To understand how teachers navigate this gap, we defined the new concept Cultural Distance.
  arXiv  Detail & Related papers  (2025-09-13T01:57:48Z)
• LLMs to Support K-12 Teachers in Culturally Relevant Pedagogy: An AI Literacy Example [3.888255532159152]
  Culturally Relevant Pedagogy (CRP) is vital in K-12 education, yet teachers struggle to implement CRP into practice due to time, training, and resource gaps.<n>This study explores how Large Language Models (LLMs) can address these barriers by introducing CulturAIEd.
  arXiv  Detail & Related papers  (2025-05-12T21:35:59Z)
• CAReDiO: Cultural Alignment of LLM via Representativeness and Distinctiveness Guided Data Optimization [50.90288681622152]
  Large Language Models (LLMs) more deeply integrate into human life across various regions.<n>Existing approaches develop culturally aligned LLMs through fine-tuning with culture-specific corpora.<n>We introduce CAReDiO, a novel cultural data construction framework.
  arXiv  Detail & Related papers  (2025-04-09T13:40:13Z)
• Glocalizing Generative AI in Education for the Global South: The Design Case of 21st Century Teacher Educator AI for Ghana [0.7416846035207727]
  The 21st Century Teacher Educator for Ghana GPT is a customized Generative AI (GenAI) tool created using OpenAI's Retrieval-Augmented Generation (RAG) and Interactive Semi-Automated Prompting Strategy (ISA)<n>This tool supports pre-service teachers in Ghana by embedding localized linguistic, cultural, and curricular content within globally aligned principles of ethical and responsible AI use.
  arXiv  Detail & Related papers  (2025-04-09T03:28:35Z)
• CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries [63.00147630084146]
  Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding.<n>CultureVerse is a large-scale multimodal benchmark covering 19, 682 cultural concepts, 188 countries/regions, 15 cultural concepts, and 3 question types.<n>We propose CultureVLM, a series of VLMs fine-tuned on our dataset to achieve significant performance improvement in cultural understanding.
  arXiv  Detail & Related papers  (2025-01-02T14:42:37Z)
• CultureVo: The Serious Game of Utilizing Gen AI for Enhancing Cultural Intelligence [0.0]
  This paper explores how Generative AI powered by open source Large Langauge Models are utilized within the Integrated Culture Learning Suite. The suite employs Generative AI techniques to automate the assessment of learner knowledge, analyze behavioral patterns, and manage interactions with non-player characters.
  arXiv  Detail & Related papers  (2024-07-30T09:26:43Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• Generative AI and Digital Neocolonialism in Global Education: Towards an Equitable Framework [0.5586073503694489]
  This paper critically discusses how generative artificial intelligence (GenAI) might impose Western ideologies on non-Western societies. It suggests strategies for local and global stakeholders to mitigate these effects.
  arXiv  Detail & Related papers  (2024-06-05T05:43:55Z)
• CulturePark: Boosting Cross-cultural Understanding in Large Language Models [63.452948673344395]
  This paper introduces CulturePark, an LLM-powered multi-agent communication framework for cultural data collection. It generates high-quality cross-cultural dialogues encapsulating human beliefs, norms, and customs. We evaluate these models across three downstream tasks: content moderation, cultural alignment, and cultural education.
  arXiv  Detail & Related papers  (2024-05-24T01:49:02Z)
• Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking [48.21982147529661]
  This paper introduces a novel approach for massively multicultural knowledge acquisition. Our method strategically navigates from densely informative Wikipedia documents on cultural topics to an extensive network of linked pages. Our work marks an important step towards deeper understanding and bridging the gaps of cultural disparities in AI.
  arXiv  Detail & Related papers  (2024-02-14T18:16:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.