Analyzing Information-Seeking Behaviors in a Hakka AI Chatbot: A Cognitive-Pragmatic Study

• URL: http://arxiv.org/abs/2509.11591v2
• Date: Sat, 04 Oct 2025 02:05:13 GMT
• Title: Analyzing Information-Seeking Behaviors in a Hakka AI Chatbot: A Cognitive-Pragmatic Study
• Authors: Chu-Hsuan Lee, Chen-Chi Chang, Hung-Shin Lee, Yun-Hsiang Hsu, Ching-Yuan Chen,
• Abstract summary: We analyzed 7,077 user utterances, each carefully annotated according to six cognitive levels and eleven dialogue act types.<n>Results suggest that generative AI chatbots can support language learning in meaningful ways.<n>By focusing on AI-assisted language learning, this study offers new insights into how technology can support language preservation and educational practice.
• Score: 2.928395244258111
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: With many endangered languages at risk of disappearing, efforts to preserve them now rely more than ever on using technology alongside culturally informed teaching strategies. This study examines user behaviors in TALKA, a generative AI-powered chatbot designed for Hakka language engagement, by employing a dual-layered analytical framework grounded in Bloom's Taxonomy of cognitive processes and dialogue act categorization. We analyzed 7,077 user utterances, each carefully annotated according to six cognitive levels and eleven dialogue act types. These included a variety of functions, such as asking for information, requesting translations, making cultural inquiries, and using language creatively. Pragmatic classifications further highlight how different types of dialogue acts--such as feedback, control commands, and social greetings--align with specific cognitive intentions. The results suggest that generative AI chatbots can support language learning in meaningful ways--especially when they are designed with an understanding of how users think and communicate. They may also help learners express themselves more confidently and connect with their cultural identity. The TALKA case provides empirical insights into how AI-mediated dialogue facilitates cognitive development in low-resource language learners, as well as pragmatic negotiation and socio-cultural affiliation. By focusing on AI-assisted language learning, this study offers new insights into how technology can support language preservation and educational practice.

Related papers

• From Textbook to Talkbot: A Case Study of a Greek-Language RAG-Based Chatbot in Higher Education [0.0]
  The study aims to evaluate the effectiveness, reliability, and perceived usability of RAG based chatbots in higher education.<n>Findings from this research are expected to contribute to the emerging field of AI driven education.
  arXiv  Detail & Related papers  (2025-12-23T22:40:03Z)
• Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models [49.22720751953838]
  We propose a method for training language models in an interactive setting inspired by child language acquisition.<n>In our setting, a speaker attempts to communicate some information to a listener in a single-turn dialogue and receives a reward if communicative success is achieved.
  arXiv  Detail & Related papers  (2025-05-09T11:48:36Z)
• Generative AI, Pragmatics, and Authenticity in Second Language Learning [0.0]
  There are obvious benefits to integrating generative AI (artificial intelligence) into language learning and teaching. However, due to how AI systems under-stand human language, they lack the lived experience to be able to use language with the same social awareness as humans. There are built-in linguistic and cultural biases based on their training data which is mostly in English and predominantly from Western sources.
  arXiv  Detail & Related papers  (2024-10-18T11:58:03Z)
• Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs [49.18567856499736]
  We investigate whether large language models (LLMs) can be supportive of open-ended dialogue tutoring.<n>We apply a range of knowledge tracing (KT) methods on the resulting labeled data to track student knowledge levels over an entire dialogue.<n>We conduct experiments on two tutoring dialogue datasets, and show that a novel yet simple LLM-based method, LLMKT, significantly outperforms existing KT methods in predicting student response correctness in dialogues.
  arXiv  Detail & Related papers  (2024-09-24T22:31:39Z)
• Distributed agency in second language learning and teaching through generative AI [0.0]
  ChatGPT can provide informal second language practice through chats in written or voice forms. Instructors can use AI to build learning and assessment materials in a variety of media.
  arXiv  Detail & Related papers  (2024-03-29T14:55:40Z)
• Test-takers have a say: understanding the implications of the use of AI in language tests [12.430886405811757]
  This study is the first empirical study aimed at identifying the implications of AI adoption in language tests from a test-taker perspective. We identify that AI integration may enhance perceptions of fairness, consistency, and availability. It might incite mistrust regarding reliability and interactivity aspects, subsequently influencing the behaviors and well-being of test-takers.
  arXiv  Detail & Related papers  (2023-07-19T10:28:59Z)
• User Adaptive Language Learning Chatbots with a Curriculum [55.63893493019025]
  We adapt lexically constrained decoding to a dialog system, which urges the dialog system to include curriculum-aligned words and phrases in its generated utterances. The evaluation result demonstrates that the dialog system with curriculum infusion improves students' understanding of target words and increases their interest in practicing English.
  arXiv  Detail & Related papers  (2023-04-11T20:41:41Z)
• PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model [79.64376762489164]
  PK-Chat is a Pointer network guided generative dialogue model, incorporating a unified pretrained language model and a pointer network over knowledge graphs. The words generated by PK-Chat in the dialogue are derived from the prediction of word lists and the direct prediction of the external knowledge graph knowledge. Based on the PK-Chat, a dialogue system is built for academic scenarios in the case of geosciences.
  arXiv  Detail & Related papers  (2023-04-02T18:23:13Z)
• Language Cognition and Language Computation -- Human and Machine Language Understanding [51.56546543716759]
  Language understanding is a key scientific issue in the fields of cognitive and computer science. Can a combination of the disciplines offer new insights for building intelligent language models?
  arXiv  Detail & Related papers  (2023-01-12T02:37:00Z)
• Advances in Multi-turn Dialogue Comprehension: A Survey [51.215629336320305]
  Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. This paper reviews the previous methods from the technical perspective of dialogue modeling for the dialogue comprehension task. In addition, we categorize dialogue-related pre-training techniques which are employed to enhance PrLMs in dialogue scenarios.
  arXiv  Detail & Related papers  (2021-10-11T03:52:37Z)
• Fostering learners' self-regulation and collaboration skills and strategies for mobile language learning beyond the classroom [0.0]
  The chapter argues that support should focus on the development of two vital learning skills, namely being able to self-regulate and to collaborate effectively. The ultimate aim is to enable the provision of individual adaptive learning paths to facilitate language learning beyond the classroom.
  arXiv  Detail & Related papers  (2021-03-20T15:57:59Z)
• Advances in Multi-turn Dialogue Comprehension: A Survey [51.215629336320305]
  We review the previous methods from the perspective of dialogue modeling. We discuss three typical patterns of dialogue modeling that are widely-used in dialogue comprehension tasks.
  arXiv  Detail & Related papers  (2021-03-04T15:50:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.