Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective

• URL: http://arxiv.org/abs/2306.01798v2
• Date: Sat, 10 Feb 2024 14:13:43 GMT
• Title: Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective
• Authors: David James Woo, Kai Guo, Hengky Susanto
• Abstract summary: This study applies Activity Theory to investigate how English as a foreign language (EFL) students prompt generative artificial intelligence (AI) tools during short story writing. The study collected and analyzed the students' generative-AI tools, short stories, and written reflections on their conditions or purposes for prompting.
• Score: 4.0109641418513355
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This study applies Activity Theory to investigate how English as a foreign language (EFL) students prompt generative artificial intelligence (AI) tools during short story writing. Sixty-seven Hong Kong secondary school students created generative-AI tools using open-source language models and wrote short stories with them. The study collected and analyzed the students' generative-AI tools, short stories, and written reflections on their conditions or purposes for prompting. The research identified three main themes regarding the purposes for which students prompt generative-AI tools during short story writing: a lack of awareness of purposes, overcoming writer's block, and developing, expanding, and improving the story. The study also identified common characteristics of students' activity systems, including the sophistication of their generative-AI tools, the quality of their stories, and their school's overall academic achievement level, for their prompting of generative-AI tools for the three purposes during short story writing. The study's findings suggest that teachers should be aware of students' purposes for prompting generative-AI tools to provide tailored instructions and scaffolded guidance. The findings may also help designers provide differentiated instructions for users at various levels of story development when using a generative-AI tool.

Related papers

• Elementary School Students' and Teachers' Perceptions Towards Creative Mathematical Writing with Generative AI [2.42996714881935]
  Generative AI (GenAI) offers possibilities for supporting creative writing activities. This study explores students' and teachers' perceptions of creative mathematical writing with the developed GenAI-powered technology.
  arXiv  Detail & Related papers  (2024-08-26T19:04:08Z)
• Tool Learning with Large Language Models: A Survey [60.733557487886635]
  Tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the existing literature remains fragmented and lacks systematic organization.
  arXiv  Detail & Related papers  (2024-05-28T08:01:26Z)
• Purposeful remixing with generative AI: Constructing designer voice in multimodal composing [16.24460569356749]
  This study investigates whether the use of generative AI tools could help student authors construct a more consistent voice in multimodal writing. The study sheds light on the intentional and discursive nature of multimodal writing with AI as afforded by the technological flexibility.
  arXiv  Detail & Related papers  (2024-03-28T02:15:03Z)
• Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading Activities [52.828843153565984]
  AI-based storytelling and reading technologies are becoming increasingly ubiquitous in preschoolers' lives. This paper investigates how they function in practical storytelling and reading scenarios and, how parents, the most critical stakeholders, experience and perceive them. Our findings suggest that even though AI-based storytelling and reading technologies provide more immersive and engaging interaction, they still cannot meet parents' expectations due to a series of interactive and algorithmic challenges.
  arXiv  Detail & Related papers  (2024-01-24T20:55:40Z)
• Language Models: A Guide for the Perplexed [51.88841610098437]
  This tutorial aims to help narrow the gap between those who study language models and those who are intrigued and want to learn more. We offer a scientific viewpoint that focuses on questions amenable to study through experimentation. We situate language models as they are today in the context of the research that led to their development.
  arXiv  Detail & Related papers  (2023-11-29T01:19:02Z)
• Storyfier: Exploring Vocabulary Learning Support with Text Generation Models [52.58844741797822]
  We develop Storyfier to provide a coherent context for any target words of learners' interests. learners generally favor the generated stories for connecting target words and writing assistance for easing their learning workload. In read-cloze-write learning sessions, participants using Storyfier perform worse in recalling and using target words than learning with a baseline tool without our AI features.
  arXiv  Detail & Related papers  (2023-08-07T18:25:00Z)
• EFL Students' Attitudes and Contradictions in a Machine-in-the-loop Activity System [5.326832235832844]
  This study investigates the attitudes and contradictions of 67 English as a foreign language (EFL) students towards machine-in-the-loop writing. Results revealed mostly positive attitudes, with some negative or mixed feelings.
  arXiv  Detail & Related papers  (2023-07-13T07:38:11Z)
• Constructing Dreams using Generative AI [23.344751807278044]
  Generative AI tools introduce new and accessible forms of media creation for youth. They raise ethical concerns about the generation of fake media, data protection, privacy and ownership of AI-generated art. We facilitated students' generative AI learning through expression of their imagined future identities.
  arXiv  Detail & Related papers  (2023-05-19T21:56:12Z)
• Perception, performance, and detectability of conversational artificial intelligence across 32 university courses [15.642614735026106]
  We compare the performance of ChatGPT against students on 32 university-level courses. We find that ChatGPT's performance is comparable, if not superior, to that of students in many courses. We find an emerging consensus among students to use the tool, and among educators to treat this as plagiarism.
  arXiv  Detail & Related papers  (2023-05-07T10:37:51Z)
• LLM-based Interaction for Content Generation: A Case Study on the Perception of Employees in an IT department [85.1523466539595]
  This paper presents a questionnaire survey to identify the intention to use generative tools by employees of an IT company. Our results indicate a rather average acceptability of generative tools, although the more useful the tool is perceived to be, the higher the intention seems to be. Our analyses suggest that the frequency of use of generative tools is likely to be a key factor in understanding how employees perceive these tools in the context of their work.
  arXiv  Detail & Related papers  (2023-04-18T15:35:43Z)
• The Next Chapter: A Study of Large Language Models in Storytelling [51.338324023617034]
  The application of prompt-based learning with large language models (LLMs) has exhibited remarkable performance in diverse natural language processing (NLP) tasks. This paper conducts a comprehensive investigation, utilizing both automatic and human evaluation, to compare the story generation capacity of LLMs with recent models. The results demonstrate that LLMs generate stories of significantly higher quality compared to other story generation models.
  arXiv  Detail & Related papers  (2023-01-24T02:44:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.