How Problematic Writer-AI Interactions (Rather than Problematic AI) Hinder Writers' Idea Generation

• URL: http://arxiv.org/abs/2503.11915v1
• Date: Fri, 14 Mar 2025 22:53:53 GMT
• Title: How Problematic Writer-AI Interactions (Rather than Problematic AI) Hinder Writers' Idea Generation
• Authors: Khonzoda Umarova, Talia Wise, Zhuoer Lyu, Mina Lee, Qian Yang,
• Abstract summary: We show that the impact of genAI on students' idea development depends not only on the AI but also on the students and, crucially, their interactions in between.<n>Students who proactively explored ideas gained new ideas from writing, regardless of whether they used auto-complete or Socratic AI assistants.<n>These findings suggest opportunities in designing AI writing assistants, not merely by creating more thought-provoking AI, but also by fostering more thought-provoking writer-AI interactions.
• Score: 18.06791806791819
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Writing about a subject enriches writers' understanding of that subject. This cognitive benefit of writing -- known as constructive learning -- is essential to how students learn in various disciplines. However, does this benefit persist when students write with generative AI writing assistants? Prior research suggests the answer varies based on the type of AI, e.g., auto-complete systems tend to hinder ideation, while assistants that pose Socratic questions facilitate it. This paper adds an additional perspective. Through a case study, we demonstrate that the impact of genAI on students' idea development depends not only on the AI but also on the students and, crucially, their interactions in between. Students who proactively explored ideas gained new ideas from writing, regardless of whether they used auto-complete or Socratic AI assistants. Those who engaged in prolonged, mindless copyediting developed few ideas even with a Socratic AI. These findings suggest opportunities in designing AI writing assistants, not merely by creating more thought-provoking AI, but also by fostering more thought-provoking writer-AI interactions.

Related papers

• The Impact of AI-Driven Tools on Student Writing Development: A Case Study From The CGScholar AI Helper Project [1.1234721101613931]
  The case study examines the impact of the CGScholar (Common Ground Scholar) AI Helper on a pilot research initiative involving the writing development of 11th-grade students in English Language Arts (ELA) CGScholar AI Helper is an evolving and innovative web-based application designed to support students in their writing tasks by providing specified AI-generated feedback.
  arXiv  Detail & Related papers  (2025-01-14T22:38:14Z)
• Harnessing AI in Secondary Education to Enhance Writing Competence [0.0]
  ChatGPT holds significant implications for developing writing skills in secondary education.<n>This study examines AI's impact on students' writing competence and personal voice.<n>We advocate for a balanced approach to AI in education, ensuring it supports rather than replaces teacher instruction.
  arXiv  Detail & Related papers  (2024-12-02T14:14:25Z)
• "It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models [97.22914355737676]
  We examine whether and how writers want to preserve their authentic voice when co-writing with AI tools. Our findings illuminate conceptions of authenticity in human-AI co-creation. Readers' responses showed less concern about human-AI co-writing.
  arXiv  Detail & Related papers  (2024-11-20T04:42:32Z)
• Techniques for supercharging academic writing with generative AI [0.0]
  This Perspective maps out principles and methods for using generative artificial intelligence (AI) to elevate the quality and efficiency of academic writing. We introduce a human-AI collaborative framework that delineates the rationale (why), process (how), and nature (what) of AI engagement in writing.
  arXiv  Detail & Related papers  (2023-10-26T04:35:00Z)
• PaperCard for Reporting Machine Assistance in Academic Writing [48.33722012818687]
  ChatGPT, a question-answering system released by OpenAI in November 2022, has demonstrated a range of capabilities that could be utilised in producing academic papers. This raises critical questions surrounding the concept of authorship in academia. We propose a framework we name "PaperCard", a documentation for human authors to transparently declare the use of AI in their writing process.
  arXiv  Detail & Related papers  (2023-10-07T14:28:04Z)
• The Future of AI-Assisted Writing [0.0]
  We conduct a comparative user-study between such tools from an information retrieval lens: pull and push. Our findings show that users welcome seamless assistance of AI in their writing. Users also enjoyed the collaboration with AI-assisted writing tools and did not feel a lack of ownership.
  arXiv  Detail & Related papers  (2023-06-29T02:46:45Z)
• ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing [45.187790784934734]
  This paper focuses on Conversational XAI for AI-assisted scientific writing tasks. We identify four design rationales: "multifaceted", "controllability", "mix-initiative", "context-aware drill-down" We incorporate them into an interactive prototype, ConvXAI, which facilitates heterogeneous AI explanations for scientific writing through dialogue.
  arXiv  Detail & Related papers  (2023-05-16T19:48:49Z)
• The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors [42.72188284211033]
  We investigate authorship and ownership in human-AI collaboration for personalized language generation. We show an AI Ghostwriter Effect: Users do not consider themselves the owners and authors of AI-generated text. We discuss how our findings relate to psychological ownership and human-AI interaction to lay the foundations for adapting authorship frameworks.
  arXiv  Detail & Related papers  (2023-03-06T16:53:12Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• AI and the Sense of Self [0.0]
  We focus on the cognitive sense of "self" and its role in autonomous decision-making leading to responsible behaviour. Authors hope to make a case for greater research interest in building richer computational models of AI agents with a sense of self.
  arXiv  Detail & Related papers  (2022-01-07T10:54:06Z)
• A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interaction [70.11080854486953]
  We propose a user-centred framework for XAI that focuses on its social-interactive aspect. The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
  arXiv  Detail & Related papers  (2021-09-27T09:56:23Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.