Writer-Defined AI Personas for On-Demand Feedback Generation

• URL: http://arxiv.org/abs/2309.10433v2
• Date: Tue, 20 Feb 2024 15:20:32 GMT
• Title: Writer-Defined AI Personas for On-Demand Feedback Generation
• Authors: Karim Benharrak, Tim Zindulka, Florian Lehmann, Hendrik Heuer, Daniel Buschek
• Abstract summary: We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience. This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design.
• Score: 32.19315306717165
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Compelling writing is tailored to its audience. This is challenging, as writers may struggle to empathize with readers, get feedback in time, or gain access to the target group. We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience. We explore this concept with a prototype (using GPT-3.5) in two user studies (N=5 and N=11): Writers appreciated the concept and strategically used personas for getting different perspectives. The feedback was seen as helpful and inspired revisions of text and personas, although it was often verbose and unspecific. We discuss the impact of on-demand feedback, the limited representativity of contemporary AI systems, and further ideas for defining AI personas. This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design: To empower creators, we also need to keep in mind their relationship to an audience.

Related papers

• "It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models [97.22914355737676]
  We examine whether and how writers want to preserve their authentic voice when co-writing with AI tools. Our findings illuminate conceptions of authenticity in human-AI co-creation. Readers' responses showed less concern about human-AI co-writing.
  arXiv  Detail & Related papers  (2024-11-20T04:42:32Z)
• Human Bias in the Face of AI: The Role of Human Judgement in AI Generated Text Evaluation [48.70176791365903]
  This study explores how bias shapes the perception of AI versus human generated content. We investigated how human raters respond to labeled and unlabeled content.
  arXiv  Detail & Related papers  (2024-09-29T04:31:45Z)
• The Future of Open Human Feedback [65.2188596695235]
  We bring together interdisciplinary experts to assess the opportunities and challenges to realizing an open ecosystem of human feedback for AI. We first look for successful practices in peer production, open source, and citizen science communities. We end by envisioning the components needed to underpin a sustainable and open human feedback ecosystem.
  arXiv  Detail & Related papers  (2024-08-15T17:59:14Z)
• GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency [1.7707677585873678]
  Large language models (LLMs) are becoming more prevalent and have found a ubiquitous use in providing different forms of writing assistance. We introduce GhostWriter, an AI-enhanced writing design probe where users can exercise enhanced agency and personalization. We study 18 participants who use GhostWriter on two different writing tasks, observing that it helps users craft personalized text generations and empowers them by providing multiple ways to control the system's writing style.
  arXiv  Detail & Related papers  (2024-02-13T23:48:59Z)
• UltraFeedback: Boosting Language Models with Scaled AI Feedback [99.4633351133207]
  We present textscUltraFeedback, a large-scale, high-quality, and diversified AI feedback dataset. Our work validates the effectiveness of scaled AI feedback data in constructing strong open-source chat language models.
  arXiv  Detail & Related papers  (2023-10-02T17:40:01Z)
• The Future of AI-Assisted Writing [0.0]
  We conduct a comparative user-study between such tools from an information retrieval lens: pull and push. Our findings show that users welcome seamless assistance of AI in their writing. Users also enjoyed the collaboration with AI-assisted writing tools and did not feel a lack of ownership.
  arXiv  Detail & Related papers  (2023-06-29T02:46:45Z)
• Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers [9.120878749348986]
  Natural language generation (NLG) using neural language models has brought us closer than ever to the goal of building AI-powered creative writing tools. Recent developments in natural language generation using neural language models have brought us closer than ever to the goal of building AI-powered creative writing tools.
  arXiv  Detail & Related papers  (2022-11-09T17:00:56Z)
• What Do End-Users Really Want? Investigation of Human-Centered XAI for Mobile Health Apps [69.53730499849023]
  We present a user-centered persona concept to evaluate explainable AI (XAI) Results show that users' demographics and personality, as well as the type of explanation, impact explanation preferences. Our insights bring an interactive, human-centered XAI closer to practical application.
  arXiv  Detail & Related papers  (2022-10-07T12:51:27Z)
• Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorship [27.853155569154705]
  We present two user interfaces for writing with AI on mobile devices, which manipulate levels of initiative and control. With AI suggestions, people wrote less actively, yet felt they were the author. In both designs, AI increased text length and was perceived to influence wording.
  arXiv  Detail & Related papers  (2022-08-01T13:57:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.