Writer-Defined AI Personas for On-Demand Feedback Generation
- URL: http://arxiv.org/abs/2309.10433v2
- Date: Tue, 20 Feb 2024 15:20:32 GMT
- Title: Writer-Defined AI Personas for On-Demand Feedback Generation
- Authors: Karim Benharrak, Tim Zindulka, Florian Lehmann, Hendrik Heuer, Daniel
Buschek
- Abstract summary: We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience.
This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design.
- Score: 32.19315306717165
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Compelling writing is tailored to its audience. This is challenging, as
writers may struggle to empathize with readers, get feedback in time, or gain
access to the target group. We propose a concept that generates on-demand
feedback, based on writer-defined AI personas of any target audience. We
explore this concept with a prototype (using GPT-3.5) in two user studies (N=5
and N=11): Writers appreciated the concept and strategically used personas for
getting different perspectives. The feedback was seen as helpful and inspired
revisions of text and personas, although it was often verbose and unspecific.
We discuss the impact of on-demand feedback, the limited representativity of
contemporary AI systems, and further ideas for defining AI personas. This work
contributes to the vision of supporting writers with AI by expanding the
socio-technical perspective in AI tool design: To empower creators, we also
need to keep in mind their relationship to an audience.
Related papers
- Automated Focused Feedback Generation for Scientific Writing Assistance [6.559560602099439]
SWIF$2$T: a Scientific WrIting Focused Feedback Tool.
It is designed to generate specific, actionable and coherent comments, which identify weaknesses in a scientific paper and/or propose revisions to it.
We compile a dataset of 300 peer reviews citing weaknesses in scientific papers and conduct human evaluation.
The results demonstrate the superiority in specificity, reading comprehension, and overall helpfulness of SWIF$2$T's feedback compared to other approaches.
arXiv Detail & Related papers (2024-05-30T20:56:41Z) - GhostWriter: Augmenting Collaborative Human-AI Writing Experiences
Through Personalization and Agency [1.7707677585873678]
Large language models (LLMs) are becoming more prevalent and have found a ubiquitous use in providing different forms of writing assistance.
We introduce GhostWriter, an AI-enhanced writing design probe where users can exercise enhanced agency and personalization.
We study 18 participants who use GhostWriter on two different writing tasks, observing that it helps users craft personalized text generations and empowers them by providing multiple ways to control the system's writing style.
arXiv Detail & Related papers (2024-02-13T23:48:59Z) - UltraFeedback: Boosting Language Models with Scaled AI Feedback [99.4633351133207]
We present textscUltraFeedback, a large-scale, high-quality, and diversified AI feedback dataset.
Our work validates the effectiveness of scaled AI feedback data in constructing strong open-source chat language models.
arXiv Detail & Related papers (2023-10-02T17:40:01Z) - The Future of AI-Assisted Writing [0.0]
We conduct a comparative user-study between such tools from an information retrieval lens: pull and push.
Our findings show that users welcome seamless assistance of AI in their writing.
Users also enjoyed the collaboration with AI-assisted writing tools and did not feel a lack of ownership.
arXiv Detail & Related papers (2023-06-29T02:46:45Z) - The Role of AI in Drug Discovery: Challenges, Opportunities, and
Strategies [97.5153823429076]
The benefits, challenges and drawbacks of AI in this field are reviewed.
The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
arXiv Detail & Related papers (2022-12-08T23:23:39Z) - Creative Writing with an AI-Powered Writing Assistant: Perspectives from
Professional Writers [9.120878749348986]
Natural language generation (NLG) using neural language models has brought us closer than ever to the goal of building AI-powered creative writing tools.
Recent developments in natural language generation using neural language models have brought us closer than ever to the goal of building AI-powered creative writing tools.
arXiv Detail & Related papers (2022-11-09T17:00:56Z) - What Do End-Users Really Want? Investigation of Human-Centered XAI for
Mobile Health Apps [69.53730499849023]
We present a user-centered persona concept to evaluate explainable AI (XAI)
Results show that users' demographics and personality, as well as the type of explanation, impact explanation preferences.
Our insights bring an interactive, human-centered XAI closer to practical application.
arXiv Detail & Related papers (2022-10-07T12:51:27Z) - Suggestion Lists vs. Continuous Generation: Interaction Design for
Writing with Generative Models on Mobile Devices Affect Text Length, Wording
and Perceived Authorship [27.853155569154705]
We present two user interfaces for writing with AI on mobile devices, which manipulate levels of initiative and control.
With AI suggestions, people wrote less actively, yet felt they were the author.
In both designs, AI increased text length and was perceived to influence wording.
arXiv Detail & Related papers (2022-08-01T13:57:11Z) - Telling Creative Stories Using Generative Visual Aids [52.623545341588304]
We asked writers to write creative stories from a starting prompt, and provided them with visuals created by generative AI models from the same prompt.
Compared to a control group, writers who used the visuals as story writing aid wrote significantly more creative, original, complete and visualizable stories.
Findings indicate that cross modality inputs by AI can benefit divergent aspects of creativity in human-AI co-creation, but hinders convergent thinking.
arXiv Detail & Related papers (2021-10-27T23:13:47Z) - The MineRL BASALT Competition on Learning from Human Feedback [58.17897225617566]
The MineRL BASALT competition aims to spur forward research on this important class of techniques.
We design a suite of four tasks in Minecraft for which we expect it will be hard to write down hardcoded reward functions.
We provide a dataset of human demonstrations on each of the four tasks, as well as an imitation learning baseline.
arXiv Detail & Related papers (2021-07-05T12:18:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.