"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models
- URL: http://arxiv.org/abs/2411.13032v1
- Date: Wed, 20 Nov 2024 04:42:32 GMT
- Title: "It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models
- Authors: Angel Hsing-Chi Hwang, Q. Vera Liao, Su Lin Blodgett, Alexandra Olteanu, Adam Trischler,
- Abstract summary: We examine whether and how writers want to preserve their authentic voice when co-writing with AI tools.
Our findings illuminate conceptions of authenticity in human-AI co-creation.
Readers' responses showed less concern about human-AI co-writing.
- Score: 97.22914355737676
- License:
- Abstract: Given the rising proliferation and diversity of AI writing assistance tools, especially those powered by large language models (LLMs), both writers and readers may have concerns about the impact of these tools on the authenticity of writing work. We examine whether and how writers want to preserve their authentic voice when co-writing with AI tools and whether personalization of AI writing support could help achieve this goal. We conducted semi-structured interviews with 19 professional writers, during which they co-wrote with both personalized and non-personalized AI writing-support tools. We supplemented writers' perspectives with opinions from 30 avid readers about the written work co-produced with AI collected through an online survey. Our findings illuminate conceptions of authenticity in human-AI co-creation, which focus more on the process and experience of constructing creators' authentic selves. While writers reacted positively to personalized AI writing tools, they believed the form of personalization needs to target writers' growth and go beyond the phase of text production. Overall, readers' responses showed less concern about human-AI co-writing. Readers could not distinguish AI-assisted work, personalized or not, from writers' solo-written work and showed positive attitudes toward writers experimenting with new technology for creative writing.
Related papers
- AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text [53.15652021126663]
We present CREATIVITY INDEX as the first step to quantify the linguistic creativity of a text.
To compute CREATIVITY INDEX efficiently, we introduce DJ SEARCH, a novel dynamic programming algorithm.
Experiments reveal that the CREATIVITY INDEX of professional human authors is on average 66.2% higher than that of LLMs.
arXiv Detail & Related papers (2024-10-05T18:55:01Z) - PaperCard for Reporting Machine Assistance in Academic Writing [48.33722012818687]
ChatGPT, a question-answering system released by OpenAI in November 2022, has demonstrated a range of capabilities that could be utilised in producing academic papers.
This raises critical questions surrounding the concept of authorship in academia.
We propose a framework we name "PaperCard", a documentation for human authors to transparently declare the use of AI in their writing process.
arXiv Detail & Related papers (2023-10-07T14:28:04Z) - Writer-Defined AI Personas for On-Demand Feedback Generation [32.19315306717165]
We propose a concept that generates on-demand feedback, based on writer-defined AI personas of any target audience.
This work contributes to the vision of supporting writers with AI by expanding the socio-technical perspective in AI tool design.
arXiv Detail & Related papers (2023-09-19T08:49:35Z) - The Future of AI-Assisted Writing [0.0]
We conduct a comparative user-study between such tools from an information retrieval lens: pull and push.
Our findings show that users welcome seamless assistance of AI in their writing.
Users also enjoyed the collaboration with AI-assisted writing tools and did not feel a lack of ownership.
arXiv Detail & Related papers (2023-06-29T02:46:45Z) - The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of
AI-Generated Text But Self-Declare as Authors [42.72188284211033]
We investigate authorship and ownership in human-AI collaboration for personalized language generation.
We show an AI Ghostwriter Effect: Users do not consider themselves the owners and authors of AI-generated text.
We discuss how our findings relate to psychological ownership and human-AI interaction to lay the foundations for adapting authorship frameworks.
arXiv Detail & Related papers (2023-03-06T16:53:12Z) - Creative Writing with an AI-Powered Writing Assistant: Perspectives from
Professional Writers [9.120878749348986]
Natural language generation (NLG) using neural language models has brought us closer than ever to the goal of building AI-powered creative writing tools.
Recent developments in natural language generation using neural language models have brought us closer than ever to the goal of building AI-powered creative writing tools.
arXiv Detail & Related papers (2022-11-09T17:00:56Z) - Suggestion Lists vs. Continuous Generation: Interaction Design for
Writing with Generative Models on Mobile Devices Affect Text Length, Wording
and Perceived Authorship [27.853155569154705]
We present two user interfaces for writing with AI on mobile devices, which manipulate levels of initiative and control.
With AI suggestions, people wrote less actively, yet felt they were the author.
In both designs, AI increased text length and was perceived to influence wording.
arXiv Detail & Related papers (2022-08-01T13:57:11Z) - Computational Storytelling and Emotions: A Survey [56.95572957863576]
This survey paper is intended to summarize and contribute to the development of research being conducted on the relationship between stories and emotions.
We believe creativity research is not to replace humans with computers, but to find a way of collaboration between humans and computers to enhance the creativity.
arXiv Detail & Related papers (2022-05-23T00:21:59Z) - CoAuthor: Designing a Human-AI Collaborative Writing Dataset for
Exploring Language Model Capabilities [92.79451009324268]
We present CoAuthor, a dataset designed for revealing GPT-3's capabilities in assisting creative and argumentative writing.
We demonstrate that CoAuthor can address questions about GPT-3's language, ideation, and collaboration capabilities.
We discuss how this work may facilitate a more principled discussion around LMs' promises and pitfalls in relation to interaction design.
arXiv Detail & Related papers (2022-01-18T07:51:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.