Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

• URL: http://arxiv.org/abs/2210.13669v1
• Date: Tue, 25 Oct 2022 00:07:10 GMT
• Title: Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing
• Abstract summary: We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change.
• Score: 17.975181293647697
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted creativity, we aim to study if LLMs can improve the quality of user-generated content through collaboration. We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about `love' or Write a sentence ending in `fly'. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive with publicly available LLMs trained on instructions (InstructGPT), but is also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change. Further, the collaboratively written poems are preferred by third-party evaluators over those written without the system.

Related papers

• SWIM: Student Writing Simulation via Proficiency-Conditioned Generation [54.69949380133243]
  This work explores if language models can realistically simulate student writing, and introduce SWIM.<n>We evaluate prompting, supervised fine-tuning, and reinforcement learning methods for writing simulation using automated essay scoring as a measure of profile alignment.<n>Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.
  arXiv  Detail & Related papers  (2026-09-02T23:10:51Z)
• Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Style [21.31042786004255]
  Post-editing of large language models (LLMs) is a common collaborative writing strategy.<n>We find that post-editing increases stylistic similarity to participants' unassisted writing.<n>We find a gap between perceived stylistic authenticity and model-measured stylistic similarity.
  arXiv  Detail & Related papers  (2026-04-27T13:11:57Z)
• Decoding the Black Box: Discerning AI Rhetorics About and Through Poetic Prompting [0.0]
  This study suggests that creative text prompting, specifically Poetry Prompt Patterns, may be a useful addition to the toolbox of the prompt engineer.<n>The paper uses poetic prompts to assess descriptions and evaluations of three models of a renowned poet.
  arXiv  Detail & Related papers  (2025-12-04T20:41:39Z)
• Catch Me If You Can? Not Yet: LLMs Still Struggle to Imitate the Implicit Writing Styles of Everyday Authors [9.921537507947473]
  This work presents a comprehensive evaluation of large language models' ability to mimic personal writing styles.<n>We introduce an ensemble of complementary metrics-including authorship attribution, authorship verification, style matching, and AI detection-to robustly assess style imitation.<n>Results show that while LLMs can approximate user styles in structured formats like news and email, they struggle with nuanced, informal writing in blogs and forums.
  arXiv  Detail & Related papers  (2025-09-18T02:18:49Z)
• ProsodyLM: Uncovering the Emerging Prosody Processing Capabilities in Speech Language Models [70.56468982313834]
  We propose ProsodyLM, which introduces a simple tokenization scheme amenable to learning prosody.<n>We find that ProsodyLM can learn surprisingly diverse emerging prosody processing capabilities through pre-training alone.
  arXiv  Detail & Related papers  (2025-07-27T00:59:01Z)
• Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs [50.0874045899661]
  We introduce CharacterBot, a model designed to replicate both the linguistic patterns and distinctive thought processes of a character. Using Lu Xun as a case study, we propose four training tasks derived from his 17 essay collections. These include a pre-training task focused on mastering external linguistic structures and knowledge, as well as three fine-tuning tasks. We evaluate CharacterBot on three tasks for linguistic accuracy and opinion comprehension, demonstrating that it significantly outperforms the baselines on our adapted metrics.
  arXiv  Detail & Related papers  (2025-02-18T16:11:54Z)
• Customizing Large Language Model Generation Style using Parameter-Efficient Finetuning [24.263699489328427]
  One-size-fits-all large language models (LLMs) are increasingly being used to help people with their writing. This paper explores whether parameter-efficient finetuning (PEFT) with Low-Rank Adaptation can effectively guide the style of LLM generations.
  arXiv  Detail & Related papers  (2024-09-06T19:25:18Z)
• Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education [1.6340559025561785]
  Large language model (LLM)-based evaluation pipelines have demonstrated their capability to robustly evaluate machine-generated text. We investigate whether LLMs can effectively assess human-written text for educational purposes.
  arXiv  Detail & Related papers  (2024-07-24T06:02:57Z)
• Step-Back Profiling: Distilling User History for Personalized Scientific Writing [50.481041470669766]
  Large language models (LLM) excel at a variety of natural language processing tasks, yet they struggle to generate personalized content for individuals. We introduce STEP-BACK PROFILING to personalize LLMs by distilling user history into concise profiles. Our approach outperforms the baselines by up to 3.6 points on the general personalization benchmark.
  arXiv  Detail & Related papers  (2024-06-20T12:58:26Z)
• Navigating the Path of Writing: Outline-guided Text Generation with Large Language Models [8.920436030483872]
  We propose Writing Path, a framework that uses explicit outlines to guide Large Language Models (LLMs) in generating user-aligned text. Our approach draws inspiration from structured writing planning and reasoning paths, focusing on capturing and reflecting user intentions throughout the writing process.
  arXiv  Detail & Related papers  (2024-04-22T06:57:43Z)
• Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations [65.29513437838457]
  Even if two current turns are the same sentence, their responses might still differ when they are spoken in different styles. We propose Spoken-LLM framework that can model the linguistic content and the speaking styles. We train Spoken-LLM using the StyleTalk dataset and devise a two-stage training pipeline to help the Spoken-LLM better learn the speaking styles.
  arXiv  Detail & Related papers  (2024-02-20T07:51:43Z)
• GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency [1.7707677585873678]
  Large language models (LLMs) are becoming more prevalent and have found a ubiquitous use in providing different forms of writing assistance. We introduce GhostWriter, an AI-enhanced writing design probe where users can exercise enhanced agency and personalization. We study 18 participants who use GhostWriter on two different writing tasks, observing that it helps users craft personalized text generations and empowers them by providing multiple ways to control the system's writing style.
  arXiv  Detail & Related papers  (2024-02-13T23:48:59Z)
• PerPLM: Personalized Fine-tuning of Pretrained Language Models via Writer-specific Intermediate Learning and Prompts [16.59511985633798]
  Pretrained language models (PLMs) are powerful tools for capturing context. PLMs are typically pretrained and fine-tuned for universal use across different writers. This study aims to improve the accuracy of text understanding tasks by personalizing the fine-tuning of PLMs for specific writers.
  arXiv  Detail & Related papers  (2023-09-14T14:03:48Z)
• PEER: A Collaborative Language Model [70.11876901409906]
  We introduce PEER, a collaborative language model that imitates the entire writing process itself. PEER can write drafts, add suggestions, propose edits and provide explanations for its actions. We show that PEER achieves strong performance across various domains and editing tasks.
  arXiv  Detail & Related papers  (2022-08-24T16:56:47Z)
• CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities [92.79451009324268]
  We present CoAuthor, a dataset designed for revealing GPT-3's capabilities in assisting creative and argumentative writing. We demonstrate that CoAuthor can address questions about GPT-3's language, ideation, and collaboration capabilities. We discuss how this work may facilitate a more principled discussion around LMs' promises and pitfalls in relation to interaction design.
  arXiv  Detail & Related papers  (2022-01-18T07:51:57Z)
• Machine-in-the-Loop Rewriting for Creative Image Captioning [5.544401446569243]
  We train a rewriting model that modifies specified spans of text within the user's original draft to introduce descriptive and figurative elements locally in the text. We evaluate the model on its ability to collaborate with humans on the task of creative image captioning.
  arXiv  Detail & Related papers  (2021-11-07T22:17:41Z)
• Abstractive Summarization of Spoken and Written Instructions with BERT [66.14755043607776]
  We present the first application of the BERTSum model to conversational language. We generate abstractive summaries of narrated instructional videos across a wide variety of topics. We envision this integrated as a feature in intelligent virtual assistants, enabling them to summarize both written and spoken instructional content upon request.
  arXiv  Detail & Related papers  (2020-08-21T20:59:34Z)
• Enabling Language Models to Fill in the Blanks [81.59381915581892]
  We present a simple approach for text infilling, the task of predicting missing spans of text at any position in a document. We train (or fine-tune) off-the-shelf language models on sequences containing the concatenation of artificially-masked text and the text which was masked. We show that this approach, which we call infilling by language modeling, can enable LMs to infill entire sentences effectively on three different domains: short stories, scientific abstracts, and lyrics.
  arXiv  Detail & Related papers  (2020-05-11T18:00:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.