GPoeT-2: A GPT-2 Based Poem Generator
- URL: http://arxiv.org/abs/2205.08847v1
- Date: Wed, 18 May 2022 10:25:12 GMT
- Title: GPoeT-2: A GPT-2 Based Poem Generator
- Authors: Kai-Ling Lo, Rami Ariss, Philipp Kurz
- Abstract summary: GPoeT-2 is based on fine-tuning a state of the art natural language model (i.e. GPT-2) to generate limericks.
We present a collection of 94 categorized limericks that rank highly on the explored "good poetry" metrics to provoke human creativity.
- Score: 0.5156484100374058
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: This project aims to produce the next volume of machine-generated poetry, a
complex art form that can be structured and unstructured, and carries depth in
the meaning between the lines. GPoeT-2 is based on fine-tuning a state of the
art natural language model (i.e. GPT-2) to generate limericks, typically
humorous structured poems consisting of five lines with a AABBA rhyming scheme.
With a two-stage generation system utilizing both forward and reverse language
modeling, GPoeT-2 is capable of freely generating limericks in diverse topics
while following the rhyming structure without any seed phrase or a posteriori
constraints.Based on the automated generation process, we explore a wide
variety of evaluation metrics to quantify "good poetry," including syntactical
correctness, lexical diversity, and subject continuity. Finally, we present a
collection of 94 categorized limericks that rank highly on the explored "good
poetry" metrics to provoke human creativity.
Related papers
- REFFLY: Melody-Constrained Lyrics Editing Model [50.03960548399128]
We introduce REFFLY, the first revision framework designed to edit arbitrary forms of plain text draft into high-quality, full-fledged song lyrics.
Our approach ensures that the generated lyrics retain the original meaning of the draft, align with the melody, and adhere to the desired song structures.
arXiv Detail & Related papers (2024-08-30T23:22:34Z) - PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in
Poetry Generation [58.36105306993046]
Controllable text generation is a challenging and meaningful field in natural language generation (NLG)
In this paper, we pioneer the use of the Diffusion model for generating sonnets and Chinese SongCi poetry.
Our model outperforms existing models in automatic evaluation of semantic, metrical, and overall performance as well as human evaluation.
arXiv Detail & Related papers (2023-06-14T11:57:31Z) - Unsupervised Melody-to-Lyric Generation [91.29447272400826]
We propose a method for generating high-quality lyrics without training on any aligned melody-lyric data.
We leverage the segmentation and rhythm alignment between melody and lyrics to compile the given melody into decoding constraints.
Our model can generate high-quality lyrics that are more on-topic, singable, intelligible, and coherent than strong baselines.
arXiv Detail & Related papers (2023-05-30T17:20:25Z) - PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised
Poetry Generation [42.12348554537587]
Formal verse poetry imposes strict constraints on the meter and rhyme scheme of poems.
Most prior work on generating this type of poetry uses existing poems for supervision.
We propose an unsupervised approach to generate poems following any given meter and rhyme scheme.
arXiv Detail & Related papers (2022-05-24T17:09:55Z) - SP-GPT2: Semantics Improvement in Vietnamese Poetry Generation [1.9107347888374506]
Generative Pretraining Transformer 2 (GPT2) is one of the state of the art approaches that have excellent successes.
In this paper, we took the first step to investigate the power of GPT2 in traditional Vietnamese poetry generation.
We released the first computational scoring module for poems generated in the template containing the style rule dictionary.
arXiv Detail & Related papers (2021-10-10T14:31:08Z) - CCPM: A Chinese Classical Poetry Matching Dataset [50.90794811956129]
We propose a novel task to assess a model's semantic understanding of poetry by poem matching.
This task requires the model to select one line of Chinese classical poetry among four candidates according to the modern Chinese translation of a line of poetry.
To construct this dataset, we first obtain a set of parallel data of Chinese classical poetry and modern Chinese translation.
arXiv Detail & Related papers (2021-06-03T16:49:03Z) - There Once Was a Really Bad Poet, It Was Automated but You Didn't Know
It [31.951441780084345]
We introduce LimGen, a novel and fully automated system for limerick generation.
LimGen outperforms state-of-the-art neural network-based poetry models.
The resulting limericks satisfy poetic constraints and have thematically coherent storylines.
arXiv Detail & Related papers (2021-03-05T16:03:55Z) - Acrostic Poem Generation [26.604889384391726]
We propose a new task in the area of computational creativity: acrostic poem generation in English.
Acrostic poems are poems that contain a hidden message; typically, the first letter of each line spells out a word or short phrase.
Our experiments show that the acrostic poems generated by our baseline are received well by humans and do not lose much quality due to the additional constraints.
arXiv Detail & Related papers (2020-10-05T18:00:15Z) - Generating Major Types of Chinese Classical Poetry in a Uniformed
Framework [88.57587722069239]
We propose a GPT-2 based framework for generating major types of Chinese classical poems.
Preliminary results show this enhanced model can generate Chinese classical poems of major types with high quality in both form and content.
arXiv Detail & Related papers (2020-03-13T14:16:25Z) - Introducing Aspects of Creativity in Automatic Poetry Generation [2.792030485253753]
Poetry Generation involves teaching systems to automatically generate text that resembles poetic work.
A deep learning system can learn to generate poetry on its own by training on a corpus of poems and modeling the particular style of language.
We propose taking an approach that fine-tunes GPT-2, a pre-trained language model, to our downstream task of poetry generation.
arXiv Detail & Related papers (2020-02-06T20:44:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.