Compose Like Humans: Jointly Improving the Coherence and Novelty for Modern Chinese Poetry Generation

• URL: http://arxiv.org/abs/2005.01556v1
• Date: Mon, 4 May 2020 15:16:10 GMT
• Title: Compose Like Humans: Jointly Improving the Coherence and Novelty for Modern Chinese Poetry Generation
• Authors: Lei Shen, Xiaoyu Guo, Meng Chen
• Abstract summary: We propose a generate-retrieve-then-refine paradigm to jointly improve the coherence and novelty. Experimental results on a collected large-scale modern Chinese poetry dataset show that our proposed approach can not only generate more coherent poems, but also improve the diversity and novelty.
• Score: 13.709648635080828
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Chinese poetry is an important part of worldwide culture, and classical and modern sub-branches are quite different. The former is a unique genre and has strict constraints, while the latter is very flexible in length, optional to have rhymes, and similar to modern poetry in other languages. Thus, it requires more to control the coherence and improve the novelty. In this paper, we propose a generate-retrieve-then-refine paradigm to jointly improve the coherence and novelty. In the first stage, a draft is generated given keywords (i.e., topics) only. The second stage produces a "refining vector" from retrieval lines. At last, we take into consideration both the draft and the "refining vector" to generate a new poem. The draft provides future sentence-level information for a line to be generated. Meanwhile, the "refining vector" points out the direction of refinement based on impressive words detection mechanism which can learn good patterns from references and then create new ones via insertion operation. Experimental results on a collected large-scale modern Chinese poetry dataset show that our proposed approach can not only generate more coherent poems, but also improve the diversity and novelty.

Related papers

• Encoder-Decoder Framework for Interactive Free Verses with Generation with Controllable High-Quality Rhyming [15.595206559574017]
  We propose a novel fine-tuning approach that prepends the rhyming word at the start of each lyric. We conducted extensive experiments to compare this fine-tuning against the current state-of-the-art strategies for rhyming. We furnish a high-quality dataset in English and 12 other languages, analyse the approach's feasibility in a multilingual context, and propose metrics to compare methods in the future.
  arXiv  Detail & Related papers  (2024-05-08T16:13:40Z)
• SciMON: Scientific Inspiration Machines Optimized for Novelty [68.46036589035539]
  We explore and enhance the ability of neural language models to generate novel scientific directions grounded in literature. We take a dramatic departure with a novel setting in which models use as input background contexts. We present SciMON, a modeling framework that uses retrieval of "inspirations" from past scientific papers.
  arXiv  Detail & Related papers  (2023-05-23T17:12:08Z)
• Prose2Poem: The Blessing of Transformers in Translating Prose to Persian Poetry [2.15242029196761]
  We introduce a novel Neural Machine Translation (NMT) approach to translate prose to ancient Persian poetry. We trained a Transformer model from scratch to obtain initial translations and pretrained different variations of BERT to obtain final translations.
  arXiv  Detail & Related papers  (2021-09-30T09:04:11Z)
• Lingxi: A Diversity-aware Chinese Modern Poetry Generation System [43.36560720793425]
  Lingxi is a diversity-aware Chinese modern poetry generation system. We propose nucleus sampling with randomized head (NS-RH) algorithm. We find that even when a large portion of filtered vocabulary is randomized, it can actually generate fluent poetry.
  arXiv  Detail & Related papers  (2021-08-27T03:33:28Z)
• CCPM: A Chinese Classical Poetry Matching Dataset [50.90794811956129]
  We propose a novel task to assess a model's semantic understanding of poetry by poem matching. This task requires the model to select one line of Chinese classical poetry among four candidates according to the modern Chinese translation of a line of poetry. To construct this dataset, we first obtain a set of parallel data of Chinese classical poetry and modern Chinese translation.
  arXiv  Detail & Related papers  (2021-06-03T16:49:03Z)
• Generate and Revise: Reinforcement Learning in Neural Poetry [17.128639251861784]
  We propose a framework to generate poems that are repeatedly revisited and corrected, as humans do, in order to improve their overall quality. Our model generates poems from scratch and it learns to progressively adjust the generated text in order to match a target criterion. We evaluate this approach in the case of matching a rhyming scheme, without having any information on which words are responsible of creating rhymes and on how to coherently alter the poem words.
  arXiv  Detail & Related papers  (2021-02-08T10:35:33Z)
• Improving Adversarial Text Generation by Modeling the Distant Future [155.83051741029732]
  We consider a text planning scheme and present a model-based imitation-learning approach to alleviate the aforementioned issues. We propose a novel guider network to focus on the generative process over a longer horizon, which can assist next-word prediction and provide intermediate rewards for generator optimization.
  arXiv  Detail & Related papers  (2020-05-04T05:45:13Z)
• Generating Major Types of Chinese Classical Poetry in a Uniformed Framework [88.57587722069239]
  We propose a GPT-2 based framework for generating major types of Chinese classical poems. Preliminary results show this enhanced model can generate Chinese classical poems of major types with high quality in both form and content.
  arXiv  Detail & Related papers  (2020-03-13T14:16:25Z)
• MixPoet: Diverse Poetry Generation via Learning Controllable Mixed Latent Space [79.70053419040902]
  We propose MixPoet, a novel model that absorbs multiple factors to create various styles and promote diversity. Based on a semi-supervised variational autoencoder, our model disentangles the latent space into some subspaces, with each conditioned on one influence factor by adversarial training. Experiment results on Chinese poetry demonstrate that MixPoet improves both diversity and quality against three state-of-the-art models.
  arXiv  Detail & Related papers  (2020-03-13T03:31:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.