Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learning

• URL: http://arxiv.org/abs/2111.07592v1
• Date: Mon, 15 Nov 2021 08:13:26 GMT
• Title: Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learning
• Authors: Naveen Ram, Tanay Gummadi, Rahul Bhethanabotla, Richard J. Savery, Gil Weinberg
• Abstract summary: We present a collaborative line-level lyric generation system that utilizes transfer-learning via the T5 transformer model. We develop a model that is able to learn lyrical and stylistic tasks like rhyming, matching line beat requirements, and ending lines with specific target words.
• Score: 0.9449650062296822
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Lyric generation is a popular sub-field of natural language generation that has seen growth in recent years. Pop lyrics are of unique interest due to the genre's unique style and content, in addition to the high level of collaboration that goes on behind the scenes in the professional pop songwriting process. In this paper, we present a collaborative line-level lyric generation system that utilizes transfer-learning via the T5 transformer model, which, till date, has not been used to generate pop lyrics. By working and communicating directly with professional songwriters, we develop a model that is able to learn lyrical and stylistic tasks like rhyming, matching line beat requirements, and ending lines with specific target words. Our approach compares favorably to existing methods for multiple datasets and yields positive results from our online studies and interviews with industry songwriters.

Related papers

• Optimizing the Songwriting Process: Genre-Based Lyric Generation Using Deep Learning Models [2.703659575788133]
  This project aims to simplify the traditional songwriting process with deep learning techniques. We developed a unique preprocessing format using tokens to parse lyrics into individual verses. We found that generation yielded higher recall (ROUGE) in the baseline model, but similar precision (BLEU) for both models.
  arXiv  Detail & Related papers  (2024-09-15T21:32:46Z)
• SongCreator: Lyrics-based Universal Song Generation [53.248473603201916]
  SongCreator is a song-generation system designed to tackle the challenge of generating songs with both vocals and accompaniment given lyrics. The model features two novel designs: a meticulously designed dual-sequence language model (M) to capture the information of vocals and accompaniment for song generation, and a series of attention mask strategies for DSLM. Experiments demonstrate the effectiveness of SongCreator by achieving state-of-the-art or competitive performances on all eight tasks.
  arXiv  Detail & Related papers  (2024-09-09T19:37:07Z)
• Encoder-Decoder Framework for Interactive Free Verses with Generation with Controllable High-Quality Rhyming [15.595206559574017]
  We propose a novel fine-tuning approach that prepends the rhyming word at the start of each lyric. We conducted extensive experiments to compare this fine-tuning against the current state-of-the-art strategies for rhyming. We furnish a high-quality dataset in English and 12 other languages, analyse the approach's feasibility in a multilingual context, and propose metrics to compare methods in the future.
  arXiv  Detail & Related papers  (2024-05-08T16:13:40Z)
• Unsupervised Melody-to-Lyric Generation [91.29447272400826]
  We propose a method for generating high-quality lyrics without training on any aligned melody-lyric data. We leverage the segmentation and rhythm alignment between melody and lyrics to compile the given melody into decoding constraints. Our model can generate high-quality lyrics that are more on-topic, singable, intelligible, and coherent than strong baselines.
  arXiv  Detail & Related papers  (2023-05-30T17:20:25Z)
• Unsupervised Melody-Guided Lyrics Generation [84.22469652275714]
  We propose to generate pleasantly listenable lyrics without training on melody-lyric aligned data. We leverage the crucial alignments between melody and lyrics and compile the given melody into constraints to guide the generation process.
  arXiv  Detail & Related papers  (2023-05-12T20:57:20Z)
• Genre-conditioned Acoustic Models for Automatic Lyrics Transcription of Polyphonic Music [73.73045854068384]
  We propose to transcribe the lyrics of polyphonic music using a novel genre-conditioned network. The proposed network adopts pre-trained model parameters, and incorporates the genre adapters between layers to capture different genre peculiarities for lyrics-genre pairs. Our experiments show that the proposed genre-conditioned network outperforms the existing lyrics transcription systems.
  arXiv  Detail & Related papers  (2022-04-07T09:15:46Z)
• Youling: an AI-Assisted Lyrics Creation System [72.00418962906083]
  This paper demonstrates textitYouling, an AI-assisted lyrics creation system, designed to collaborate with music creators. In the lyrics generation process, textitYouling supports traditional one pass full-text generation mode as well as an interactive generation mode. The system also provides a revision module which enables users to revise undesired sentences or words of lyrics repeatedly.
  arXiv  Detail & Related papers  (2022-01-18T03:57:04Z)
• Melody-Conditioned Lyrics Generation with SeqGANs [81.2302502902865]
  We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN) We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.
  arXiv  Detail & Related papers  (2020-10-28T02:35:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.