Automatic Neural Lyrics and Melody Composition
- URL: http://arxiv.org/abs/2011.06380v1
- Date: Thu, 12 Nov 2020 13:44:01 GMT
- Title: Automatic Neural Lyrics and Melody Composition
- Authors: Gurunath Reddy Madhumani, Yi Yu, Florian Harsco\"et, Simon Canales,
Suhua Tang
- Abstract summary: The proposed system, Automatic Neural Lyrics and Melody Composition (AutoNLMC) is an attempt to make the whole process of songwriting automatic using artificial neural networks.
Our lyric to vector (lyric2vec) model trained on a large set of lyric-melody pairs dataset parsed at syllable, word and sentence levels are large scale embedding models.
It can also take lyrics from professional lyric writer to generate matching melodies.
- Score: 6.574381538711984
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: In this paper, we propose a technique to address the most challenging aspect
of algorithmic songwriting process, which enables the human community to
discover original lyrics, and melodies suitable for the generated lyrics. The
proposed songwriting system, Automatic Neural Lyrics and Melody Composition
(AutoNLMC) is an attempt to make the whole process of songwriting automatic
using artificial neural networks. Our lyric to vector (lyric2vec) model trained
on a large set of lyric-melody pairs dataset parsed at syllable, word and
sentence levels are large scale embedding models enable us to train data driven
model such as recurrent neural networks for popular English songs. AutoNLMC is
a encoder-decoder sequential recurrent neural network model consisting of a
lyric generator, a lyric encoder and melody decoder trained end-to-end.
AutoNLMC is designed to generate both lyrics and corresponding melody
automatically for an amateur or a person without music knowledge. It can also
take lyrics from professional lyric writer to generate matching melodies. The
qualitative and quantitative evaluation measures revealed that the proposed
method is indeed capable of generating original lyrics and corresponding melody
for composing new songs.
Related papers
- Syllable-level lyrics generation from melody exploiting character-level
language model [14.851295355381712]
We propose to exploit fine-tuning character-level language models for syllable-level lyrics generation from symbolic melody.
In particular, our method endeavors to incorporate linguistic knowledge of the language model into the beam search process of a syllable-level Transformer generator network.
arXiv Detail & Related papers (2023-10-02T02:53:29Z) - Unsupervised Melody-to-Lyric Generation [91.29447272400826]
We propose a method for generating high-quality lyrics without training on any aligned melody-lyric data.
We leverage the segmentation and rhythm alignment between melody and lyrics to compile the given melody into decoding constraints.
Our model can generate high-quality lyrics that are more on-topic, singable, intelligible, and coherent than strong baselines.
arXiv Detail & Related papers (2023-05-30T17:20:25Z) - Unsupervised Melody-Guided Lyrics Generation [84.22469652275714]
We propose to generate pleasantly listenable lyrics without training on melody-lyric aligned data.
We leverage the crucial alignments between melody and lyrics and compile the given melody into constraints to guide the generation process.
arXiv Detail & Related papers (2023-05-12T20:57:20Z) - Deep Attention-Based Alignment Network for Melody Generation from
Incomplete Lyrics [12.05359079565586]
A deep neural lyrics-to-melody net is trained in an encoder-decoder way to predict possible pairs of lyrics-melody when given incomplete lyrics.
The attention mechanism is exploited to align the predicted lyrics with the melody during the lyrics-to-melody generation.
arXiv Detail & Related papers (2023-01-23T03:41:53Z) - Re-creation of Creations: A New Paradigm for Lyric-to-Melody Generation [158.54649047794794]
Re-creation of Creations (ROC) is a new paradigm for lyric-to-melody generation.
ROC achieves good lyric-melody feature alignment in lyric-to-melody generation.
arXiv Detail & Related papers (2022-08-11T08:44:47Z) - Interpretable Melody Generation from Lyrics with Discrete-Valued
Adversarial Training [12.02541352832997]
Gumbel-Softmax is exploited to solve the non-differentiability problem of generating music attributes by Generative Adversarial Networks (GANs)
Users can listen to the generated AI song as well as recreate a new song by selecting from recommended music attributes.
arXiv Detail & Related papers (2022-06-30T05:45:47Z) - Youling: an AI-Assisted Lyrics Creation System [72.00418962906083]
This paper demonstrates textitYouling, an AI-assisted lyrics creation system, designed to collaborate with music creators.
In the lyrics generation process, textitYouling supports traditional one pass full-text generation mode as well as an interactive generation mode.
The system also provides a revision module which enables users to revise undesired sentences or words of lyrics repeatedly.
arXiv Detail & Related papers (2022-01-18T03:57:04Z) - SongMASS: Automatic Song Writing with Pre-training and Alignment
Constraint [54.012194728496155]
SongMASS is proposed to overcome the challenges of lyric-to-melody generation and melody-to-lyric generation.
It leverages masked sequence to sequence (MASS) pre-training and attention based alignment modeling.
We show that SongMASS generates lyric and melody with significantly better quality than the baseline method.
arXiv Detail & Related papers (2020-12-09T16:56:59Z) - Melody-Conditioned Lyrics Generation with SeqGANs [81.2302502902865]
We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN)
We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.
arXiv Detail & Related papers (2020-10-28T02:35:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.