Chord-Conditioned Melody Choralization with Controllable Harmonicity and Polyphonicity

• URL: http://arxiv.org/abs/2202.08423v1
• Date: Thu, 17 Feb 2022 02:59:36 GMT
• Title: Chord-Conditioned Melody Choralization with Controllable Harmonicity and Polyphonicity
• Authors: Shangda Wu, Xiaobing Li, Maosong Sun
• Abstract summary: Melody choralization, i.e. generating a four-part chorale based on a user-given melody, has long been closely associated with J.S. Bach chorales. Previous neural network-based systems rarely focus on chorale generation conditioned on a chord progression. We propose DeepChoir, a melody choralization system, which can generate a four-part chorale for a given melody conditioned on a chord progression.
• Score: 75.02344976811062
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Melody choralization, i.e. generating a four-part chorale based on a user-given melody, has long been closely associated with J.S. Bach chorales. Previous neural network-based systems rarely focus on chorale generation conditioned on a chord progression, and none of them realised controllable melody choralization. To enable neural networks to learn the general principles of counterpoint from Bach's chorales, we first design a music representation that encoded chord symbols for chord conditioning. We then propose DeepChoir, a melody choralization system, which can generate a four-part chorale for a given melody conditioned on a chord progression. Furthermore, with the improved density sampling, a user can control the extent of harmonicity and polyphonicity for the chorale generated by DeepChoir. Experimental results reveal the effectiveness of our data representation and the controllability of DeepChoir over harmonicity and polyphonicity. The code and generated samples (chorales, folk songs and a symphony) of DeepChoir, and the dataset we use now are available at https://github.com/sander-wood/deepchoir.

Related papers

• MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation [39.892059799407434]
  MelodyGLM is a multi-task pre-training framework for generating melodies with long-term structure. We have constructed a large-scale symbolic melody dataset, MelodyNet, containing more than 0.4 million melody pieces.
  arXiv  Detail & Related papers  (2023-09-19T16:34:24Z)
• Choir Transformer: Generating Polyphonic Music with Relative Attention on Transformer [4.866650264773479]
  We propose a polyphonic music generation neural network named Choir Transformer. The performance of Choir Transformer surpasses the previous state-of-the-art accuracy of 4.06%. In practical application, the generated melody and rhythm can be adjusted according to the specified input.
  arXiv  Detail & Related papers  (2023-08-01T06:44:15Z)
• Unsupervised Melody-to-Lyric Generation [91.29447272400826]
  We propose a method for generating high-quality lyrics without training on any aligned melody-lyric data. We leverage the segmentation and rhythm alignment between melody and lyrics to compile the given melody into decoding constraints. Our model can generate high-quality lyrics that are more on-topic, singable, intelligible, and coherent than strong baselines.
  arXiv  Detail & Related papers  (2023-05-30T17:20:25Z)
• Melody transcription via generative pre-training [86.08508957229348]
  Key challenge in melody transcription is building methods which can handle broad audio containing any number of instrument ensembles and musical styles. To confront this challenge, we leverage representations from Jukebox (Dhariwal et al. 2020), a generative model of broad music audio. We derive a new dataset containing $50$ hours of melody transcriptions from crowdsourced annotations of broad music.
  arXiv  Detail & Related papers  (2022-12-04T18:09:23Z)
• Symphony Generation with Permutation Invariant Language Model [57.75739773758614]
  We present a symbolic symphony music generation solution, SymphonyNet, based on a permutation invariant language model. A novel transformer decoder architecture is introduced as backbone for modeling extra-long sequences of symphony tokens. Our empirical results show that our proposed approach can generate coherent, novel, complex and harmonious symphony compared to human composition.
  arXiv  Detail & Related papers  (2022-05-10T13:08:49Z)
• A-Muze-Net: Music Generation by Composing the Harmony based on the Generated Melody [91.22679787578438]
  We present a method for the generation of Midi files of piano music. The method models the right and left hands using two networks, where the left hand is conditioned on the right hand. The Midi is represented in a way that is invariant to the musical scale, and the melody is represented, for the purpose of conditioning the harmony.
  arXiv  Detail & Related papers  (2021-11-25T09:45:53Z)
• BacHMMachine: An Interpretable and Scalable Model for Algorithmic Harmonization for Four-part Baroque Chorales [23.64897650817862]
  BacHMMachine employs a "theory-driven" framework guided by music composition principles. It provides a probabilistic framework for learning key modulations and chordal progressions from a given melodic line. It results in vast decreases in computational burden and greater interpretability.
  arXiv  Detail & Related papers  (2021-09-15T23:39:45Z)
• Controllable deep melody generation via hierarchical music structure representation [14.891975420982511]
  MusicFrameworks is a hierarchical music structure representation and a multi-step generative process to create a full-length melody. To generate melody in each phrase, we generate rhythm and basic melody using two separate transformer-based networks. To customize or add variety, one can alter chords, basic melody, and rhythm structure in the music frameworks, letting our networks generate the melody accordingly.
  arXiv  Detail & Related papers  (2021-09-02T01:31:14Z)
• Melody-Conditioned Lyrics Generation with SeqGANs [81.2302502902865]
  We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN) We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.
  arXiv  Detail & Related papers  (2020-10-28T02:35:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.