MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks

• URL: http://arxiv.org/abs/2208.14345v1
• Date: Tue, 30 Aug 2022 15:44:15 GMT
• Title: MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks
• Authors: Peiling Lu, Xu Tan, Botao Yu, Tao Qin, Sheng Zhao, Tie-Yan Liu
• Abstract summary: MeloForm is a system that generates melody with musical form using expert systems and neural networks. It can support various kinds of forms, such as verse and chorus form, rondo form, variational form, sonata form, etc.
• Score: 146.59245563763065
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Human usually composes music by organizing elements according to the musical form to express music ideas. However, for neural network-based music generation, it is difficult to do so due to the lack of labelled data on musical form. In this paper, we develop MeloForm, a system that generates melody with musical form using expert systems and neural networks. Specifically, 1) we design an expert system to generate a melody by developing musical elements from motifs to phrases then to sections with repetitions and variations according to pre-given musical form; 2) considering the generated melody is lack of musical richness, we design a Transformer based refinement model to improve the melody without changing its musical form. MeloForm enjoys the advantages of precise musical form control by expert systems and musical richness learning via neural models. Both subjective and objective experimental evaluations demonstrate that MeloForm generates melodies with precise musical form control with 97.79% accuracy, and outperforms baseline systems in terms of subjective evaluation score by 0.75, 0.50, 0.86 and 0.89 in structure, thematic, richness and overall quality, without any labelled musical form data. Besides, MeloForm can support various kinds of forms, such as verse and chorus form, rondo form, variational form, sonata form, etc.

Related papers

• Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representation [16.790582113573453]
  Emotion-driven melody aims to generate diverse harmonies for a single melody to convey desired emotions. Previous research found it hard to alter the perceived emotional valence of lead sheets only by harmonizing the same melody with different chords. In this paper, we propose a novel functional representation for symbolic music.
  arXiv  Detail & Related papers  (2024-07-29T17:05:12Z)
• MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation [39.892059799407434]
  MelodyGLM is a multi-task pre-training framework for generating melodies with long-term structure. We have constructed a large-scale symbolic melody dataset, MelodyNet, containing more than 0.4 million melody pieces.
  arXiv  Detail & Related papers  (2023-09-19T16:34:24Z)
• Re-creation of Creations: A New Paradigm for Lyric-to-Melody Generation [158.54649047794794]
  Re-creation of Creations (ROC) is a new paradigm for lyric-to-melody generation. ROC achieves good lyric-melody feature alignment in lyric-to-melody generation.
  arXiv  Detail & Related papers  (2022-08-11T08:44:47Z)
• A-Muze-Net: Music Generation by Composing the Harmony based on the Generated Melody [91.22679787578438]
  We present a method for the generation of Midi files of piano music. The method models the right and left hands using two networks, where the left hand is conditioned on the right hand. The Midi is represented in a way that is invariant to the musical scale, and the melody is represented, for the purpose of conditioning the harmony.
  arXiv  Detail & Related papers  (2021-11-25T09:45:53Z)
• TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method [92.36505210982648]
  TeleMelody is a two-stage lyric-to-melody generation system with music template. It generates melodies with higher quality, better controllability, and less requirement on paired lyric-melody data.
  arXiv  Detail & Related papers  (2021-09-20T15:19:33Z)
• Controllable deep melody generation via hierarchical music structure representation [14.891975420982511]
  MusicFrameworks is a hierarchical music structure representation and a multi-step generative process to create a full-length melody. To generate melody in each phrase, we generate rhythm and basic melody using two separate transformer-based networks. To customize or add variety, one can alter chords, basic melody, and rhythm structure in the music frameworks, letting our networks generate the melody accordingly.
  arXiv  Detail & Related papers  (2021-09-02T01:31:14Z)
• MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training [97.91071692716406]
  Symbolic music understanding refers to the understanding of music from the symbolic data. MusicBERT is a large-scale pre-trained model for music understanding.
  arXiv  Detail & Related papers  (2021-06-10T10:13:05Z)
• Melody-Conditioned Lyrics Generation with SeqGANs [81.2302502902865]
  We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN) We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.
  arXiv  Detail & Related papers  (2020-10-28T02:35:40Z)
• Exploring Inherent Properties of the Monophonic Melody of Songs [10.055143995729415]
  We propose a set of interpretable features on monophonic melody for computational purposes. These features are defined not only in mathematical form, but also with some considerations on composers 'intuition. These features are considered by people universally in many genres of songs, even for atonal composition practices.
  arXiv  Detail & Related papers  (2020-03-20T14:13:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.