Incorporating Structure and Chord Constraints in Symbolic Transformer-based Melodic Harmonization

• URL: http://arxiv.org/abs/2512.07627v1
• Date: Mon, 08 Dec 2025 15:16:33 GMT
• Title: Incorporating Structure and Chord Constraints in Symbolic Transformer-based Melodic Harmonization
• Abstract summary: This paper studies the inclusion of predefined chord constraints in melodic, i.e., where a desired chord at a specific location is provided along with the melody as inputs.<n>The peculiarities of involving such constraints is discussed and an algorithm is proposed for tackling this task.<n>The algorithm is called B* and it combines aspects of beam search and A* along with backtracking to force pretrained transformers to satisfy the chord constraints.
• Score: 2.087792589220897
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Transformer architectures offer significant advantages regarding the generation of symbolic music; their capabilities for incorporating user preferences toward what they generate is being studied under many aspects. This paper studies the inclusion of predefined chord constraints in melodic harmonization, i.e., where a desired chord at a specific location is provided along with the melody as inputs and the autoregressive transformer model needs to incorporate the chord in the harmonization that it generates. The peculiarities of involving such constraints is discussed and an algorithm is proposed for tackling this task. This algorithm is called B* and it combines aspects of beam search and A* along with backtracking to force pretrained transformers to satisfy the chord constraints, at the correct onset position within the correct bar. The algorithm is brute-force and has exponential complexity in the worst case; however, this paper is a first attempt to highlight the difficulties of the problem and proposes an algorithm that offers many possibilities for improvements since it accommodates the involvement of heuristics.

Related papers

• UOT-IR: Structured Routing of High-Polyphony Symbolic Music into Fixed-Budget Representations [26.793789931591746]
  This study reformulates the compression problem as a fixed-budget structured routing problem.<n>It proposes Unbalanced Optimal Transport for Information Routing (UOT-IR), a training-free framework based on constrained unbalanced optimal transport.<n>Experiments on the SymphonyNet corpus show that UOT-IR delivers strong overall performance across both settings.
  arXiv  Detail & Related papers  (2026-08-01T10:29:31Z)
• Gaussian Match-and-Copy: A Minimalist Benchmark for Studying Transformer Induction [44.83333974000826]
  We introduce a minimalist benchmark that isolates long-range retrieval through pure second-order correlation signals.<n> Numerical investigations show that this task retains key qualitative aspects of how Transformers develop match-and-copy circuits.<n>We prove this max-margin alignment for GD trajectories that reach vanishing empirical loss under explicit technical conditions.
  arXiv  Detail & Related papers  (2026-02-07T14:18:11Z)
• Weights to Code: Extracting Interpretable Algorithms from the Discrete Transformer [65.38883376379812]
  We propose the Discrete Transformer, an architecture engineered to bridge the gap between continuous representations and discrete symbolic logic.<n> Empirically, the Discrete Transformer not only achieves performance comparable to RNN-based baselines but crucially extends interpretability to continuous variable domains.
  arXiv  Detail & Related papers  (2026-01-09T12:49:41Z)
• In-Context Algorithm Emulation in Fixed-Weight Transformers [13.585357287532588]
  A minimal Transformer with frozen weights emulates a broad class of algorithms by in-context prompting.<n>A single fixed-weight two-layer softmax attention module emulates all algorithms from the task-specific class via only prompting.
  arXiv  Detail & Related papers  (2025-08-24T23:20:31Z)
• ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognition [1.2187048691454239]
  Chord recognition serves as a critical task in music information retrieval due to the descriptive nature of chords in music analysis.<n>This work proposes ChordFormer, a novel conformer-based architecture designed to tackle structural chord recognition (e.g., triads, bass, sevenths) for large vocabularies.<n> ChordFormer outperforms state-of-the-art models, achieving a 2% improvement in frame-wise accuracy and a 6% increase in class-wise accuracy on large-vocabulary chord datasets.
  arXiv  Detail & Related papers  (2025-02-17T14:35:16Z)
• Music102: An $D_{12}$-equivariant transformer for chord progression accompaniment [0.0]
  Music102 is an advanced model aimed at enhancing chord progression accompaniment through a $D_12$-equivariant transformer.<n>Inspired by group theory and symbolic music structures, Music102 leverages musical symmetry--such as transposition and reflection operations--integrating these properties into the transformer architecture.
  arXiv  Detail & Related papers  (2024-10-23T03:11:01Z)
• An End-to-End Approach for Chord-Conditioned Song Generation [14.951089833579063]
  Song Generation task aims to synthesize music composed of vocals and accompaniment from given lyrics. To mitigate the issue, we introduce an important concept from music composition, namely chords to song generation networks. We propose a novel model termed Chord-Conditioned Song Generator (CSG) based on it.
  arXiv  Detail & Related papers  (2024-09-10T08:07:43Z)
• Unifying Symbolic Music Arrangement: Track-Aware Reconstruction and Structured Tokenization [19.27890803128116]
  We present a unified framework for automatic multitrack music arrangement.<n>At its core is a segment-level reconstruction objective operating on token-level disentangled content and style.<n>To support track-wise modeling, we introduce REMI-z, a structured tokenization scheme for multitrack symbolic music.
  arXiv  Detail & Related papers  (2024-08-27T16:18:51Z)
• GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding [52.14832976759585]
  Grammatical error correction (GEC) is an important NLP task that is usually solved with autoregressive sequence-to-sequence models. We propose a novel non-autoregressive approach to GEC that decouples the architecture into a permutation network. We show that the resulting network improves over previously known non-autoregressive methods for GEC.
  arXiv  Detail & Related papers  (2023-11-14T14:24:36Z)
• Variational Quantum Harmonizer: Generating Chord Progressions and Other Sonification Methods with the VQE Algorithm [0.1675245825272646]
  This work investigates using physical-based sonification of Quadratic Unconstrained Binary Optimization (QUBO) problems, optimized by the Variational Quantum Eigensolver (VQE) algorithm. The VQE approximates the solution of the problem by using an iterative loop between the quantum computer and a classical optimization routine. The implementation was realised in the form of a musical interface prototype named Variational Quantum Harmonizer (VQH)
  arXiv  Detail & Related papers  (2023-09-21T16:58:35Z)
• Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editability [76.6724135757723]
  GAN inversion aims to invert an input image into the latent space of a pre-trained GAN. Despite the recent advances in GAN inversion, there remain challenges to mitigate the tradeoff between distortion and editability. We propose a two-step approach that first inverts the input image into a latent code, called pivot code, and then alters the generator so that the input image can be accurately mapped into the pivot code.
  arXiv  Detail & Related papers  (2022-07-19T16:10:16Z)
• Symphony Generation with Permutation Invariant Language Model [57.75739773758614]
  We present a symbolic symphony music generation solution, SymphonyNet, based on a permutation invariant language model. A novel transformer decoder architecture is introduced as backbone for modeling extra-long sequences of symphony tokens. Our empirical results show that our proposed approach can generate coherent, novel, complex and harmonious symphony compared to human composition.
  arXiv  Detail & Related papers  (2022-05-10T13:08:49Z)
• Discovering Non-monotonic Autoregressive Orderings with Variational Inference [67.27561153666211]
  We develop an unsupervised parallelizable learner that discovers high-quality generation orders purely from training data. We implement the encoder as a Transformer with non-causal attention that outputs permutations in one forward pass. Empirical results in language modeling tasks demonstrate that our method is context-aware and discovers orderings that are competitive with or even better than fixed orders.
  arXiv  Detail & Related papers  (2021-10-27T16:08:09Z)
• A framework to compare music generative models using automatic evaluation metrics extended to rhythm [69.2737664640826]
  This paper takes the framework proposed in a previous research that did not consider rhythm to make a series of design decisions, then, rhythm support is added to evaluate the performance of two RNN memory cells in the creation of monophonic music. The model considers the handling of music transposition and the framework evaluates the quality of the generated pieces using automatic quantitative metrics based on geometry which have rhythm support added as well.
  arXiv  Detail & Related papers  (2021-01-19T15:04:46Z)
• RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning [69.20460466735852]
  This paper presents a deep reinforcement learning algorithm for online accompaniment generation. The proposed algorithm is able to respond to the human part and generate a melodic, harmonic and diverse machine part.
  arXiv  Detail & Related papers  (2020-02-08T03:53:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.