On the Human and Computer Alignment of Attribute-Based Music Matches

• URL: http://arxiv.org/abs/2609.00987v1
• Date: Tue, 01 Sep 2026 09:41:29 GMT
• Title: On the Human and Computer Alignment of Attribute-Based Music Matches
• Abstract summary: We focus on five musical attributes: melody, harmony, rhythm, voice, and timbre.<n>We design a triplet-based forced-choice task comprising 300 cases, including plagiarism examples, cover songs, and AI-generated music.<n>From this experiment, we introduce the MATCHA dataset: a collection of 1105 perceptual assessments of attribute-based music matches from 83 expert participants.
• Score: 38.92033810619237
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in generative AI are raising ethical concerns regarding the originality of generated content and the potential replication of training data, with further implications for transparency, attribution, and intellectual property. In music, several computational approaches have been proposed to identify potential replication, using audio-based similarity metrics. Yet, their alignment with human judgments across distinct musical attributes remains underexplored. To address this gap, we conduct a perceptual experiment on music matches, defined as strongly similar musical excerpts. We focus on five musical attributes: melody, harmony, rhythm, voice, and timbre. We design a triplet-based forced-choice task comprising 300 cases, including plagiarism examples, cover songs, and AI-generated music. From this experiment, we introduce the MATCHA (Musical Attribute-based Triplet Comparison with Human Annotations) dataset: a collection of 1105 perceptual assessments of attribute-based music matches from 83 expert participants. Our findings reveal measurable agreement among participants in identifying matches across attributes. We further observe partial alignment between human judgments and computational similarity measures. Overall, this work underscores the importance of domain-specific and perceptually grounded evaluation frameworks for generative AI in creative practice.

Related papers

• FIGMA: Towards FIne-Grained Music retrievAl [65.98380295254817]
  Retrieving music using natural language descriptions has improved with contrastive audio-text models such as CLAP, but current systems remain limited to coarse semantic queries.<n>We show that this limitation stems from the contrastive learning objective itself: despite being trained on long captions, CLAP-based models effectively utilize only the first few tokens.<n>We propose FIGMA, a multi-view contrastive architecture that addresses this limitation by jointly optimizing global audio-text alignment and frame-level, token-wise alignment.
  arXiv  Detail & Related papers  (2026-06-04T18:05:39Z)
• Understanding Human Perception of Music Plagiarism Through a Computational Approach [4.404667592877916]
  We focus on the three commonly used musical features in similarity analysis: melody, rhythm, and chord progression.<n>We propose a LLM-as-a-judge framework that applies a systematic, step-by-step approach.
  arXiv  Detail & Related papers  (2026-01-05T22:37:19Z)
• Perception of AI-Generated Music - The Role of Composer Identity, Personality Traits, Music Preferences, and Perceived Humanness [0.0]
  The rapid rise of AI-generated art has sparked debate about potential biases in how audiences perceive and evaluate such works.<n>This study investigates how composer information and listener characteristics shape the perception of AI-generated music.
  arXiv  Detail & Related papers  (2025-12-02T13:59:10Z)
• MuseTok: Symbolic Music Tokenization for Generation and Semantic Understanding [46.89003337712407]
  We propose MuseTok, a tokenization method for symbolic music.<n>MuseTok employs the residual vector quantized-variational autoencoder (RQ-VAE) on bar-wise music segments within a Transformer-based encoder-decoder framework.<n>For comprehensive evaluation, we apply MuseTok to music generation and semantic understanding tasks, including melody extraction, chord recognition, and emotion recognition.
  arXiv  Detail & Related papers  (2025-10-18T00:04:48Z)
• Discovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music [50.87225308217594]
  This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as music-words'' -- from symbolic music data.<n>We formulate the task of music-word discovery as a statistical optimization problem and propose a two-stage Expectation-Maximization (EM)-based learning framework.
  arXiv  Detail & Related papers  (2025-09-29T11:10:57Z)
• Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music [1.2874569408514918]
  We explore participants' perspectives on AI- vs human-generated progressive metal, using rock music as a control group. We propose a mixed methods approach to assess the effects of generation type (human vs. AI), genre (progressive metal vs. rock), and curation process (random vs. cherry-picked) Our findings validate the use of fine-tuning to achieve genre-specific specialization in AI music generation. Despite some AI-generated excerpts receiving similar ratings to human music, listeners exhibited a preference for human compositions.
  arXiv  Detail & Related papers  (2024-07-31T14:03:45Z)
• Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio [25.254669525489923]
  We present a model-independent open evaluation method based on diverse audio music similarity metrics to assess data replication. Our results show that the proposed methodology can estimate exact data replication with a proportion higher than 10%.
  arXiv  Detail & Related papers  (2024-07-19T14:52:11Z)
• Contrastive Learning with Positive-Negative Frame Mask for Music Representation [91.44187939465948]
  This paper proposes a novel Positive-nEgative frame mask for Music Representation based on the contrastive learning framework, abbreviated as PEMR. We devise a novel contrastive learning objective to accommodate both self-augmented positives/negatives sampled from the same music.
  arXiv  Detail & Related papers  (2022-03-17T07:11:42Z)
• Research on AI Composition Recognition Based on Music Rules [7.699648754969773]
  Article constructs a music-rule-identifying algorithm through extracting modes. It will identify the stability of the mode of machine-generated music to judge whether it is artificial intelligent.
  arXiv  Detail & Related papers  (2020-10-15T14:51:24Z)
• Multi-Modal Music Information Retrieval: Augmenting Audio-Analysis with Visual Computing for Improved Music Video Analysis [91.3755431537592]
  This thesis combines audio-analysis with computer vision to approach Music Information Retrieval (MIR) tasks from a multi-modal perspective. The main hypothesis of this work is based on the observation that certain expressive categories such as genre or theme can be recognized on the basis of the visual content alone. The experiments are conducted for three MIR tasks Artist Identification, Music Genre Classification and Cross-Genre Classification.
  arXiv  Detail & Related papers  (2020-02-01T17:57:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.