ScorePrompts: Natural-Language Exploration of Symbolic Music Scores through Analysis

• URL: http://arxiv.org/abs/2609.13291v1
• Date: Wed, 09 Sep 2026 11:13:48 GMT
• Title: ScorePrompts: Natural-Language Exploration of Symbolic Music Scores through Analysis
• Abstract summary: interactive system in which users upload a score, receive natural-language descriptions of its musical structure.<n>MIR components first estimate harmony, tonality, cadences, formal boundaries, texture, and note-level roles.<n>For questions such as "What changes in measures 14-18?", a deterministic router selects the relevant measures and analytical levels.<n>Verovio renders the score and links the returned information to cited measures and note-level attributes.
• Score: 10.043889764557965
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present ScorePrompts, an interactive system in which users upload a score, receive natural-language descriptions of its musical structure, ask questions about specific passages, and inspect the corresponding analysis results in staff notation. Specialist MIR components first estimate harmony, tonality, cadences, formal boundaries, texture, and note-level roles, organizing their outputs at note, beat, measure, and piece levels. A schema-constrained language model converts these results into descriptions rather than inferring musical structure directly from raw MusicXML. For questions such as "What changes in measures 14-18?", a deterministic router selects the relevant measures and analytical levels and returns a concise response together with the underlying results and caveats. Verovio renders the score and links the returned information to cited measures and note-level attributes. The interface also exposes intermediate tables and disagreements between analytical levels. ScorePrompts is intended for exploratory score analysis and explanation, not score editing. The demo shows how existing analysis models, constrained language generation, Q&A retrieval, and notation-based visualization can provide natural-language access to symbolic music analysis while keeping intermediate results inspectable.

Related papers

• INSPIRE: A Benchmark for Instruction-Aware Speech Retrieval [53.79335341504602]
  INSPIRE is the first benchmark for instruction-aware speech retrieval.<n>We evaluate four retrieval paradigms: large audio-language models, cascaded pipelines, self-supervised speech models, and contrastive audio-language models.
  arXiv  Detail & Related papers  (2026-08-17T07:35:18Z)
• Integrating Contextual Embeddings into Evaluation of Expressive MIDI Piano Performances [0.00746020873338928]
  In generative applications, the wide variety of expressive attributes makes it difficult to aggregate them into a single metric for model selection.<n>In this work, we reexamine attribute-scoped metrics and explore the perceptual properties of contextual embeddings from self-supervised symbolic music models, Aria and CLaMP3.<n>Unlike Pearson correlation and reconstruction error, kernel-based methods on contextual embeddings do not require note alignment and are sensitive to contextual perturbations.
  arXiv  Detail & Related papers  (2026-07-30T09:22:54Z)
• FIGMA: Towards FIne-Grained Music retrievAl [65.98380295254817]
  Retrieving music using natural language descriptions has improved with contrastive audio-text models such as CLAP, but current systems remain limited to coarse semantic queries.<n>We show that this limitation stems from the contrastive learning objective itself: despite being trained on long captions, CLAP-based models effectively utilize only the first few tokens.<n>We propose FIGMA, a multi-view contrastive architecture that addresses this limitation by jointly optimizing global audio-text alignment and frame-level, token-wise alignment.
  arXiv  Detail & Related papers  (2026-06-04T18:05:39Z)
• Direct content-based retrieval from music scores images [8.910548576237087]
  This work contributes to the field by first studying which characteristics of a score are most relevant for search and by defining a systematic method to build query datasets from any annotated corpus.<n>We also consider diverse methods for content-based search on music score images, ranging from transcription-based approaches relying on Optical Music Recognition (OMR), to a transcription-free Transformer model trained to recognize queries directly from score images, and a text-prompted Large Language Model.
  arXiv  Detail & Related papers  (2026-05-21T09:59:59Z)
• ADAG: Automatically Describing Attribution Graphs [50.460651620833055]
  We introduce textbfADAG, an end-to-end pipeline for describing these attribution graphs which is fully automated.<n>We then introduce a novel clustering algorithm for grouping features, and an LLM explainer--simulator setup which generates and scores natural-language explanations of the functional role of these feature groups.<n>We run our system on known human-analysed circuit-tracing tasks and recover interpretable circuits, and further show ADAG can find steerable clusters which are responsible for a harmful advice jailbreak in Llama 3.1 8B Instruct.
  arXiv  Detail & Related papers  (2026-04-08T21:34:37Z)
• Three Stage Narrative Analysis; Plot-Sentiment Breakdown, Structure Learning and Concept Detection [0.0]
  We propose a framework that analyzes the sentiment arcs of movie scripts and performs extended analysis related to the context of the characters involved.<n>Using dictionary-based sentiment analysis, our approach applies a custom lexicon built with the LabMTsimple storylab module.<n>The framework advances the analysis by clustering similar sentiment plots using Wards hierarchical clustering technique.
  arXiv  Detail & Related papers  (2025-11-14T20:30:18Z)
• Factual and Musical Evaluation Metrics for Music Language Models [5.124350492915739]
  Music language models (Music LMs) leverage multimodal representations to answer natural language queries about musical audio recordings.<n>Although Music LMs are reportedly improving, we find that current evaluations fail to capture whether their answers are correct.<n>We propose (1) a better general-purpose evaluation metric for Music LMs adapted to the music domain and (2) a factual evaluation framework to quantify the correctness of a Music LM's responses.
  arXiv  Detail & Related papers  (2025-11-02T18:08:26Z)
• Discovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music [50.87225308217594]
  This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as music-words'' -- from symbolic music data.<n>We formulate the task of music-word discovery as a statistical optimization problem and propose a two-stage Expectation-Maximization (EM)-based learning framework.
  arXiv  Detail & Related papers  (2025-09-29T11:10:57Z)
• Towards an AI Musician: Synthesizing Sheet Music Problems for Musical Reasoning [69.78158549955384]
  We introduce a novel approach that treats core music theory rules, such as those governing beats and intervals, as programmatic functions.<n>This approach generates verifiable sheet music questions in both textual and visual modalities.<n> Evaluation results on SSMR-Bench highlight the key role reasoning plays in interpreting sheet music.
  arXiv  Detail & Related papers  (2025-09-04T09:42:17Z)
• Towards Explainable and Interpretable Musical Difficulty Estimation: A Parameter-efficient Approach [49.2787113554916]
  Estimating music piece difficulty is important for organizing educational music collections. Our work employs explainable descriptors for difficulty estimation in symbolic music representations. Our approach, evaluated in piano repertoire categorized in 9 classes, achieved 41.4% accuracy independently, with a mean squared error (MSE) of 1.7.
  arXiv  Detail & Related papers  (2024-08-01T11:23:42Z)
• A Phoneme-Informed Neural Network Model for Note-Level Singing Transcription [11.951441023641975]
  We propose a method of finding note onsets of singing voice more accurately by leveraging the linguistic characteristics of singing. Our approach substantially improves the performance of singing transcription and emphasizes the importance of linguistic features in singing analysis.
  arXiv  Detail & Related papers  (2023-04-12T15:36:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.