Full-Page Optical Music Recognition of Handwritten Monophonic Scores

• URL: http://arxiv.org/abs/2609.05662v1
• Date: Fri, 04 Sep 2026 18:56:03 GMT
• Title: Full-Page Optical Music Recognition of Handwritten Monophonic Scores
• Abstract summary: Full-page end-to-end Optical Music Recognition seeks to transcribe entire music pages directly into symbolic notation.<n>Recent Transformer-based architectures have achieved strong performance on typeset scores, relying on large-scale synthetic data for pretraining.<n>We introduce a generator capable of producing visually coherent full-page scores in both typeset and handwritten styles.
• Score: 9.83963562042336
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Full-page end-to-end Optical Music Recognition seeks to transcribe entire music pages directly into symbolic notation, avoiding the limitations of traditional pipelines that rely on accurate staff segmentation. Recent Transformer-based architectures have achieved strong performance on typeset scores, relying on large-scale synthetic data for pretraining. However, their applicability to handwritten music remains largely unexplored. In this work, we study full-page transcription on handwritten monophonic collections and analyze the impact of synthetic pretraining in this setting. To investigate which factors are most relevant during pretraining, we introduce a generator capable of producing visually coherent full-page scores in both typeset and handwritten styles. Experiments on three real handwritten datasets provide a comparative evaluation of several full-page pipelines and different synthetic pretraining strategies. The results suggest that the benefits of synthetic pretraining are primarily associated with learning structural layout conventions rather than with visual similarity to the target handwriting.

Related papers

• MuScriptor: An Open Model for Multi-Instrument Music Transcription [49.08645057428182]
  We analyze the effectiveness of synthetic data for pre-training while combining it with fine-tuning on real music audio and post-training using reinforcement learning.<n>We release MuScriptor, an open-weight multi-instrument music transcription model that works on real-world music recordings from across a diverse range of musical genres.
  arXiv  Detail & Related papers  (2026-07-09T07:12:30Z)
• Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies [60.84720484975815]
  Handwritten Text Recognition (HTR) models often struggle to generalize to real text.<n>We tackle the fully zero-shot synthetic-to-real generalization setting.<n>Our approach learns how model parameters change when moving from synthetic to real handwriting in one or more source languages.
  arXiv  Detail & Related papers  (2026-04-08T07:33:31Z)
• Synthetic bootstrapped pretraining [52.92577542049469]
  We introduce Synthetic Bootstrapped Pretraining (SBP), a language model (LM) pretraining procedure.<n>SBP first learns a model of relations between documents from the pretraining dataset and then leverages it to synthesize a vast new corpus for joint training.<n>We find SBP consistently improves upon a strong repetition baseline and delivers a significant fraction of performance improvement attainable by an oracle upper bound.
  arXiv  Detail & Related papers  (2025-09-17T22:28:27Z)
• Towards an AI Musician: Synthesizing Sheet Music Problems for Musical Reasoning [69.78158549955384]
  We introduce a novel approach that treats core music theory rules, such as those governing beats and intervals, as programmatic functions.<n>This approach generates verifiable sheet music questions in both textual and visual modalities.<n> Evaluation results on SSMR-Bench highlight the key role reasoning plays in interpreting sheet music.
  arXiv  Detail & Related papers  (2025-09-04T09:42:17Z)
• Aligned Music Notation and Lyrics Transcription [8.411893399638046]
  This paper introduces and formalizes the Aligned Music Notation and Lyrics Transcription (AMNLT) challenge.<n>It addresses the complete transcription of vocal scores by jointly considering music symbols, lyrics, and their synchronization.<n>We evaluate different approaches to address this challenge, ranging from traditional divide-and-conquer methods that handle music and lyrics separately, to novel end-to-end solutions.
  arXiv  Detail & Related papers  (2024-12-05T14:50:11Z)
• Optical Music Recognition in Manuscripts from the Ricordi Archive [6.274767633959002]
  Ricordi archive, a prestigious collection of significant musical manuscripts from renowned opera composers such as Donizetti, Verdi and Puccini, has been digitized. We have automatically extracted samples that represent various musical elements depicted on the manuscripts, including notes, staves, clefs, erasures, and composer's annotations. We trained multiple neural network-based classifiers to differentiate between the identified music elements.
  arXiv  Detail & Related papers  (2024-08-14T09:29:11Z)
• End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding [4.604877755214193]
  Existing end-to-end piano A2S systems have been trained and evaluated with only synthetic data. We propose a sequence-to-sequence (Seq2Seq) model with a hierarchical decoder that aligns with the hierarchical structure of musical scores. We propose a two-stage training scheme, which involves pre-training the model using an expressive performance rendering system on synthetic audio, followed by fine-tuning the model using recordings of human performance.
  arXiv  Detail & Related papers  (2024-05-22T10:52:04Z)
• End-to-End Full-Page Optical Music Recognition for Pianoform Sheet Music [12.779526750915707]
  We present the first truly end-to-end approach for page-level Optical Music Recognition in complex layouts.<n>Our system, which combines convolutional layers with autoregressive Transformers, processes an entire music score page and outputs a complete transcription in a music encoding format.<n>The results demonstrate that our system not only successfully transcribes full-page music scores but also outperforms the commercial tool in both zero-shot settings and after fine-tuning with the target domain.
  arXiv  Detail & Related papers  (2024-05-20T15:21:48Z)
• StyleSpeech: Self-supervised Style Enhancing with VQ-VAE-based Pre-training for Expressive Audiobook Speech Synthesis [63.019962126807116]
  The expressive quality of synthesized speech for audiobooks is limited by generalized model architecture and unbalanced style distribution. We propose a self-supervised style enhancing method with VQ-VAE-based pre-training for expressive audiobook speech synthesis.
  arXiv  Detail & Related papers  (2023-12-19T14:13:26Z)
• Towards Context-Aware Neural Performance-Score Synchronisation [2.0305676256390934]
  Music synchronisation provides a way to navigate among multiple representations of music in a unified manner. Traditional synchronisation methods compute alignment using knowledge-driven and performance analysis approaches. This PhD furthers the development of performance-score synchronisation research by proposing data-driven, context-aware alignment approaches.
  arXiv  Detail & Related papers  (2022-05-31T16:45:25Z)
• Music Gesture for Visual Sound Separation [121.36275456396075]
  "Music Gesture" is a keypoint-based structured representation to explicitly model the body and finger movements of musicians when they perform music. We first adopt a context-aware graph network to integrate visual semantic context with body dynamics, and then apply an audio-visual fusion model to associate body movements with the corresponding audio signals.
  arXiv  Detail & Related papers  (2020-04-20T17:53:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.