MulTTiPop: A Multitrack Transcription Dataset for Pop Music

• URL: http://arxiv.org/abs/2607.08756v1
• Date: Thu, 09 Jul 2026 17:55:33 GMT
• Title: MulTTiPop: A Multitrack Transcription Dataset for Pop Music
• Abstract summary: We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings.<n>MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio.<n>We evaluate state-of-the-art automatic music transcription models on MulTTiPop and find substantial room for improvement.
• Score: 49.06419020509759
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio, and contains songs from diverse genres and decades from the 1930s to 2000s. To collect this dataset, we perform metadata-based matching on song segments from the Lakh MIDI and TheoryTab datasets, manually identify an anchor beat between the audio and MIDI, then use beat tracking on the audio and warp the MIDI to match its tempo and timing. We evaluate state-of-the-art automatic music transcription models on MulTTiPop and find substantial room for improvement, with the best model achieving 38% Onset F1. More details and sound examples of MulTTiPop are available at https://gclef-cmu.org/multtipop.

Related papers

• Barwise Section Boundary Detection in Symbolic Music Using Convolutional Neural Networks [0.0]
  We introduce a human-annotated MIDI dataset for section boundary detection.<n>Second, we train a deep learning model to classify the presence of section boundaries within a fixed-length musical window.<n>Our model achieves an F1 score of 0.77, improving over the analogous audio-based supervised learning approach.
  arXiv  Detail & Related papers  (2025-09-20T07:52:08Z)
• PianoVAM: A Multimodal Piano Performance Dataset [56.318475235705954]
  PianoVAM is a comprehensive piano performance dataset that includes videos, audio, MIDI, hand landmarks, fingering labels, and rich metadata.<n>The dataset was recorded using a Disklavier piano, capturing audio and MIDI from amateur pianists during their daily practice sessions.<n>Hand landmarks and fingering labels were extracted using a pretrained hand pose estimation model and a semi-automated fingering annotation algorithm.
  arXiv  Detail & Related papers  (2025-09-10T17:35:58Z)
• Aria-MIDI: A Dataset of Piano MIDI Files for Symbolic Music Modeling [1.3812010983144802]
  We introduce an extensive new dataset of MIDI files, created by transcribing audio recordings of piano performances into their constituent notes.<n>The data pipeline we use is multi-stage, employing a language model to autonomously crawl and score audio recordings from the internet.<n>The resulting dataset contains over one million distinct MIDI files, comprising roughly 100,000 hours of transcribed audio.
  arXiv  Detail & Related papers  (2025-04-21T12:59:40Z)
• The GigaMIDI Dataset with Features for Expressive Music Performance Detection [5.585625844344932]
  The GigaMIDI dataset contains over 1.4 million unique MIDI files, encompassing 1.8 billion MIDI note events and over 5.3 million MIDI tracks.<n>This curated iteration of GigaMIDI encompasses expressively-performed instrument tracks detected by NOMML, constituting 31% of the GigaMIDI dataset.
  arXiv  Detail & Related papers  (2025-02-24T23:39:40Z)
• PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text [8.382511298208003]
  PIAST (PIano dataset with Audio, Symbolic, and Text) is a piano music dataset. We collected 9,673 tracks from YouTube and added human annotations for 2,023 tracks by music experts. Both include audio, text, tag annotations, and transcribed MIDI utilizing state-of-the-art piano transcription and beat tracking models.
  arXiv  Detail & Related papers  (2024-11-04T19:34:13Z)
• Accompanied Singing Voice Synthesis with Fully Text-controlled Melody [61.147446955297625]
  Text-to-song (TTSong) is a music generation task that synthesizes accompanied singing voices. We present MelodyLM, the first TTSong model that generates high-quality song pieces with fully text-controlled melodies.
  arXiv  Detail & Related papers  (2024-07-02T08:23:38Z)
• MidiCaps: A large-scale MIDI dataset with text captions [6.806050368211496]
  This work aims to enable research that combines LLMs with symbolic music by presenting, the first openly available large-scale MIDI dataset with text captions. Inspired by recent advancements in captioning techniques, we present a curated dataset of over 168k MIDI files with textual descriptions.
  arXiv  Detail & Related papers  (2024-06-04T12:21:55Z)
• Melody transcription via generative pre-training [86.08508957229348]
  Key challenge in melody transcription is building methods which can handle broad audio containing any number of instrument ensembles and musical styles. To confront this challenge, we leverage representations from Jukebox (Dhariwal et al. 2020), a generative model of broad music audio. We derive a new dataset containing $50$ hours of melody transcriptions from crowdsourced annotations of broad music.
  arXiv  Detail & Related papers  (2022-12-04T18:09:23Z)
• PopMAG: Pop Music Accompaniment Generation [190.09996798215738]
  We propose a novel MUlti-track MIDI representation (MuMIDI) which enables simultaneous multi-track generation in a single sequence. MuMIDI enlarges the sequence length and brings the new challenge of long-term music modeling. We call our system for pop music accompaniment generation as PopMAG.
  arXiv  Detail & Related papers  (2020-08-18T02:28:36Z)
• Foley Music: Learning to Generate Music from Videos [115.41099127291216]
  Foley Music is a system that can synthesize plausible music for a silent video clip about people playing musical instruments. We first identify two key intermediate representations for a successful video to music generator: body keypoints from videos and MIDI events from audio recordings. We present a Graph$-$Transformer framework that can accurately predict MIDI event sequences in accordance with the body movements.
  arXiv  Detail & Related papers  (2020-07-21T17:59:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.