Music Source Restoration with Ensemble Separation and Targeted Reconstruction

• URL: http://arxiv.org/abs/2603.16926v1
• Date: Fri, 13 Mar 2026 07:40:42 GMT
• Title: Music Source Restoration with Ensemble Separation and Targeted Reconstruction
• Abstract summary: The Inaugural Music Source Restoration (MSR) Challenge targets the recovery of original, unprocessed stems from fully mixed and mastered music.<n>To address MSR, we propose a two-stage system. First, an ensemble of pre-trained separation models produces preliminary source estimates.<n>Then a set of pre-trained BSRNN-based restoration models performs targeted reconstruction to refine these estimates.
• Score: 6.528712884168779
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The Inaugural Music Source Restoration (MSR) Challenge targets the recovery of original, unprocessed stems from fully mixed and mastered music. Unlike conventional music source separation, MSR requires reversing complex production processes such as equalization, compression, reverberation, and other real-world degradations. To address MSR, we propose a two-stage system. First, an ensemble of pre-trained separation models produces preliminary source estimates. Then a set of pre-trained BSRNN-based restoration models performs targeted reconstruction to refine these estimates. On the official MSR benchmark, our system surpasses the baselines on all metrics, ranking second among all submissions. The code is available at https://github.com/xinghour/Music-source-restoration-CUPAudioGroup

Related papers

• DTT-BSR+: A Generative-Regression Cascade for Music Source Restoration [13.053766595316224]
  DTT-BSR+ is a two-stage cascade MSR system that decouples distribution fitting from signal reconstruction into separate stages.<n>A generative DTT-BSR separator in the first stage produces stems matching the prior of clean sources.<n>A modified Demucs network in the second stage enhances the first stage output using time-domain and multi-resolution spectral losses.
  arXiv  Detail & Related papers  (2026-06-23T04:22:20Z)
• Next-Acceleration-Scale Prediction for Autoregressive MRI Reconstruction [52.32112533846212]
  MRI reconstruction is an inherently ill-posed inverse problem, since incomplete measurements admit many plausible solutions.<n>We address this limitation by moving reconstruction to discrete multi-scale latent space and posing it as autoregressive next-acceleration-scale prediction.<n>We show that our approach delivers improved reconstruction performance across diverse sampling patterns under extreme undersampling.
  arXiv  Detail & Related papers  (2026-05-19T04:40:50Z)
• Multi-Stage Music Source Restoration with BandSplit-RoFormer Separation and HiFi++ GAN [8.647179779228761]
  Music Source Restoration (MSR) targets recovery of original, unprocessed instrument stems from fully mixed and mastered audio.<n>This technical report presents the CP-JKU team's system for the MSR ICASSP Challenge 2025.
  arXiv  Detail & Related papers  (2026-03-04T13:10:39Z)
• Summary of The Inaugural Music Source Restoration Challenge [52.405241781545634]
  Music Source Restoration (MSR) aims to recover original, unprocessed instrument stems from professionally mixed audio.<n>MSR Challenge features objective evaluation on studio-produced mixtures using Multi-Mel-SNR, Zimtohrli, and FAD-CLAP.<n>Winning system achieved 4.46 dB Multi-Mel-SNR and 3.47 MOS-Overall, corresponding to relative improvements of 91% and 18% over the second-place system, respectively.
  arXiv  Detail & Related papers  (2026-01-07T19:31:06Z)
• MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration [62.929029990341796]
  Real-world videos often suffer from complex degradations, such as noise, compression artifacts, and low-light distortions.<n>We propose MoA-VR, which mimics the reasoning and processing procedures of human professionals through three coordinated agents.<n>Specifically, we construct a large-scale and high-resolution video degradation recognition benchmark and build a vision-language model (VLM) driven degradation identifier.
  arXiv  Detail & Related papers  (2025-10-09T17:42:51Z)
• Music Source Restoration [20.814486236405823]
  We introduce Music Source Restoration (MSR), a novel task addressing the gap between idealized source separation and real-world music production.<n>MSR models mixtures as degraded sums of individually degraded sources, with the goal of recovering original, undegraded signals.<n>Due to the lack of data for MSR, we present RawStems, a dataset annotation of 578 songs with unprocessed source signals organized into 8 primary and 17 secondary instrument groups, totaling 354.13 hours.
  arXiv  Detail & Related papers  (2025-05-27T23:27:31Z)
• Unleashing the Power of Natural Audio Featuring Multiple Sound Sources [54.38251699625379]
  Universal sound separation aims to extract clean audio tracks corresponding to distinct events from mixed audio.<n>We propose ClearSep, a framework that employs a data engine to decompose complex naturally mixed audio into multiple independent tracks.<n>In experiments, ClearSep achieves state-of-the-art performance across multiple sound separation tasks.
  arXiv  Detail & Related papers  (2025-04-24T17:58:21Z)
• Separate This, and All of these Things Around It: Music Source Separation via Hyperellipsoidal Queries [53.30852012059025]
  Music source separation is an audio-to-audio retrieval task.<n>Recent work in music source separation has begun to challenge the fixed-stem paradigm.<n>We propose the use of hyperellipsoidal regions as queries to allow for an intuitive yet easily parametrizable approach to specifying both the target (location) and its spread.
  arXiv  Detail & Related papers  (2025-01-27T16:13:50Z)
• DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior [70.46245698746874]
  We present DiffBIR, a general restoration pipeline that could handle different blind image restoration tasks. DiffBIR decouples blind image restoration problem into two stages: 1) degradation removal: removing image-independent content; 2) information regeneration: generating the lost image content. In the first stage, we use restoration modules to remove degradations and obtain high-fidelity restored results. For the second stage, we propose IRControlNet that leverages the generative ability of latent diffusion models to generate realistic details.
  arXiv  Detail & Related papers  (2023-08-29T07:11:52Z)
• Benchmarks and leaderboards for sound demixing tasks [44.99833362998488]
  We introduce two new benchmarks for the sound source separation tasks. We compare popular models for sound demixing, as well as their ensembles, on these benchmarks. We also develop a novel approach for audio separation, based on the ensembling of different models that are suited best for the particular stem.
  arXiv  Detail & Related papers  (2023-05-12T14:00:26Z)
• Blind Restoration of Real-World Audio by 1D Operational GANs [18.462912387382346]
  We propose a novel approach for blind restoration of real-world audio signals by Operational Generative Adversarial Networks (Op-GANs) The proposed approach has been evaluated extensively over the benchmark TIMIT-RAR (speech) and GTZAN-RAR (non-speech) datasets. Average SDR improvements of over 7.2 dB and 4.9 dB are achieved, respectively, which are substantial when compared with the baseline methods.
  arXiv  Detail & Related papers  (2022-12-30T10:11:57Z)
• Music Separation Enhancement with Generative Modeling [11.545349346125743]
  We propose a post-processing model (the Make it Sound Good) to enhance the output of music source separation systems. Crowdsourced subjective evaluations demonstrate that human listeners prefer source estimates of bass and drums that have been post-processed by MSG.
  arXiv  Detail & Related papers  (2022-08-26T00:44:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.