Iterative Audio Separation with Mixture Consistency via MIMO Model Extension

• URL: http://arxiv.org/abs/2609.07226v1
• Date: Mon, 07 Sep 2026 08:40:12 GMT
• Title: Iterative Audio Separation with Mixture Consistency via MIMO Model Extension
• Abstract summary: This paper proposes a general framework for stable and effective iterative audio separation with mixture consistency.<n>By extending source separation models to a multi-input multi-output (MIMO) configuration, we introduce iterative prediction without compromising the architectural advantages.<n> Experimental results demonstrate significant performance improvements when applying the proposed framework to state-of-the-art separation models.
• Score: 30.695924254558093
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a general framework for stable and effective iterative audio separation with mixture consistency by extending source separation models to a multi-input multi-output (MIMO) configuration. In the field of audio separation, mixture consistency is an essential property for many applications that require accurate phase and timbral information of target sources. While iterative approaches such as diffusion models achieve perceptually superior results in speech enhancement or user-guided target source separation tasks, most existing methods focus on single-step separation with a single-input single-output (SISO) or single-input multi-output (SIMO) configuration through architectural improvements, since mixture-consistent audio separation is generally regarded as a regression problem that admits a unique solution. By extending these architectures to a MIMO configuration, we introduce iterative prediction without compromising the architectural advantages or the characteristics of mixture consistency. We conduct a comprehensive ablation study of combining the framework with discriminators and extending it to a generative model. Experimental results demonstrate significant performance improvements when applying the proposed framework to state-of-the-art separation models.

Related papers

• HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models [15.857004573762575]
  We propose a novel approach combining temporally compressed discrete tokens with dimensionality-reduced continuous residuals.<n> Experimental results show that our approach significantly improves the retention of speaker characteristics compared to discrete-only methods.
  arXiv  Detail & Related papers  (2026-06-26T00:53:49Z)
• Multimodal Distribution Matching for Vision-Language Dataset Distillation [50.411341509805936]
  Multimodal Distribution Matching is a geometry-aware framework for efficient and generalizable multimodal distillation.<n>MDM integrates complementary components at the data, model, and loss levels.<n>It yields compact synthetic sets that preserve multimodal semantics, substantially reduce distillation cost, and remain robust across architectures.
  arXiv  Detail & Related papers  (2026-05-22T10:41:58Z)
• High-Quality Sound Separation Across Diverse Categories via Visually-Guided Generative Modeling [65.02357548201188]
  We propose DAVIS, a Diffusion-based Audio-VIsual Separation framework that solves the audio-visual sound source separation task through generative learning.<n>Our framework operates by synthesizing the desired separated sound spectrograms directly from a noise distribution, conditioned concurrently on the mixed audio input and associated visual information.
  arXiv  Detail & Related papers  (2025-09-26T08:46:00Z)
• UniMRSeg: Unified Modality-Relax Segmentation via Hierarchical Self-Supervised Compensation [104.59740403500132]
  Multi-modal image segmentation faces real-world deployment challenges from incomplete/corrupted modalities degrading performance.<n>We propose a unified modality-relax segmentation network (UniMRSeg) through hierarchical self-supervised compensation (HSSC)<n>Our approach hierarchically bridges representation gaps between complete and incomplete modalities across input, feature and output levels.
  arXiv  Detail & Related papers  (2025-09-19T17:29:25Z)
• Improving Progressive Generation with Decomposable Flow Matching [50.63174319509629]
  Decomposable Flow Matching (DFM) is a simple and effective framework for the progressive generation of visual media.<n>On Imagenet-1k 512px, DFM achieves 35.2% improvements in FDD scores over the base architecture and 26.4% over the best-performing baseline.
  arXiv  Detail & Related papers  (2025-06-24T17:58:02Z)
• Training-Free Multi-Step Audio Source Separation [16.187944473839632]
  We show that pretrained one-step audio source separation models can be leveraged for multi-step separation without additional training.<n>We propose a simple yet effective inference method that iteratively applies separation by optimally blending the input mixture with the previous step's separation result.<n>Our empirical results demonstrate that our multi-step separation approach consistently outperforms one-step inference across both speech enhancement and music source separation tasks.
  arXiv  Detail & Related papers  (2025-05-26T05:40:12Z)
• Revisit Mixture Models for Multi-Agent Simulation: Experimental Study within a Unified Framework [19.558523263211942]
  In multi-agent simulation, the primary challenges include behavioral multimodality and closed-loop distributional shifts.<n>In this study, we revisit mixture models for generating multimodal agent behaviors, which can cover the mainstream methods.<n>We introduce a closed-loop sample generation approach tailored for mixture models to mitigate distributional shifts.
  arXiv  Detail & Related papers  (2025-01-28T15:26:25Z)
• Complete and separate: Conditional separation with missing target source attribute completion [27.215800308343322]
  We present an approach in which a model, given an input mixture and partial semantic information about a target source, is trained to extract additional semantic data. We then leverage this pre-trained model to improve the separation performance of an uncoupled multi-conditional separation network.
  arXiv  Detail & Related papers  (2023-07-27T03:53:53Z)
• Hierarchical Integration Diffusion Model for Realistic Image Deblurring [71.76410266003917]
  Diffusion models (DMs) have been introduced in image deblurring and exhibited promising performance. We propose the Hierarchical Integration Diffusion Model (HI-Diff), for realistic image deblurring. Experiments on synthetic and real-world blur datasets demonstrate that our HI-Diff outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-22T12:18:20Z)
• Exploiting Temporal Structures of Cyclostationary Signals for Data-Driven Single-Channel Source Separation [98.95383921866096]
  We study the problem of single-channel source separation (SCSS) We focus on cyclostationary signals, which are particularly suitable in a variety of application domains. We propose a deep learning approach using a U-Net architecture, which is competitive with the minimum MSE estimator.
  arXiv  Detail & Related papers  (2022-08-22T14:04:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.