How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixtures

• URL: http://arxiv.org/abs/2608.07285v1
• Date: Fri, 07 Aug 2026 14:46:06 GMT
• Title: How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixtures
• Abstract summary: Current AI music detection systems are binary, treating tracks as either fully AI or fully human.<n>We reformulate AI music detection as a regression problem on a continuous AI energy ratio, alpha in [0, 1].<n>We train a similar CNN-based model for regression of alpha, achieving MAE = 0.076 and R2 = 0.85 on heldout mixtures from the same pipeline.
• Score: 39.04964205178628
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: AI-generated music is increasingly used at the stem level, with producers integrating synthetic drums, basslines, or vocals alongside human-performed instruments. However, current AI music detection systems are binary, treating tracks as either fully AI or fully human. In this paper, we reformulate AI music detection as a regression problem on a continuous AI energy ratio, alpha in [0, 1]. We propose a methodology that leverages a multi-track music dataset to assemble mixtures of human-performed and AI-reconstructed stems (obtained using a neural audio codec) with known proportions of each content type. Using this approach, we first show that a CNN-based model trained on fully AI-generated or human-performed tracks, which achieves >99% accuracy as a binary detector, when faced with mixed content, yields an output that rises with the AI stems' energy contribution, acting as a noisy and miscalibrated estimator. Our analysis of the influence of different stems shows that detection sensitivity depends on the instrument and reflects its frequency content: drums and guitar carry strong codec-artifact signatures, while vocals and bass are less detectable. Based on these insights, we train a similar CNN-based model for regression of alpha, achieving MAE = 0.076 and R^2 = 0.85 on held-out mixtures from the same pipeline. These results suggest that the regression formulation is an initial promising step towards AI-music detection in realistic music production workflows.

Related papers

• Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Task [39.146761527401424]
  Real-world uploads are often remixed, re-encoded, pitch-shifted, or otherwise edited.<n> edited versions form a difficult negative class: they are not generated by AI, yet they may introduce spectral artifacts that resemble synthetic audio fingerprints.<n>We study this problem as a hard-negative setting for AI-generated music detection, focusing on AI-generated and edited variants derived from the same anchor songs.
  arXiv  Detail & Related papers  (2026-08-14T22:03:50Z)
• HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark [1.7034813545878587]
  We introduce HAIM, a dataset with diverse labels for stages of music production.<n>Our evaluation of state-of-the-art detectors reveals systemic flaws.
  arXiv  Detail & Related papers  (2026-06-01T04:51:12Z)
• From Sound to Setting: AI-Based Equalizer Parameter Prediction for Piano Tone Replication [0.0]
  This project presents an AI-based system for tone replication in music production, focusing on predicting EQ parameter settings directly from audio features.<n>Unlike traditional audio-to-audio methods, our approach outputs interpretable parameter values that musicians can further adjust in their workflow.<n>The system enables practical, flexible, and automated tone matching for music producers and lays the foundation for extensions to more complex audio effects.
  arXiv  Detail & Related papers  (2025-09-29T07:50:28Z)
• Improving AI-generated music with user-guided training [0.0]
  Image-generation algorithms can be applied to generate novel music.<n>These algorithms are typically trained on fixed datasets.<n>We propose a human-computation approach to gradually improve the performance of these algorithms based on user interactions.
  arXiv  Detail & Related papers  (2025-06-05T10:22:54Z)
• Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writing [55.2480439325792]
  This study systematically evaluations twelve state-of-the-art AI-text detectors using our AI-Polished-Text Evaluation dataset.<n>Our findings reveal that detectors frequently flag even minimally polished text as AI-generated, struggle to differentiate between degrees of AI involvement, and exhibit biases against older and smaller models.
  arXiv  Detail & Related papers  (2025-02-21T18:45:37Z)
• SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generation [75.86473375730392]
  SongGen is a fully open-source, single-stage auto-regressive transformer for controllable song generation.<n>It supports two output modes: mixed mode, which generates a mixture of vocals and accompaniment directly, and dual-track mode, which synthesizes them separately.<n>To foster community engagement and future research, we will release our model weights, training code, annotated data, and preprocessing pipeline.
  arXiv  Detail & Related papers  (2025-02-18T18:52:21Z)
• Estimating Musical Surprisal in Audio [4.056099795258358]
  Information content (IC) of one-step predictions from an autoregressive model as a proxy for surprisal in symbolic music.<n>We train an autoregressive Transformer model to predict compressed latent audio representations of a pretrained autoencoder network.<n>We investigate the IC's relation to audio and musical features and find it correlated with timbral variations and loudness and, to a lesser extent, dissonance, rhythmic complexity, and onset density related to audio and musical features.
  arXiv  Detail & Related papers  (2025-01-13T16:46:45Z)
• Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music [1.2874569408514918]
  We explore participants' perspectives on AI- vs human-generated progressive metal, using rock music as a control group. We propose a mixed methods approach to assess the effects of generation type (human vs. AI), genre (progressive metal vs. rock), and curation process (random vs. cherry-picked) Our findings validate the use of fine-tuning to achieve genre-specific specialization in AI music generation. Despite some AI-generated excerpts receiving similar ratings to human music, listeners exhibited a preference for human compositions.
  arXiv  Detail & Related papers  (2024-07-31T14:03:45Z)
• A Sanity Check for AI-generated Image Detection [49.08585395873425]
  We propose AIDE (AI-generated Image DEtector with Hybrid Features) to detect AI-generated images.<n>AIDE achieves +3.5% and +4.6% improvements to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-06-27T17:59:49Z)
• ProcTHOR: Large-Scale Embodied AI Using Procedural Generation [55.485985317538194]
  ProcTHOR is a framework for procedural generation of Embodied AI environments. We demonstrate state-of-the-art results across 6 embodied AI benchmarks for navigation, rearrangement, and arm manipulation.
  arXiv  Detail & Related papers  (2022-06-14T17:09:35Z)
• Neurosymbolic hybrid approach to driver collision warning [64.02492460600905]
  There are two main algorithmic approaches to autonomous driving systems. Deep learning alone has achieved state-of-the-art results in many areas. But sometimes it can be very difficult to debug if the deep learning model doesn't work.
  arXiv  Detail & Related papers  (2022-03-28T20:29:50Z)
• VaPar Synth -- A Variational Parametric Model for Audio Synthesis [78.3405844354125]
  We present VaPar Synth - a Variational Parametric Synthesizer which utilizes a conditional variational autoencoder (CVAE) trained on a suitable parametric representation. We demonstrate our proposed model's capabilities via the reconstruction and generation of instrumental tones with flexible control over their pitch.
  arXiv  Detail & Related papers  (2020-03-30T16:05:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.