APEX: Large-scale Multi-task Aesthetic-Informed Popularity Prediction for AI-Generated Music

• URL: http://arxiv.org/abs/2605.03395v1
• Date: Tue, 05 May 2026 06:11:51 GMT
• Title: APEX: Large-scale Multi-task Aesthetic-Informed Popularity Prediction for AI-Generated Music
• Abstract summary: We propose APEX, the first large-scale multi-task learning framework for AI-generated music.<n>It predicts engagement-based popularity signals - streams and likes scores - alongside five perceptual aesthetic quality dimensions.<n>It was trained on over 211k songs (10k hours of audio) from Suno and Udio.
• Score: 11.491774036026923
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Music popularity prediction has attracted growing research interest, with relevance to artists, platforms, and recommendation systems. However, the explosive rise of AI-generated music platforms has created an entirely new and largely unexplored landscape, where a surge of songs is produced and consumed daily without the traditional markers of artist reputation or label backing. Key, yet unexplored in this pursuit is aesthetic quality. We propose APEX, the first large-scale multi-task learning framework for AI-generated music, trained on over 211k songs (10k hours of audio) from Suno and Udio, that jointly predicts engagement-based popularity signals - streams and likes scores - alongside five perceptual aesthetic quality dimensions from frozen audio embeddings extracted from MERT, a self-supervised music understanding model. Aesthetic quality and popularity capture complementary aspects of music that together prove valuable: in an out-of-distribution evaluation on the Music Arena dataset, comprising pairwise human preference battles across eleven generative music systems unseen during training, including aesthetic features consistently improves preference prediction, demonstrating strong generalisation of the learned representations across generative architectures.

Related papers

• FIGMA: Towards FIne-Grained Music retrievAl [65.98380295254817]
  Retrieving music using natural language descriptions has improved with contrastive audio-text models such as CLAP, but current systems remain limited to coarse semantic queries.<n>We show that this limitation stems from the contrastive learning objective itself: despite being trained on long captions, CLAP-based models effectively utilize only the first few tokens.<n>We propose FIGMA, a multi-view contrastive architecture that addresses this limitation by jointly optimizing global audio-text alignment and frame-level, token-wise alignment.
  arXiv  Detail & Related papers  (2026-06-04T18:05:39Z)
• MusicAIR: A Multimodal AI Music Generation Framework Powered by an Algorithm-Driven Core [0.0]
  MusicAIR is an innovative AI music generation framework powered by a novel algorithm-driven symbolic music core.<n>The framework generates a complete melodic score solely from the lyrics.<n>GenAIM is a web tool using MusicAIR for lyric-to-song, text-to-music, and image-to-music generation.
  arXiv  Detail & Related papers  (2025-11-21T15:43:27Z)
• Music Flamingo: Scaling Music Understanding in Audio Language Models [98.94537017112704]
  Music Flamingo is a novel large audio-language model designed to advance music understanding in foundational audio models.<n> MF-Skills is a dataset labeled through a multi-stage pipeline that yields rich captions and question-answer pairs covering harmony, structure, timbre, lyrics, and cultural context.<n>We introduce a post-training recipe: we first cold-start with MF-Think, a novel chain-of-thought dataset grounded in music theory, followed by GRPO-based reinforcement learning with custom rewards.
  arXiv  Detail & Related papers  (2025-11-13T13:21:09Z)
• Predicting Music Track Popularity by Convolutional Neural Networks on Spotify Features and Spectrogram of Audio Waveform [3.6458439734112695]
  This study introduces a pioneering methodology that uses Convolutional Neural Networks (CNNs) and Spotify data analysis to forecast the popularity of music tracks.<n>Our approach takes advantage of Spotify's wide range of features, including acoustic attributes based on the spectrogram of audio waveform, metadata, and user engagement metrics.<n>Using a large dataset covering various genres and demographics, our CNN-based model shows impressive effectiveness in predicting the popularity of music tracks.
  arXiv  Detail & Related papers  (2025-05-12T07:03:17Z)
• Detecting Musical Deepfakes [0.0]
  This study investigates the detection of AI-generated songs using the FakeMusicCaps dataset.<n>To simulate real-world adversarial conditions, tempo stretching and pitch shifting were applied to the dataset.<n>Mel spectrograms were generated from the modified audio, then used to train and evaluate a convolutional neural network.
  arXiv  Detail & Related papers  (2025-05-03T21:45:13Z)
• Enhancing Sequential Music Recommendation with Personalized Popularity Awareness [56.972624411205224]
  This paper introduces a novel approach that incorporates personalized popularity information into sequential recommendation. Experimental results demonstrate that a Personalized Most Popular recommender outperforms existing state-of-the-art models.
  arXiv  Detail & Related papers  (2024-09-06T15:05:12Z)
• An Order-Complexity Aesthetic Assessment Model for Aesthetic-aware Music Recommendation [20.164044758068634]
  subjective evaluation is still the most effective form of evaluating artistic works. While compared to music produced by humans, AI generated music still sounds mechanical, monotonous, and lacks aesthetic appeal. We use Birkhoff's aesthetic measure to design a aesthetic model, objectively measuring the aesthetic beauty of music, and form a recommendation list according to the aesthetic feeling of music.
  arXiv  Detail & Related papers  (2024-02-13T09:03:03Z)
• MusicRL: Aligning Music Generation to Human Preferences [62.44903326718772]
  MusicRL is the first music generation system finetuned from human feedback. We deploy MusicLM to users and collect a substantial dataset comprising 300,000 pairwise preferences. We train MusicRL-U, the first text-to-music model that incorporates human feedback at scale.
  arXiv  Detail & Related papers  (2024-02-06T18:36:52Z)
• MARBLE: Music Audio Representation Benchmark for Universal Evaluation [79.25065218663458]
  We introduce the Music Audio Representation Benchmark for universaL Evaluation, termed MARBLE. It aims to provide a benchmark for various Music Information Retrieval (MIR) tasks by defining a comprehensive taxonomy with four hierarchy levels, including acoustic, performance, score, and high-level description. We then establish a unified protocol based on 14 tasks on 8 public-available datasets, providing a fair and standard assessment of representations of all open-sourced pre-trained models developed on music recordings as baselines.
  arXiv  Detail & Related papers  (2023-06-18T12:56:46Z)
• An Order-Complexity Model for Aesthetic Quality Assessment of Symbolic Homophony Music Scores [8.751312368054016]
  The quality of music score generated by AI is relatively poor compared with that created by human composers. This paper proposes an objective quantitative evaluation method for homophony music score aesthetic quality assessment.
  arXiv  Detail & Related papers  (2023-01-14T12:30:16Z)
• MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training [97.91071692716406]
  Symbolic music understanding refers to the understanding of music from the symbolic data. MusicBERT is a large-scale pre-trained model for music understanding.
  arXiv  Detail & Related papers  (2021-06-10T10:13:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.