Leveraging Negative Signals with Self-Attention for Sequential Music Recommendation

• URL: http://arxiv.org/abs/2309.11623v2
• Date: Thu, 18 Jan 2024 22:37:48 GMT
• Title: Leveraging Negative Signals with Self-Attention for Sequential Music Recommendation
• Authors: Pavan Seshadri, Peter Knees
• Abstract summary: We propose a contrastive learning task to incorporate negative feedback to promote positive hits and penalize negative hits. Our experiments show that this results in consistent performance gains over the baseline architectures ignoring negative user feedback.
• Score: 0.27195102129094995
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Music streaming services heavily rely on their recommendation engines to continuously provide content to their consumers. Sequential recommendation consequently has seen considerable attention in current literature, where state of the art approaches focus on self-attentive models leveraging contextual information such as long and short-term user history and item features; however, most of these studies focus on long-form content domains (retail, movie, etc.) rather than short-form, such as music. Additionally, many do not explore incorporating negative session-level feedback during training. In this study, we investigate the use of transformer-based self-attentive architectures to learn implicit session-level information for sequential music recommendation. We additionally propose a contrastive learning task to incorporate negative feedback (e.g skipped tracks) to promote positive hits and penalize negative hits. This task is formulated as a simple loss term that can be incorporated into a variety of deep learning architectures for sequential recommendation. Our experiments show that this results in consistent performance gains over the baseline architectures ignoring negative user feedback.

Related papers

• Towards Leveraging Contrastively Pretrained Neural Audio Embeddings for Recommender Tasks [18.95453617434051]
  Music recommender systems frequently utilize network-based models to capture relationships between music pieces, artists, and users. New music pieces or artists often face the cold-start problem due to insufficient initial information. To address this, one can extract content-based information directly from the music to enhance collaborative-filtering-based methods.
  arXiv  Detail & Related papers  (2024-09-13T17:53:06Z)
• Fairness Through Domain Awareness: Mitigating Popularity Bias For Music Discovery [56.77435520571752]
  We explore the intrinsic relationship between music discovery and popularity bias. We propose a domain-aware, individual fairness-based approach which addresses popularity bias in graph neural network (GNNs) based recommender systems. Our approach uses individual fairness to reflect a ground truth listening experience, i.e., if two songs sound similar, this similarity should be reflected in their representations.
  arXiv  Detail & Related papers  (2023-08-28T14:12:25Z)
• Video-to-Music Recommendation using Temporal Alignment of Segments [5.7235653928654235]
  We study cross-modal recommendation of music tracks to be used as soundtracks for videos. We build on a self-supervised system that learns a content association between music and video. We propose a novel approach to significantly improve the system's performance using structure-aware recommendation.
  arXiv  Detail & Related papers  (2023-06-12T15:40:31Z)
• Exploiting Negative Preference in Content-based Music Recommendation with Contrastive Learning [16.728976424372362]
  We analyze the role of negative preference in users' music tastes by comparing music recommendation models with contrastive learning exploiting preference (CLEP) Our experimental results show that CLEP-N outperforms the other two in accuracy and false positive rate.
  arXiv  Detail & Related papers  (2022-07-28T07:02:48Z)
• Positive, Negative and Neutral: Modeling Implicit Feedback in Session-based News Recommendation [13.905580921329717]
  We propose a comprehensive framework to model user behaviors through positive feedback and negative feedback. The framework implicitly models the user using their session start time, and the article using its initial publishing time. Empirical evaluation on three real-world news datasets shows the framework's promising performance.
  arXiv  Detail & Related papers  (2022-05-12T12:47:06Z)
• Simulating Bandit Learning from User Feedback for Extractive Question Answering [51.97943858898579]
  We study learning from user feedback for extractive question answering by simulating feedback using supervised data. We show that systems initially trained on a small number of examples can dramatically improve given feedback from users on model-predicted answers.
  arXiv  Detail & Related papers  (2022-03-18T17:47:58Z)
• Explainability in Music Recommender Systems [69.0506502017444]
  We discuss how explainability can be addressed in the context of Music Recommender Systems (MRSs) MRSs are often quite complex and optimized for recommendation accuracy. We show how explainability components can be integrated within a MRS and in what form explanations can be provided.
  arXiv  Detail & Related papers  (2022-01-25T18:32:11Z)
• Learning Robust Recommender from Noisy Implicit Feedback [140.7090392887355]
  We propose a new training strategy named Adaptive Denoising Training (ADT) ADT adaptively prunes the noisy interactions by two paradigms (i.e., Truncated Loss and Reweighted Loss) We consider extra feedback (e.g., rating) as auxiliary signal and propose three strategies to incorporate extra feedback into ADT.
  arXiv  Detail & Related papers  (2021-12-02T12:12:02Z)
• Reinforcement Learning based Path Exploration for Sequential Explainable Recommendation [57.67616822888859]
  We propose a novel Temporal Meta-path Guided Explainable Recommendation leveraging Reinforcement Learning (TMER-RL) TMER-RL utilizes reinforcement item-item path modelling between consecutive items with attention mechanisms to sequentially model dynamic user-item evolutions on dynamic knowledge graph for explainable recommendation. Extensive evaluations of TMER on two real-world datasets show state-of-the-art performance compared against recent strong baselines.
  arXiv  Detail & Related papers  (2021-11-24T04:34:26Z)
• Generative Inverse Deep Reinforcement Learning for Online Recommendation [62.09946317831129]
  We propose a novel inverse reinforcement learning approach, namely InvRec, for online recommendation. InvRec extracts the reward function from user's behaviors automatically, for online recommendation.
  arXiv  Detail & Related papers  (2020-11-04T12:12:25Z)
• Time-Aware Music Recommender Systems: Modeling the Evolution of Implicit User Preferences and User Listening Habits in A Collaborative Filtering Approach [4.576379639081977]
  This paper studies the temporal information regarding when songs are played. The purpose is to model both the evolution of user preferences in the form of evolving implicit ratings and user listening behavior. In the collaborative filtering method proposed in this work, daily listening habits are captured in order to characterize users and provide them with more reliable recommendations.
  arXiv  Detail & Related papers  (2020-08-26T08:00:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.