Transformers Meet ACT-R: Repeat-Aware and Sequential Listening Session Recommendation

• URL: http://arxiv.org/abs/2408.16578v1
• Date: Thu, 29 Aug 2024 14:44:12 GMT
• Title: Transformers Meet ACT-R: Repeat-Aware and Sequential Listening Session Recommendation
• Authors: Viet-Anh Tran, Guillaume Salha-Galvan, Bruno Sguerra, Romain Hennequin,
• Abstract summary: We introduce PISA, a session-level sequential recommender system for music streaming services. PISA employs a Transformer architecture learning embedding representations of listening sessions and users. We demonstrate the empirical relevance of PISA using both publicly available listening data from Last.fm and proprietary data from Deezer.
• Score: 12.295794664393368
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Music streaming services often leverage sequential recommender systems to predict the best music to showcase to users based on past sequences of listening sessions. Nonetheless, most sequential recommendation methods ignore or insufficiently account for repetitive behaviors. This is a crucial limitation for music recommendation, as repeatedly listening to the same song over time is a common phenomenon that can even change the way users perceive this song. In this paper, we introduce PISA (Psychology-Informed Session embedding using ACT-R), a session-level sequential recommender system that overcomes this limitation. PISA employs a Transformer architecture learning embedding representations of listening sessions and users using attention mechanisms inspired by Anderson's ACT-R (Adaptive Control of Thought-Rational), a cognitive architecture modeling human information access and memory dynamics. This approach enables us to capture dynamic and repetitive patterns from user behaviors, allowing us to effectively predict the songs they will listen to in subsequent sessions, whether they are repeated or new ones. We demonstrate the empirical relevance of PISA using both publicly available listening data from Last.fm and proprietary data from Deezer, a global music streaming service, confirming the critical importance of repetition modeling for sequential listening session recommendation. Along with this paper, we publicly release our proprietary dataset to foster future research in this field, as well as the source code of PISA to facilitate its future use.

Related papers

• Multi-granularity Interest Retrieval and Refinement Network for Long-Term User Behavior Modeling in CTR Prediction [68.90783662117936]
  Click-through Rate (CTR) prediction is crucial for online personalization platforms. Recent advancements have shown that modeling rich user behaviors can significantly improve the performance of CTR prediction. We propose Multi-granularity Interest Retrieval and Refinement Network (MIRRN)
  arXiv  Detail & Related papers  (2024-11-22T15:29:05Z)
• Towards Leveraging Contrastively Pretrained Neural Audio Embeddings for Recommender Tasks [18.95453617434051]
  Music recommender systems frequently utilize network-based models to capture relationships between music pieces, artists, and users. New music pieces or artists often face the cold-start problem due to insufficient initial information. To address this, one can extract content-based information directly from the music to enhance collaborative-filtering-based methods.
  arXiv  Detail & Related papers  (2024-09-13T17:53:06Z)
• Enhancing Sequential Music Recommendation with Personalized Popularity Awareness [56.972624411205224]
  This paper introduces a novel approach that incorporates personalized popularity information into sequential recommendation. Experimental results demonstrate that a Personalized Most Popular recommender outperforms existing state-of-the-art models.
  arXiv  Detail & Related papers  (2024-09-06T15:05:12Z)
• LARP: Language Audio Relational Pre-training for Cold-Start Playlist Continuation [49.89372182441713]
  We introduce LARP, a multi-modal cold-start playlist continuation model. Our framework uses increasing stages of task-specific abstraction: within-track (language-audio) contrastive loss, track-track contrastive loss, and track-playlist contrastive loss.
  arXiv  Detail & Related papers  (2024-06-20T14:02:15Z)
• Modeling Activity-Driven Music Listening with PACE [2.241215446326728]
  We propose PACE (PAttern-based user Consumption Embedding), a framework for building user embeddings that takes advantage of periodic listening behaviors. By applying this framework on long-term user histories, we evaluate the embeddings through a predictive task of activities performed while listening to music.
  arXiv  Detail & Related papers  (2024-05-02T16:08:03Z)
• Oh, Jeez! or Uh-huh? A Listener-aware Backchannel Predictor on ASR Transcriptions [30.779582465296897]
  We develop a system which acts as a proactive listener by inserting backchannels, such as continuers and assessment, to influence speakers. Our model takes into account not only lexical and acoustic cues, but also introduces the simple and novel idea of using listener embeddings to mimic different backchanneling behaviours.
  arXiv  Detail & Related papers  (2023-04-10T09:33:29Z)
• Recommender Transformers with Behavior Pathways [50.842316273120744]
  We build the Recommender Transformer (RETR) with a novel Pathway Attention mechanism. We empirically verify the effectiveness of RETR on seven real-world datasets.
  arXiv  Detail & Related papers  (2022-06-13T08:58:37Z)
• Exploiting Session Information in BERT-based Session-aware Sequential Recommendation [13.15762859612114]
  In recommendation systems, utilizing the user interaction history as sequential information has resulted in great performance improvement. In many online services, user interactions are commonly grouped by sessions that presumably share preferences, which requires a different approach from ordinary sequence representation techniques. We propose three methods to improve recommendation performance by exploiting session information while minimizing additional parameters in a BERT-based sequential recommendation model.
  arXiv  Detail & Related papers  (2022-04-22T17:58:10Z)
• Modeling Dynamic User Preference via Dictionary Learning for Sequential Recommendation [133.8758914874593]
  Capturing the dynamics in user preference is crucial to better predict user future behaviors because user preferences often drift over time. Many existing recommendation algorithms -- including both shallow and deep ones -- often model such dynamics independently. This paper considers the problem of embedding a user's sequential behavior into the latent space of user preferences.
  arXiv  Detail & Related papers  (2022-04-02T03:23:46Z)
• SR-HetGNN:Session-based Recommendation with Heterogeneous Graph Neural Network [20.82060191403763]
  Session-Based Recommendation System aims to predict the user's next click based on their previous session sequence. We propose SR-HetGNN, a novel session recommendation method that uses a heterogeneous graph neural network (HetGNN) to learn session embeddings. SR-HetGNN is shown to be superior to the existing state-of-the-art session-based recommendation methods through extensive experiments over two real large datasets Diginetica and Tmall.
  arXiv  Detail & Related papers  (2021-08-12T10:12:48Z)
• TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendation [66.04457457299218]
  We propose a novel target attentive graph neural network (TAGNN) model for session-based recommendation. In TAGNN, target-aware attention adaptively activates different user interests with respect to varied target items. The learned interest representation vector varies with different target items, greatly improving the expressiveness of the model.
  arXiv  Detail & Related papers  (2020-05-06T14:17:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.