Fine-Grained Session Recommendations in E-commerce using Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2210.15451v1
• Date: Thu, 20 Oct 2022 13:22:13 GMT
• Title: Fine-Grained Session Recommendations in E-commerce using Deep Reinforcement Learning
• Authors: Diddigi Raghu Ram Bharadwaj, Lakshya Kumar, Saif Jawaid, Sreekanth Vempati
• Abstract summary: Sustaining users' interest and keeping them engaged in the platform is very important for the success of an e-commerce business. In this work, we focus primarily on the unknown intent setting where our objective is to recommend a sequence of products to a user in a session to sustain their interest. We formulate this problem in the framework of the Markov Decision Process (MDP), a popular mathematical framework for sequential decision making.
• Score: 0.028675177318965035
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Sustaining users' interest and keeping them engaged in the platform is very important for the success of an e-commerce business. A session encompasses different activities of a user between logging into the platform and logging out or making a purchase. User activities in a session can be classified into two groups: Known Intent and Unknown intent. Known intent activity pertains to the session where the intent of a user to browse/purchase a specific product can be easily captured. Whereas in unknown intent activity, the intent of the user is not known. For example, consider the scenario where a user enters the session to casually browse the products over the platform, similar to the window shopping experience in the offline setting. While recommending similar products is essential in the former, accurately understanding the intent and recommending interesting products is essential in the latter setting in order to retain a user. In this work, we focus primarily on the unknown intent setting where our objective is to recommend a sequence of products to a user in a session to sustain their interest, keep them engaged and possibly drive them towards purchase. We formulate this problem in the framework of the Markov Decision Process (MDP), a popular mathematical framework for sequential decision making and solve it using Deep Reinforcement Learning (DRL) techniques. However, training the next product recommendation is difficult in the RL paradigm due to large variance in browse/purchase behavior of the users. Therefore, we break the problem down into predicting various product attributes, where a pattern/trend can be identified and exploited to build accurate models. We show that the DRL agent provides better performance compared to a greedy strategy.

Related papers

• SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding [64.45047674586671]
  We introduce the concept of an intention tree and propose a dataset curation pipeline.<n>We construct a sibling multimodal benchmark, SessionIntentBench, that evaluates L(V)LMs' capability on understanding inter-session intention shift.<n>With 1,952,177 intention entries, 1,132,145 session intention trajectories, and 13,003,664 available tasks mined using 10,905 sessions, we provide a scalable way to exploit the existing session data.
  arXiv  Detail & Related papers  (2025-07-27T09:04:17Z)
• Hierarchical Intent-guided Optimization with Pluggable LLM-Driven Semantics for Session-based Recommendation [22.653549796453426]
  Session-based Recommendation (SBR) aims to predict the next item a user will likely engage with, using their interaction sequence within an anonymous session.<n>Existing SBR models often focus only on single-session information, ignoring inter-session relationships and valuable cross-session insights.<n>We propose a novel hierarchical intent-guided optimization approach with pluggable LLM-driven semantic learning for session-based recommendations, called HIPHOP.
  arXiv  Detail & Related papers  (2025-07-07T02:50:04Z)
• Beyond Item Dissimilarities: Diversifying by Intent in Recommender Systems [20.04619904064599]
  We develop a probabilistic intent-based whole-page diversification framework for the final stage of a recommender system. Live experiments on a diverse set of intents show that our framework increases Daily Active Users and overall user enjoyment.
  arXiv  Detail & Related papers  (2024-05-20T18:52:33Z)
• Measuring Strategization in Recommendation: Users Adapt Their Behavior to Shape Future Content [66.71102704873185]
  We test for user strategization by conducting a lab experiment and survey. We find strong evidence of strategization across outcome metrics, including participants' dwell time and use of "likes" Our findings suggest that platforms cannot ignore the effect of their algorithms on user behavior.
  arXiv  Detail & Related papers  (2024-05-09T07:36:08Z)
• On Generative Agents in Recommendation [58.42840923200071]
  Agent4Rec is a user simulator in recommendation based on Large Language Models. Each agent interacts with personalized recommender models in a page-by-page manner.
  arXiv  Detail & Related papers  (2023-10-16T06:41:16Z)
• Context-aware Session-based Recommendation with Graph Neural Networks [6.825493772727133]
  We propose CARES, a novel context-aware session-based recommendation model with graph neural networks. We first construct a multi-relation cross-session graph to connect items according to intra- and cross-session item-level contexts. To encode the variation of user interests, we design personalized item representations.
  arXiv  Detail & Related papers  (2023-10-14T14:29:52Z)
• Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
  Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online. Intent modeling is thus critical for understanding users and optimizing long-term user experience.
  arXiv  Detail & Related papers  (2022-11-17T19:00:24Z)
• Intra-session Context-aware Feed Recommendation in Live Systems [35.84926743736469]
  We propose a novel intra-session Context-aware Feed Recommendation framework to maximize the total views and total clicks simultaneously. Our method sheds some lights on feed recommendation studies which aim to optimize session-level click and view metrics.
  arXiv  Detail & Related papers  (2022-09-30T04:21:36Z)
• Price DOES Matter! Modeling Price and Interest Preferences in Session-based Recommendation [55.0391061198924]
  Session-based recommendation aims to predict items that an anonymous user would like to purchase based on her short behavior sequence. It is nontrivial to incorporate price preferences for session-based recommendation. We propose a novel method Co-guided Heterogeneous Hypergraph Network (CoHHN) for session-based recommendation.
  arXiv  Detail & Related papers  (2022-05-09T10:47:15Z)
• Intent Contrastive Learning for Sequential Recommendation [86.54439927038968]
  We introduce a latent variable to represent users' intents and learn the distribution function of the latent variable via clustering. We propose to leverage the learned intents into SR models via contrastive SSL, which maximizes the agreement between a view of sequence and its corresponding intent. Experiments conducted on four real-world datasets demonstrate the superiority of the proposed learning paradigm.
  arXiv  Detail & Related papers  (2022-02-05T09:24:13Z)
• Comprehensive Empirical Evaluation of Deep Learning Approaches for Session-based Recommendation in E-Commerce [38.42250061908039]
  In session-based recommendation, a recommendation system counts on the sequence of events made by a user within the same session to predict and endorse other items. We present a comprehensive evaluation of the state-of-the-art deep learning approaches used in the session-based recommendation.
  arXiv  Detail & Related papers  (2020-10-17T17:22:35Z)
• Incorporating User Micro-behaviors and Item Knowledge into Multi-task Learning for Session-based Recommendation [18.516121495514007]
  Session-based recommendation (SR) aims to predict the next interacted item based on a given session. Most existing SR models only focus on exploiting the consecutive items in a session interacted by a certain user. We propose a novel SR model MKM-SR, which incorporates user Micro-behaviors and item Knowledge into Multi-task learning for Session-based Recommendation.
  arXiv  Detail & Related papers  (2020-06-12T03:06:23Z)
• Self-Supervised Reinforcement Learning for Recommender Systems [77.38665506495553]
  We propose self-supervised reinforcement learning for sequential recommendation tasks. Our approach augments standard recommendation models with two output layers: one for self-supervised learning and the other for RL. Based on such an approach, we propose two frameworks namely Self-Supervised Q-learning(SQN) and Self-Supervised Actor-Critic(SAC)
  arXiv  Detail & Related papers  (2020-06-10T11:18:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.