The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify

• URL: http://arxiv.org/abs/2003.08203v1
• Date: Tue, 17 Mar 2020 16:49:59 GMT
• Title: The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify
• Authors: David Holtz, Benjamin Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, Sinan Aral
• Abstract summary: We present results from a randomized field experiment on Spotify. We find that, on average, the treatment increased podcast streams by 28.90%. However, the treatment also decreased the average individual-level diversity of podcast streams by 11.51%.
• Score: 7.016697571050686
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: It remains unknown whether personalized recommendations increase or decrease the diversity of content people consume. We present results from a randomized field experiment on Spotify testing the effect of personalized recommendations on consumption diversity. In the experiment, both control and treatment users were given podcast recommendations, with the sole aim of increasing podcast consumption. Treatment users' recommendations were personalized based on their music listening history, whereas control users were recommended popular podcasts among users in their demographic group. We find that, on average, the treatment increased podcast streams by 28.90%. However, the treatment also decreased the average individual-level diversity of podcast streams by 11.51%, and increased the aggregate diversity of podcast streams by 5.96%, indicating that personalized recommendations have the potential to create patterns of consumption that are homogenous within and diverse across users, a pattern reflecting Balkanization. Our results provide evidence of an "engagement-diversity trade-off" when recommendations are optimized solely to drive consumption: while personalized recommendations increase user engagement, they also affect the diversity of consumed content. This shift in consumption diversity can affect user retention and lifetime value, and impact the optimal strategy for content producers. We also observe evidence that our treatment affected streams from sections of Spotify's app not directly affected by the experiment, suggesting that exposure to personalized recommendations can affect the content that users consume organically. We believe these findings highlight the need for academics and practitioners to continue investing in personalization methods that explicitly take into account the diversity of content recommended.

Related papers

• ComPO: Community Preferences for Language Model Personalization [122.54846260663922]
  ComPO is a method to personalize preference optimization in language models. We collect and release ComPRed, a question answering dataset with community-level preferences from Reddit.
  arXiv  Detail & Related papers  (2024-10-21T14:02:40Z)
• Stereotype or Personalization? User Identity Biases Chatbot Recommendations [54.38329151781466]
  We show that large language models (LLMs) produce recommendations that reflect both what the user wants and who the user is. We find that models generate racially stereotypical recommendations regardless of whether the user revealed their identity intentionally. Our experiments show that even though a user's revealed identity significantly influences model recommendations, model responses obfuscate this fact in response to user queries.
  arXiv  Detail & Related papers  (2024-10-08T01:51:55Z)
• Measuring Strategization in Recommendation: Users Adapt Their Behavior to Shape Future Content [66.71102704873185]
  We test for user strategization by conducting a lab experiment and survey. We find strong evidence of strategization across outcome metrics, including participants' dwell time and use of "likes" Our findings suggest that platforms cannot ignore the effect of their algorithms on user behavior.
  arXiv  Detail & Related papers  (2024-05-09T07:36:08Z)
• The Impact of Recommendation Systems on Opinion Dynamics: Microscopic versus Macroscopic Effects [1.4180331276028664]
  We study the impact of recommendation systems on users, both from a microscopic (i.e., at the level of individual users) and a macroscopic perspective. Our analysis reveals that shifts in the opinions of individual users do not always align with shifts in the opinion distribution of the population.
  arXiv  Detail & Related papers  (2023-09-16T11:44:51Z)
• Improving Recommendation System Serendipity Through Lexicase Selection [53.57498970940369]
  We propose a new serendipity metric to measure the presence of echo chambers and homophily in recommendation systems. We then attempt to improve the diversity-preservation qualities of well known recommendation techniques by adopting a parent selection algorithm known as lexicase selection. Our results show that lexicase selection, or a mixture of lexicase selection and ranking, outperforms its purely ranked counterparts in terms of personalization, coverage and our specifically designed serendipity benchmark.
  arXiv  Detail & Related papers  (2023-05-18T15:37:38Z)
• Recommending to Strategic Users [10.079698681921673]
  We show that users strategically choose content to influence the types of content they get recommended in the future. We propose three interventions that may improve recommendation quality when taking into account strategic consumption.
  arXiv  Detail & Related papers  (2023-02-13T17:57:30Z)
• Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling [66.02953670238647]
  Tail users suffer from significantly lower-quality recommendation than the head users after joint training. A model trained on tail users separately still achieve inferior results due to limited data. We propose a novel approach that significantly improves the recommendation performance of the tail users.
  arXiv  Detail & Related papers  (2022-08-19T02:50:19Z)
• Follow the guides: disentangling human and algorithmic curation in online music consumption [1.4506962780822348]
  We analyze the complete listening history of about 9k users over one year. We show that the two types of recommendation offered by music platforms -- algorithmic and editorial -- may drive the consumption of more or less diverse content in opposite directions.
  arXiv  Detail & Related papers  (2021-09-08T20:14:48Z)
• PURS: Personalized Unexpected Recommender System for Improving User Satisfaction [76.98616102965023]
  We describe a novel Personalized Unexpected Recommender System (PURS) model that incorporates unexpectedness into the recommendation process. Extensive offline experiments on three real-world datasets illustrate that the proposed PURS model significantly outperforms the state-of-the-art baseline approaches.
  arXiv  Detail & Related papers  (2021-06-05T01:33:21Z)
• Trajectory Based Podcast Recommendation [6.366468661321732]
  We show that successful and consistent recommendations can be made by viewing users as moving through the podcast library sequentially. Our approach gives a450% increase in effectiveness over a collaborative filtering baseline.
  arXiv  Detail & Related papers  (2020-09-08T16:49:12Z)
• Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste [5.429958676933934]
  We consider podcasting as an emerging medium with rapid growth in adoption. Using music consumption behavior, we examine two main techniques in inferring Spotify users preferences over more than 200k podcasts. Our results show significant improvements in consumption of up to 50% for both offline and online experiments.
  arXiv  Detail & Related papers  (2020-07-27T02:55:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.