The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization

• URL: http://arxiv.org/abs/2202.11776v3
• Date: Mon, 23 Oct 2023 12:21:18 GMT
• Title: The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization
• Authors: Jon Kleinberg, Sendhil Mullainathan, Manish Raghavan
• Abstract summary: We develop a model of media consumption where users have inconsistent preferences. We show how our model of users' preference inconsistencies produces phenomena that are familiar from everyday experience.
• Score: 2.690930520747925
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online platforms have a wealth of data, run countless experiments and use industrial-scale algorithms to optimize user experience. Despite this, many users seem to regret the time they spend on these platforms. One possible explanation is misaligned incentives: platforms are not optimizing for user happiness. We suggest the problem runs deeper, transcending the specific incentives of any particular platform, and instead stems from a mistaken foundational assumption: To understand what users want, platforms look at what users do. Yet research has demonstrated, and personal experience affirms, that we often make choices in the moment that are inconsistent with what we actually want. In this work, we develop a model of media consumption where users have inconsistent preferences. We consider a platform which simply wants to maximize user utility, but only observes user engagement. We show how our model of users' preference inconsistencies produces phenomena that are familiar from everyday experience, but difficult to capture in traditional user interaction models. A key ingredient in our model is a formulation for how platforms determine what to show users: they optimize over a large set of potential content (the content manifold) parametrized by underlying features of the content. Whether improving engagement improves user welfare depends on the direction of movement in the content manifold: for certain directions of change, increasing engagement makes users less happy, while in other directions, increasing engagement makes users happier. We characterize the structure of content manifolds for which increasing engagement fails to increase user utility. By linking these effects to abstractions of platform design choices, our model thus creates a theoretical framework and vocabulary in which to explore interactions between design, behavioral science, and social media.

Related papers

• System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes [80.97898201876592]
  We propose a generative model in which past content interactions impact the arrival rates of users based on a self-exciting Hawkes process. We show analytically that given samples it is possible to disentangle System-1 and System-2 and allow content optimization based on user utility.
  arXiv  Detail & Related papers  (2024-05-29T18:19:37Z)
• Measuring Strategization in Recommendation: Users Adapt Their Behavior to Shape Future Content [66.71102704873185]
  We test for user strategization by conducting a lab experiment and survey. We find strong evidence of strategization across outcome metrics, including participants' dwell time and use of "likes" Our findings suggest that platforms cannot ignore the effect of their algorithms on user behavior.
  arXiv  Detail & Related papers  (2024-05-09T07:36:08Z)
• Can Probabilistic Feedback Drive User Impacts in Online Platforms? [26.052963782865294]
  A common explanation for negative user impacts of content recommender systems is misalignment between the platform's objective and user welfare. In this work, we show that misalignment in the platform's objective is not the only potential cause of unintended impacts on users. The source of these user impacts is that different pieces of content may generate observable user reactions (feedback information) at different rates.
  arXiv  Detail & Related papers  (2024-01-10T18:12:31Z)
• Matching of Users and Creators in Two-Sided Markets with Departures [0.6649753747542209]
  We propose a model of content recommendation that focuses on the dynamics of user-content matching. We show that a user-centric greedy algorithm that does not consider creator departures can result in arbitrarily poor total engagement. We present two practical algorithms, one with performance guarantees under mild assumptions on user preferences, and another that tends to outperform algorithms that ignore two-sided departures in practice.
  arXiv  Detail & Related papers  (2023-12-30T20:13:28Z)
• Causal Structure Representation Learning of Confounders in Latent Space for Recommendation [6.839357057621987]
  Inferring user preferences from the historical feedback of users is a valuable problem in recommender systems. We consider the influence of confounders, disentangle them from user preferences in the latent space, and employ causal graphs to model their interdependencies.
  arXiv  Detail & Related papers  (2023-11-02T08:46:07Z)
• Inclusiveness Matters: A Large-Scale Analysis of User Feedback [7.8788463395442045]
  We leverage user feedback from three popular online sources, Reddit, Google Play Store, and Twitter, for 50 of the most popular apps in the world. Using a Socio-Technical Grounded Theory approach, we analyzed 23,107 posts across the three sources and identified 1,211 inclusiveness related posts. Our study provides an in-depth view of inclusiveness-related user feedback from most popular apps and online sources.
  arXiv  Detail & Related papers  (2023-11-02T04:05:46Z)
• Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
  Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online. Intent modeling is thus critical for understanding users and optimizing long-term user experience.
  arXiv  Detail & Related papers  (2022-11-17T19:00:24Z)
• DIGMN: Dynamic Intent Guided Meta Network for Differentiated User Engagement Forecasting in Online Professional Social Platforms [32.70471436337077]
  A major reason for the differences in user engagement patterns is that users have different intents. We propose a Dynamic Guided Meta Network (DIGMN) which can explicitly model user intent varying with time. Our method outperforms state-of-the-art baselines significantly.
  arXiv  Detail & Related papers  (2022-10-22T09:57:27Z)
• Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling [66.02953670238647]
  Tail users suffer from significantly lower-quality recommendation than the head users after joint training. A model trained on tail users separately still achieve inferior results due to limited data. We propose a novel approach that significantly improves the recommendation performance of the tail users.
  arXiv  Detail & Related papers  (2022-08-19T02:50:19Z)
• Modeling Content Creator Incentives on Algorithm-Curated Platforms [76.53541575455978]
  We study how algorithmic choices affect the existence and character of (Nash) equilibria in exposure games. We propose tools for numerically finding equilibria in exposure games, and illustrate results of an audit on the MovieLens and LastFM datasets.
  arXiv  Detail & Related papers  (2022-06-27T08:16:59Z)
• Disentangled Graph Collaborative Filtering [100.26835145396782]
  Disentangled Graph Collaborative Filtering (DGCF) is a new model for learning informative representations of users and items from interaction data. By modeling a distribution over intents for each user-item interaction, we iteratively refine the intent-aware interaction graphs and representations. DGCF achieves significant improvements over several state-of-the-art models like NGCF, DisenGCN, and MacridVAE.
  arXiv  Detail & Related papers  (2020-07-03T15:37:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.