Towards Explainable Personalized Recommendations by Learning from Users' Photos

• URL: http://arxiv.org/abs/2510.21455v1
• Date: Fri, 24 Oct 2025 13:33:50 GMT
• Title: Towards Explainable Personalized Recommendations by Learning from Users' Photos
• Authors: Jorge Díez, Pablo Pérez-Núñez, Oscar Luaces, Beatriz Remeseiro, Antonio Bahamonde,
• Abstract summary: We try to predict what photo a user would take of an item, because that image is the argument that can best convince her of the qualities of the item.<n>In this sense, an RS can explain its results and, therefore, increase its reliability.<n>The paper includes a formal framework that estimates the authorship probability for a given pair (user, photo)
• Score: 3.642823642133188
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Explaining the output of a complex system, such as a Recommender System (RS), is becoming of utmost importance for both users and companies. In this paper we explore the idea that personalized explanations can be learned as recommendation themselves. There are plenty of online services where users can upload some photos, in addition to rating items. We assume that users take these photos to reinforce or justify their opinions about the items. For this reason we try to predict what photo a user would take of an item, because that image is the argument that can best convince her of the qualities of the item. In this sense, an RS can explain its results and, therefore, increase its reliability. Furthermore, once we have a model to predict attractive images for users, we can estimate their distribution. Thus, the companies acquire a vivid knowledge about the aspects that the clients highlight of their products. The paper includes a formal framework that estimates the authorship probability for a given pair (user, photo). To illustrate the proposal, we use data gathered from TripAdvisor containing the reviews (with photos) of restaurants in six cities of different sizes.

Related papers

• PreferThinker: Reasoning-based Personalized Image Preference Assessment [83.66114370585976]
  We propose a reasoning-based personalized image preference assessment framework.<n>It first predicts a user's preference profile from reference images.<n>It then provides interpretable, multi-dimensional scores and assessments of candidate images.
  arXiv  Detail & Related papers  (2025-11-01T16:19:51Z)
• MTRec: Learning to Align with User Preferences via Mental Reward Models [60.321038000806176]
  We propose MTRec, a sequential recommendation framework designed to align with real user preferences.<n>We introduce a mental reward model to quantify user satisfaction and propose a distributional inverse reinforcement learning approach to learn it.<n>Experiments show that MTRec brings significant improvements to a variety of recommendation models.
  arXiv  Detail & Related papers  (2025-09-26T18:10:48Z)
• What if you said that differently?: How Explanation Formats Affect Human Feedback Efficacy and User Perception [53.4840989321394]
  We analyze the effect of rationales generated by QA models to support their answers. We present users with incorrect answers and corresponding rationales in various formats. We measure the effectiveness of this feedback in patching these rationales through in-context learning.
  arXiv  Detail & Related papers  (2023-11-16T04:26:32Z)
• Product Review Image Ranking for Fashion E-commerce [0.0]
  We train our network to rank bad-quality images lower than high-quality ones. Our proposed method outperforms the baseline models on two metrics, namely correlation coefficient, and accuracy, by substantial margins.
  arXiv  Detail & Related papers  (2023-08-10T07:09:13Z)
• Identifying Professional Photographers Through Image Quality and Aesthetics in Flickr [0.0]
  This study reveals the lack of suitable data sets in photo and video sharing platforms. We created one of the largest labelled data sets in Flickr with the multimodal data which has been open sourced. We examined the relationship between the aesthetics and technical quality of a picture and the social activity of that picture.
  arXiv  Detail & Related papers  (2023-07-04T14:55:37Z)
• HIVE: Harnessing Human Feedback for Instructional Visual Editing [127.29436858998064]
  We present a novel framework to harness human feedback for instructional visual editing (HIVE) Specifically, we collect human feedback on the edited images and learn a reward function to capture the underlying user preferences. We then introduce scalable diffusion model fine-tuning methods that can incorporate human preferences based on the estimated reward.
  arXiv  Detail & Related papers  (2023-03-16T19:47:41Z)
• RecXplainer: Amortized Attribute-based Personalized Explanations for Recommender Systems [35.57265154621778]
  We propose RecXplainer, a novel method for generating fine-grained explanations based on a user's preferences over the attributes of recommended items. We evaluate RecXplainer on five real-world and large-scale recommendation datasets.
  arXiv  Detail & Related papers  (2022-11-27T21:00:31Z)
• Can you recommend content to creatives instead of final consumers? A RecSys based on user's preferred visual styles [69.69160476215895]
  This report is an extension of the paper "Learning Users' Preferred Visual Styles in an Image Marketplace", presented at ACM RecSys '22. We design a RecSys that learns visual styles preferences to the semantics of the projects users work on.
  arXiv  Detail & Related papers  (2022-08-23T12:11:28Z)
• Causal Disentanglement with Network Information for Debiased Recommendations [34.698181166037564]
  Recent research proposes to debias by modeling a recommender system from a causal perspective. The critical challenge in this setting is accounting for the hidden confounders. We propose to leverage network information (i.e., user-social and user-item networks) to better approximate hidden confounders.
  arXiv  Detail & Related papers  (2022-04-14T20:55:11Z)
• Photos Are All You Need for Reciprocal Recommendation in Online Dating [1.90365714903665]
  We present a novel method of interpreting user image preference history and using this to make recommendations. We train a recurrent neural network to learn a user's preferences and make predictions of reciprocal preference relations. Our system significantly outperforms on the state of the art in both content-based and collaborative filtering systems.
  arXiv  Detail & Related papers  (2021-08-26T11:38:23Z)
• User-Inspired Posterior Network for Recommendation Reason Generation [53.035224183349385]
  Recommendation reason generation plays a vital role in attracting customers' attention as well as improving user experience. We propose a user-inspired multi-source posterior transformer (MSPT), which induces the model reflecting the users' interests. Experimental results show that our model is superior to traditional generative models.
  arXiv  Detail & Related papers  (2021-02-16T02:08:52Z)
• On the effectiveness of convolutional autoencoders on image-based personalized recommender systems [0.0]
  This paper explores the potential of using images as sources of information for modeling users' tastes. It proposes an image-based classification system to obtain personalized recommendations using a convolutional autoencoder as feature extractor. The proposed architecture will be applied to TripAdvisor data, using users' reviews that can be defined as a triad composed by a user, a restaurant, and an image of it taken by the user.
  arXiv  Detail & Related papers  (2020-03-13T11:19:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.