Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach

• URL: http://arxiv.org/abs/2005.12439v1
• Date: Mon, 25 May 2020 23:24:24 GMT
• Title: Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach
• Authors: Haitian Zheng, Kefei Wu, Jong-Hwi Park, Wei Zhu, Jiebo Luo
• Abstract summary: We study the problem of personalized fashion recommendation from social media data. We present an item-to-set metric learning framework that learns to compute the similarity between a set of historical fashion items of a user to a new fashion item. To validate the effectiveness of our approach, we collect a real-world social media dataset.
• Score: 71.63618051547144
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data source for personalized fashion analysis. In this work, we study the problem of personalized fashion recommendation from social media data, i.e. recommending new outfits to social media users that fit their fashion preferences. To this end, we present an item-to-set metric learning framework that learns to compute the similarity between a set of historical fashion items of a user to a new fashion item. To extract features from multi-modal street-view fashion items, we propose an embedding module that performs multi-modality feature extraction and cross-modality gated fusion. To validate the effectiveness of our approach, we collect a real-world social media dataset. Extensive experiments on the collected dataset show the superior performance of our proposed approach.

Related papers

• Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrieval [2.07180164747172]
  We introduce a groundbreaking approach to fashion recommendations: text-to-outfit retrieval task that generates a complete outfit set based solely on textual descriptions. Our model is devised at three semantic levels-item, style, and outfit-where each level progressively aggregates data to form a coherent outfit recommendation. Using the Maryland Polyvore and Polyvore Outfit datasets, our approach significantly outperformed state-of-the-art models in text-video retrieval tasks.
  arXiv  Detail & Related papers  (2023-11-03T07:23:21Z)
• Social Media Fashion Knowledge Extraction as Captioning [61.41631195195498]
  We study the task of social media fashion knowledge extraction. We transform the fashion knowledges into a natural language caption with a sentence transformation method. Our framework then aims to generate the sentence-based fashion knowledge directly from the social media post.
  arXiv  Detail & Related papers  (2023-09-28T09:07:48Z)
• Sentiment Analysis of Fashion Related Posts in Social Media [36.623221002330226]
  We propose a novel framework that jointly leverages the image vision, post text, as well as fashion attribute modality to determine the sentiment category. Since there is no existing dataset suitable for this task, we prepare a large-scale sentiment analysis dataset of over 12k fashion related social media posts.
  arXiv  Detail & Related papers  (2021-11-15T14:58:09Z)
• Leveraging Multiple Relations for Fashion Trend Forecasting Based on Social Media [72.06420633156479]
  We propose an improved model named Relation Enhanced Attention Recurrent (REAR) network. Compared to KERN, the REAR model leverages not only the relations among fashion elements but also those among user groups. To further improve the performance of long-range trend forecasting, the REAR method devises a sliding temporal attention mechanism.
  arXiv  Detail & Related papers  (2021-05-07T14:52:03Z)
• Dual Side Deep Context-aware Modulation for Social Recommendation [50.59008227281762]
  We propose a novel graph neural network to model the social relation and collaborative relation. On top of high-order relations, a dual side deep context-aware modulation is introduced to capture the friends' information and item attraction.
  arXiv  Detail & Related papers  (2021-03-16T11:08:30Z)
• Addressing the Cold-Start Problem in Outfit Recommendation Using Visual Preference Modelling [51.147871738838305]
  This paper attempts to address the cold-start problem for new users by leveraging a novel visual preference modelling approach. We demonstrate the use of our approach with feature-weighted clustering to personalise occasion-oriented outfit recommendation.
  arXiv  Detail & Related papers  (2020-08-04T10:07:09Z)
• MMFashion: An Open-Source Toolbox for Visual Fashion Analysis [39.186485821323004]
  MMFashion is an open-source visual fashion analysis toolbox based on PyTorch. It supports a wide spectrum of fashion analysis tasks, including Fashion Attribute Prediction, Fashion Recognition and Retrieval, Fashion Landmark Detection, Fashion Parsing and Fashion Compatibility and Recommendation.
  arXiv  Detail & Related papers  (2020-05-18T16:19:00Z)
• Learning Diverse Fashion Collocation by Neural Graph Filtering [78.9188246136867]
  We propose a novel fashion collocation framework, Neural Graph Filtering, that models a flexible set of fashion items via a graph neural network. By applying symmetric operations on the edge vectors, this framework allows varying numbers of inputs/outputs and is invariant to their ordering. We evaluate the proposed approach on three popular benchmarks, the Polyvore dataset, the Polyvore-D dataset, and our reorganized Amazon Fashion dataset.
  arXiv  Detail & Related papers  (2020-03-11T16:17:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.