Fashion Recommendation and Compatibility Prediction Using Relational
Network
- URL: http://arxiv.org/abs/2005.06584v1
- Date: Wed, 13 May 2020 21:00:54 GMT
- Title: Fashion Recommendation and Compatibility Prediction Using Relational
Network
- Authors: Maryam Moosaei, Yusan Lin, Hao Yang
- Abstract summary: We develop a Relation Network (RN) to develop new compatibility learning models.
FashionRN learns the compatibility of an entire outfit, with an arbitrary number of items, in an arbitrary order.
We evaluate our model using a large dataset of 49,740 outfits that we collected from Polyvore website.
- Score: 18.13692056232815
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Fashion is an inherently visual concept and computer vision and artificial
intelligence (AI) are playing an increasingly important role in shaping the
future of this domain. Many research has been done on recommending fashion
products based on the learned user preferences. However, in addition to
recommending single items, AI can also help users create stylish outfits from
items they already have, or purchase additional items that go well with their
current wardrobe. Compatibility is the key factor in creating stylish outfits
from single items. Previous studies have mostly focused on modeling pair-wise
compatibility. There are a few approaches that consider an entire outfit, but
these approaches have limitations such as requiring rich semantic information,
category labels, and fixed order of items. Thus, they fail to effectively
determine compatibility when such information is not available. In this work,
we adopt a Relation Network (RN) to develop new compatibility learning models,
Fashion RN and FashionRN-VSE, that addresses the limitations of existing
approaches. FashionRN learns the compatibility of an entire outfit, with an
arbitrary number of items, in an arbitrary order. We evaluated our model using
a large dataset of 49,740 outfits that we collected from Polyvore website.
Quantitatively, our experimental results demonstrate state of the art
performance compared with alternative methods in the literature in both
compatibility prediction and fill-in-the-blank test. Qualitatively, we also
show that the item embedding learned by FashionRN indicate the compatibility
among fashion items.
Related papers
- Clothes-Changing Person Re-Identification with Feasibility-Aware Intermediary Matching [86.04494755636613]
Current clothes-changing person re-identification (re-id) approaches usually perform retrieval based on clothes-irrelevant features.
We propose a Feasibility-Aware Intermediary Matching (FAIM) framework to additionally utilize clothes-relevant features for retrieval.
Our method outperforms state-of-the-art methods on several widely-used clothes-changing re-id benchmarks.
arXiv Detail & Related papers (2024-04-15T06:58:09Z) - Lost Your Style? Navigating with Semantic-Level Approach for
Text-to-Outfit Retrieval [2.07180164747172]
We introduce a groundbreaking approach to fashion recommendations: text-to-outfit retrieval task that generates a complete outfit set based solely on textual descriptions.
Our model is devised at three semantic levels-item, style, and outfit-where each level progressively aggregates data to form a coherent outfit recommendation.
Using the Maryland Polyvore and Polyvore Outfit datasets, our approach significantly outperformed state-of-the-art models in text-video retrieval tasks.
arXiv Detail & Related papers (2023-11-03T07:23:21Z) - VICTOR: Visual Incompatibility Detection with Transformers and
Fashion-specific contrastive pre-training [18.753508811614644]
Visual InCompatibility TransfORmer (VICTOR) is optimized for two tasks: 1) overall compatibility as regression and 2) the detection of mismatching items.
We build upon the Polyvore outfit benchmark to generate partially mismatching outfits, creating a new dataset termed Polyvore-MISFITs.
A series of ablation and comparative analyses show that the proposed architecture can compete and even surpass the current state-of-the-art on Polyvore datasets.
arXiv Detail & Related papers (2022-07-27T11:18:55Z) - Learning Fashion Compatibility from In-the-wild Images [6.591937706757015]
We propose to learn representations for compatibility prediction from in-the-wild street fashion images through self-supervised learning.
Our pretext task is formulated such that the representations of different items worn by the same person are closer compared to those worn by other people.
We conduct experiments on two popular fashion compatibility benchmarks - Polyvore and Polyvore-Disjoint outfits.
arXiv Detail & Related papers (2022-06-13T09:05:25Z) - Fashionformer: A simple, Effective and Unified Baseline for Human
Fashion Segmentation and Recognition [80.74495836502919]
In this work, we focus on joint human fashion segmentation and attribute recognition.
We introduce the object query for segmentation and the attribute query for attribute prediction.
For attribute stream, we design a novel Multi-Layer Rendering module to explore more fine-grained features.
arXiv Detail & Related papers (2022-04-10T11:11:10Z) - Recommendation of Compatible Outfits Conditioned on Style [22.03522251199042]
This work aims to generate outfits conditional on styles or themes as one would dress in real life.
We use a novel style encoder network that renders outfit styles in a smooth latent space.
arXiv Detail & Related papers (2022-03-30T09:23:32Z) - Arbitrary Virtual Try-On Network: Characteristics Preservation and
Trade-off between Body and Clothing [85.74977256940855]
We propose an Arbitrary Virtual Try-On Network (AVTON) for all-type clothes.
AVTON can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person.
Our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.
arXiv Detail & Related papers (2021-11-24T08:59:56Z) - Learning Tuple Compatibility for Conditional OutfitRecommendation [13.265372545945112]
Mixed Category Attention Net (MCAN) integrates fine-grained and coarse category information into recommendation.
MCAN can explicitly and effectively generate diverse and controllable recommendations based on need.
New dataset IQON can be used to test the generalization of recommendation systems.
arXiv Detail & Related papers (2020-08-18T23:22:16Z) - Addressing the Cold-Start Problem in Outfit Recommendation Using Visual
Preference Modelling [51.147871738838305]
This paper attempts to address the cold-start problem for new users by leveraging a novel visual preference modelling approach.
We demonstrate the use of our approach with feature-weighted clustering to personalise occasion-oriented outfit recommendation.
arXiv Detail & Related papers (2020-08-04T10:07:09Z) - Personalized Fashion Recommendation from Personal Social Media Data: An
Item-to-Set Metric Learning Approach [71.63618051547144]
We study the problem of personalized fashion recommendation from social media data.
We present an item-to-set metric learning framework that learns to compute the similarity between a set of historical fashion items of a user to a new fashion item.
To validate the effectiveness of our approach, we collect a real-world social media dataset.
arXiv Detail & Related papers (2020-05-25T23:24:24Z) - Learning Diverse Fashion Collocation by Neural Graph Filtering [78.9188246136867]
We propose a novel fashion collocation framework, Neural Graph Filtering, that models a flexible set of fashion items via a graph neural network.
By applying symmetric operations on the edge vectors, this framework allows varying numbers of inputs/outputs and is invariant to their ordering.
We evaluate the proposed approach on three popular benchmarks, the Polyvore dataset, the Polyvore-D dataset, and our reorganized Amazon Fashion dataset.
arXiv Detail & Related papers (2020-03-11T16:17:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.