COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles

• URL: http://arxiv.org/abs/2502.08674v1
• Date: Wed, 12 Feb 2025 03:32:28 GMT
• Title: COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles
• Authors: Dongliang Zhou, Haijun Zhang, Qun Li, Jianghong Ma, Xiaofei Xu,
• Abstract summary: We propose the new task of generating complementary and compatible fashion items based on an arbitrary number of given fashion items. In particular, given some fashion items that can make up an outfit, the aim of this paper is to synthesize photo-realistic images of other, complementary, fashion items that are compatible with the given ones. To achieve this, we propose an outfit generation framework, referred to as COutfitGAN, which includes a pyramid style extractor, an outfit generator, a UNet-based real/fake discriminator, and a collocation discriminator.
• Score: 23.301719420997927
• License:
• Abstract: How to recommend outfits has gained considerable attention in both academia and industry in recent years. Many studies have been carried out regarding fashion compatibility learning, to determine whether the fashion items in an outfit are compatible or not. These methods mainly focus on evaluating the compatibility of existing outfits and rarely consider applying such knowledge to 'design' new fashion items. We propose the new task of generating complementary and compatible fashion items based on an arbitrary number of given fashion items. In particular, given some fashion items that can make up an outfit, the aim of this paper is to synthesize photo-realistic images of other, complementary, fashion items that are compatible with the given ones. To achieve this, we propose an outfit generation framework, referred to as COutfitGAN, which includes a pyramid style extractor, an outfit generator, a UNet-based real/fake discriminator, and a collocation discriminator. To train and evaluate this framework, we collected a large-scale fashion outfit dataset with over 200K outfits and 800K fashion items from the Internet. Extensive experiments show that COutfitGAN outperforms other baselines in terms of similarity, authenticity, and compatibility measurements.

Related papers

• Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework [59.09707044733695]
  We propose a novel outfit generation framework, i.e., OutfitGAN, with the aim of synthesizing an entire outfit. OutfitGAN includes a semantic alignment module, which is responsible for characterizing the mapping correspondence between the existing fashion items and the synthesized ones. In order to evaluate the performance of our proposed models, we built a large-scale dataset consisting of 20,000 fashion outfits.
  arXiv  Detail & Related papers  (2025-02-05T12:13:53Z)
• FashionReGen: LLM-Empowered Fashion Report Generation [61.84580616045145]
  We propose an intelligent Fashion Analyzing and Reporting system based on advanced Large Language Models (LLMs) Specifically, it tries to deliver FashionReGen based on effective catwalk analysis, which is equipped with several key procedures. It also inspires the explorations of more high-level tasks with industrial significance in other domains.
  arXiv  Detail & Related papers  (2024-03-11T12:29:35Z)
• Social Media Fashion Knowledge Extraction as Captioning [61.41631195195498]
  We study the task of social media fashion knowledge extraction. We transform the fashion knowledges into a natural language caption with a sentence transformation method. Our framework then aims to generate the sentence-based fashion knowledge directly from the social media post.
  arXiv  Detail & Related papers  (2023-09-28T09:07:48Z)
• Learning Fashion Compatibility from In-the-wild Images [6.591937706757015]
  We propose to learn representations for compatibility prediction from in-the-wild street fashion images through self-supervised learning. Our pretext task is formulated such that the representations of different items worn by the same person are closer compared to those worn by other people. We conduct experiments on two popular fashion compatibility benchmarks - Polyvore and Polyvore-Disjoint outfits.
  arXiv  Detail & Related papers  (2022-06-13T09:05:25Z)
• Recommendation of Compatible Outfits Conditioned on Style [22.03522251199042]
  This work aims to generate outfits conditional on styles or themes as one would dress in real life. We use a novel style encoder network that renders outfit styles in a smooth latent space.
  arXiv  Detail & Related papers  (2022-03-30T09:23:32Z)
• Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing [85.74977256940855]
  We propose an Arbitrary Virtual Try-On Network (AVTON) for all-type clothes. AVTON can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person. Our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.
  arXiv  Detail & Related papers  (2021-11-24T08:59:56Z)
• Semi-Supervised Visual Representation Learning for Fashion Compatibility [17.893627646979038]
  We propose a semi-supervised learning approach to create pseudo-positive and pseudo-negative outfits on the fly during training. For each labeled outfit in a training batch, we obtain a pseudo-outfit by matching each item in the labeled outfit with unlabeled items. We conduct extensive experiments on Polyvore, Polyvore-D and our newly created large-scale Fashion Outfits datasets.
  arXiv  Detail & Related papers  (2021-09-16T15:35:38Z)
• Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach [71.63618051547144]
  We study the problem of personalized fashion recommendation from social media data. We present an item-to-set metric learning framework that learns to compute the similarity between a set of historical fashion items of a user to a new fashion item. To validate the effectiveness of our approach, we collect a real-world social media dataset.
  arXiv  Detail & Related papers  (2020-05-25T23:24:24Z)
• Fashion Recommendation and Compatibility Prediction Using Relational Network [18.13692056232815]
  We develop a Relation Network (RN) to develop new compatibility learning models. FashionRN learns the compatibility of an entire outfit, with an arbitrary number of items, in an arbitrary order. We evaluate our model using a large dataset of 49,740 outfits that we collected from Polyvore website.
  arXiv  Detail & Related papers  (2020-05-13T21:00:54Z)
• Learning Diverse Fashion Collocation by Neural Graph Filtering [78.9188246136867]
  We propose a novel fashion collocation framework, Neural Graph Filtering, that models a flexible set of fashion items via a graph neural network. By applying symmetric operations on the edge vectors, this framework allows varying numbers of inputs/outputs and is invariant to their ordering. We evaluate the proposed approach on three popular benchmarks, the Polyvore dataset, the Polyvore-D dataset, and our reorganized Amazon Fashion dataset.
  arXiv  Detail & Related papers  (2020-03-11T16:17:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.