Design-time Fashion Popularity Forecasting in VR Environments

• URL: http://arxiv.org/abs/2212.07187v1
• Date: Wed, 14 Dec 2022 12:30:03 GMT
• Title: Design-time Fashion Popularity Forecasting in VR Environments
• Authors: Stefanos-Iordanis Papadopoulos, Christos Koutlis, Anastasios Papazoglou-Chalikias, Symeon Papadopoulos, Spiros Nikolopoulos
• Abstract summary: We develop a computer vision pipeline fine tuned on fashion imagery to extract relevant visual features. We propose MuQAR, a Multimodal Quasi-AutoRegressive neural network that forecasts the popularity of new garments. Both the proposed HLS and MuQAR prove capable of surpassing the current state-of-the-art in key benchmark datasets.
• Score: 9.621518697689128
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Being able to forecast the popularity of new garment designs is very important in an industry as fast paced as fashion, both in terms of profitability and reducing the problem of unsold inventory. Here, we attempt to address this task in order to provide informative forecasts to fashion designers within a virtual reality designer application that will allow them to fine tune their creations based on current consumer preferences within an interactive and immersive environment. To achieve this we have to deal with the following central challenges: (1) the proposed method should not hinder the creative process and thus it has to rely only on the garment's visual characteristics, (2) the new garment lacks historical data from which to extrapolate their future popularity and (3) fashion trends in general are highly dynamical. To this end, we develop a computer vision pipeline fine tuned on fashion imagery in order to extract relevant visual features along with the category and attributes of the garment. We propose a hierarchical label sharing (HLS) pipeline for automatically capturing hierarchical relations among fashion categories and attributes. Moreover, we propose MuQAR, a Multimodal Quasi-AutoRegressive neural network that forecasts the popularity of new garments by combining their visual features and categorical features while an autoregressive neural network is modelling the popularity time series of the garment's category and attributes. Both the proposed HLS and MuQAR prove capable of surpassing the current state-of-the-art in key benchmark datasets, DeepFashion for image classification and VISUELLE for new garment sales forecasting.

Related papers

• VICTOR: Visual Incompatibility Detection with Transformers and Fashion-specific contrastive pre-training [18.753508811614644]
  Visual InCompatibility TransfORmer (VICTOR) is optimized for two tasks: 1) overall compatibility as regression and 2) the detection of mismatching items. We build upon the Polyvore outfit benchmark to generate partially mismatching outfits, creating a new dataset termed Polyvore-MISFITs. A series of ablation and comparative analyses show that the proposed architecture can compete and even surpass the current state-of-the-art on Polyvore datasets.
  arXiv  Detail & Related papers  (2022-07-27T11:18:55Z)
• Multimodal Quasi-AutoRegression: Forecasting the visual popularity of new fashion products [18.753508811614644]
  Trend detection in fashion is a challenging task due to the fast pace of change in the fashion industry. We propose MuQAR, a multi-modal multi-layer perceptron processing categorical and visual features extracted by computer vision networks. A comparative study on the VISUELLE dataset, shows that MuQAR is capable of competing and surpassing the domain's current state of the art by 2.88% in terms of WAPE and 3.04% in terms of MAE.
  arXiv  Detail & Related papers  (2022-04-08T11:53:54Z)
• Style-Based Global Appearance Flow for Virtual Try-On [119.95115739956661]
  A novel global appearance flow estimation model is proposed in this work. Experiment results on a popular virtual try-on benchmark show that our method achieves new state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-04-03T10:58:04Z)
• Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing [85.74977256940855]
  We propose an Arbitrary Virtual Try-On Network (AVTON) for all-type clothes. AVTON can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person. Our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.
  arXiv  Detail & Related papers  (2021-11-24T08:59:56Z)
• Leveraging Multiple Relations for Fashion Trend Forecasting Based on Social Media [72.06420633156479]
  We propose an improved model named Relation Enhanced Attention Recurrent (REAR) network. Compared to KERN, the REAR model leverages not only the relations among fashion elements but also those among user groups. To further improve the performance of long-range trend forecasting, the REAR method devises a sliding temporal attention mechanism.
  arXiv  Detail & Related papers  (2021-05-07T14:52:03Z)
• Cloth Interactive Transformer for Virtual Try-On [106.21605249649957]
  We propose a novel two-stage cloth interactive transformer (CIT) method for the virtual try-on task. In the first stage, we design a CIT matching block, aiming to precisely capture the long-range correlations between the cloth-agnostic person information and the in-shop cloth information. In the second stage, we put forth a CIT reasoning block for establishing global mutual interactive dependencies among person representation, the warped clothing item, and the corresponding warped cloth mask.
  arXiv  Detail & Related papers  (2021-04-12T14:45:32Z)
• A Federated Approach for Fine-Grained Classification of Fashion Apparel [4.328969982631974]
  This paper aims to enable an in-depth classification of fashion item attributes within the same category. The proposed scheme is comprised of three major stages: (a) localization of a target item from an input image using semantic segmentation, (b) detection of human key points (e.g., point of shoulder) using a pre-trained CNN and a bounding box, and (c) three phases to classify the attributes using a combination of algorithmic approaches and deep neural networks.
  arXiv  Detail & Related papers  (2020-08-27T19:44:43Z)
• Addressing the Cold-Start Problem in Outfit Recommendation Using Visual Preference Modelling [51.147871738838305]
  This paper attempts to address the cold-start problem for new users by leveraging a novel visual preference modelling approach. We demonstrate the use of our approach with feature-weighted clustering to personalise occasion-oriented outfit recommendation.
  arXiv  Detail & Related papers  (2020-08-04T10:07:09Z)
• Knowledge Enhanced Neural Fashion Trend Forecasting [81.2083786318119]
  This work focuses on investigating fine-grained fashion element trends for specific user groups. We first contribute a large-scale fashion trend dataset (FIT) collected from Instagram with extracted time series fashion element records and user information. We propose a Knowledge EnhancedRecurrent Network model (KERN) which takes advantage of the capability of deep recurrent neural networks in modeling time-series data.
  arXiv  Detail & Related papers  (2020-05-07T07:42:17Z)
• Using Artificial Intelligence to Analyze Fashion Trends [0.76146285961466]
  This study proposes a data-driven quantitative abstracting approach using an artificial intelligence (A.I.) algorithm. An A.I. model was trained on fashion images from a large-scale dataset under different scenarios. It was found that the A.I. model can generate rich descriptions of detected regions and accurately bind the garments in the images.
  arXiv  Detail & Related papers  (2020-05-03T04:46:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.