Dual-Diffusional Generative Fashion Recommendation

• URL: http://arxiv.org/abs/2605.17357v1
• Date: Sun, 17 May 2026 09:52:18 GMT
• Title: Dual-Diffusional Generative Fashion Recommendation
• Abstract summary: We propose DualFashion, a Dual-Diffusional Generative Fashion Recommendation Architecture.<n>The proposed architecture produces both fashion item images and textual descriptions.<n>Experiments on iFashion and Polyvore-U across Personalized Fill-in-the-Blank and Generative Outfit Recommendation tasks demonstrate that DualFashion achieves strong performance.
• Score: 34.16599050803813
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Personalized generative recommender systems have emerged as a promising solution for fashion recommendation. However, existing methods primarily rely on implicit visual embeddings from historical interactions, which often contain preference-irrelevant information and result in insufficient user behavior modeling. Moreover, these models typically generate only item images, providing limited interpretability. To address these limitations, we propose DualFashion, a Dual-Diffusional Generative Fashion Recommendation Architecture that jointly models image and text modalities for personalized and explainable recommendation. DualFashion adopts a dual-diffusion Transformer with image and text branches, where structured attribute-level captions and visual outfit information are jointly used as conditioning signals to model user behavior. The proposed architecture produces both fashion item images and textual descriptions, ensuring visual compatibility while providing explicit semantic interpretability. Furthermore, we introduce a text-augmented fine-tuning strategy that enhances generation diversity and enables effective cross-modal knowledge transfer without incurring heavy computational costs. Extensive experiments on iFashion and Polyvore-U across Personalized Fill-in-the-Blank and Generative Outfit Recommendation tasks demonstrate that DualFashion achieves strong performance in behavior modeling, interpretability, and efficiency compared to state-of-the-art methods. Our code and model checkpoints are available at https://github.com/LinkMingzhe/DualFashion.

Related papers

• VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis [37.779702074028044]
  VersaVogue is a unified framework for controllable fashion synthesis.<n>It supports garment generation and virtual dressing, corresponding to the design and showcase stages of the fashion lifecycle.
  arXiv  Detail & Related papers  (2026-04-08T15:31:30Z)
• RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning [88.14234949860105]
  RePrompt is a novel reprompting framework that introduces explicit reasoning into the prompt enhancement process via reinforcement learning.<n>Our approach enables end-to-end training without human-annotated data.
  arXiv  Detail & Related papers  (2025-05-23T06:44:26Z)
• DRC: Enhancing Personalized Image Generation via Disentangled Representation Composition [69.10628479553709]
  We introduce DRC, a novel personalized image generation framework that enhances Large Multimodal Models (LMMs)<n> DRC explicitly extracts user style preferences and semantic intentions from history images and the reference image, respectively.<n>It involves two critical learning stages: 1) Disentanglement learning, which employs a dual-tower disentangler to explicitly separate style and semantic features, optimized via a reconstruction-driven paradigm with difficulty-aware importance sampling; and 2) Personalized modeling, which applies semantic-preserving augmentations to effectively adapt the disentangled representations for robust personalized generation.
  arXiv  Detail & Related papers  (2025-04-24T08:10:10Z)
• Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework [59.09707044733695]
  We propose a novel outfit generation framework, i.e., OutfitGAN, with the aim of synthesizing an entire outfit.<n> OutfitGAN includes a semantic alignment module, which is responsible for characterizing the mapping correspondence between the existing fashion items and the synthesized ones.<n>In order to evaluate the performance of our proposed models, we built a large-scale dataset consisting of 20,000 fashion outfits.
  arXiv  Detail & Related papers  (2025-02-05T12:13:53Z)
• Personalized Fashion Recommendation with Image Attributes and Aesthetics Assessment [15.423307815155534]
  We aim to provide more accurate personalized fashion recommendations by converting available information, especially images, into two graphs attribute.<n>Compared with previous methods that separate image and text as two components, the proposed method combines image and text information to create a richer attributes graph.<n>Preliminary experiments on the IQON3000 dataset have shown that the proposed method achieves competitive accuracy compared with baselines.
  arXiv  Detail & Related papers  (2025-01-06T15:31:10Z)
• Fashionability-Enhancing Outfit Image Editing with Conditional Diffusion Models [8.632093933229678]
  This paper presents a novel diffusion model-based approach that generates fashion images with improved fashionability while maintaining control over key attributes.<n>Key components of our method include: 1) fashionability enhancement, which ensures that the generated images are more fashionable than the input; 2) preservation of body characteristics, encouraging the generated images to maintain the original shape and proportions of the input; and 3) automatic fashion optimization, which does not rely on manual input or external prompts.
  arXiv  Detail & Related papers  (2024-12-24T13:27:25Z)
• Improving Diffusion Models for Authentic Virtual Try-on in the Wild [53.96244595495942]
  This paper considers image-based virtual try-on, which renders an image of a person wearing a curated garment. We propose a novel diffusion model that improves garment fidelity and generates authentic virtual try-on images. We present a customization method using a pair of person-garment images, which significantly improves fidelity and authenticity.
  arXiv  Detail & Related papers  (2024-03-08T08:12:18Z)
• Style Aligned Image Generation via Shared Attention [61.121465570763085]
  We introduce StyleAligned, a technique designed to establish style alignment among a series of generated images. By employing minimal attention sharing' during the diffusion process, our method maintains style consistency across images within T2I models. Our method's evaluation across diverse styles and text prompts demonstrates high-quality and fidelity.
  arXiv  Detail & Related papers  (2023-12-04T18:55:35Z)
• ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Models [0.0]
  Arbitrary Style Transfer (AST) aims to transform images by adopting the style from any selected artwork. We propose a new approach, ArtFusion, which provides a flexible balance between content and style.
  arXiv  Detail & Related papers  (2023-06-15T17:58:36Z)
• FashionTex: Controllable Virtual Try-on with Text and Texture [29.7855591607239]
  We propose a multi-modal interactive setting by combining the advantages of both text and texture for multi-level fashion manipulation. FashionTex framework can semantically control cloth types and local texture patterns without annotated pairwise training data.
  arXiv  Detail & Related papers  (2023-05-08T04:10:36Z)
• M6-Fashion: High-Fidelity Multi-modal Image Generation and Editing [51.033376763225675]
  We adapt style prior knowledge and flexibility of multi-modal control into one unified two-stage framework, M6-Fashion, focusing on the practical AI-aided Fashion design. M6-Fashion utilizes self-correction for the non-autoregressive generation to improve inference speed, enhance holistic consistency, and support various signal controls.
  arXiv  Detail & Related papers  (2022-05-24T01:18:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.