PROMO: Promptable Outfitting for Efficient High-Fidelity Virtual Try-On

• URL: http://arxiv.org/abs/2603.11675v1
• Date: Thu, 12 Mar 2026 08:41:05 GMT
• Title: PROMO: Promptable Outfitting for Efficient High-Fidelity Virtual Try-On
• Abstract summary: VTON is a structured image editing problem that demands strong conditional generation under three key requirements.<n>We present PROMO, a promptable virtual try-on framework built upon a Flow Matching DiT backbone with latent multi-modal conditional concatenation.<n>On standard benchmarks, PROMO surpasses both prior VTON methods and general image editing models in visual fidelity while delivering a competitive balance between quality and speed.
• Score: 39.47263059671598
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Virtual Try-on (VTON) has become a core capability for online retail, where realistic try-on results provide reliable fit guidance, reduce returns, and benefit both consumers and merchants. Diffusion-based VTON methods achieve photorealistic synthesis, yet often rely on intricate architectures such as auxiliary reference networks and suffer from slow sampling, making the trade-off between fidelity and efficiency a persistent challenge. We approach VTON as a structured image editing problem that demands strong conditional generation under three key requirements: subject preservation, faithful texture transfer, and seamless harmonization. Under this perspective, our training framework is generic and transfers to broader image editing tasks. Moreover, the paired data produced by VTON constitutes a rich supervisory resource for training general-purpose editors. We present PROMO, a promptable virtual try-on framework built upon a Flow Matching DiT backbone with latent multi-modal conditional concatenation. By leveraging conditioning efficiency and self-reference mechanisms, our approach substantially reduces inference overhead. On standard benchmarks, PROMO surpasses both prior VTON methods and general image editing models in visual fidelity while delivering a competitive balance between quality and speed. These results demonstrate that flow-matching transformers, coupled with latent multi-modal conditioning and self-reference acceleration, offer an effective and training-efficient solution for high-quality virtual try-on.

Related papers

• TAMF-VTON: Texture-Aware Mask-Free Virtual Try-On via High-Fidelity Image Synthesis [18.0381961459164]
  TAMF-VTON is a texture-aware, mask-free framework that enables high-fidelity image synthesis.<n>Our method requires no human parsing or inpainting masks at inference time.<n>It supports diverse garment styles, categories, and quantities, enabling the simultaneous transfer of multiple items.
  arXiv  Detail & Related papers  (2026-07-16T10:26:27Z)
• Improving Visual Representation Alignment Generation with GRPO [51.071351994330605]
  diffusion transformers have demonstrated strong image synthesis capabilities but remain inefficient to train due to weak alignment.<n>We propose VRPO, a reinforcement-based optimization strategy that replaces REPA's static alignment loss with a generative representation policy optimization objective.<n>Our VRPO-driven training seamlessly integrates into diffusion transformers, introducing negligible cost and preserving full compatibility with SiT and DiT architectures.
  arXiv  Detail & Related papers  (2026-05-30T07:21:40Z)
• A Systematic Post-Train Framework for Video Generation [76.26555417456773]
  Large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content.<n>A significant gap remains between their pretraining performance and real-world deployment requirements due to critical issues such as prompt sensitivity, temporal inconsistency, and prohibitive inference costs.<n>We propose a comprehensive post-training framework that systematically aligns pretrained models with user intentions through four synergistic stages.
  arXiv  Detail & Related papers  (2026-04-28T09:34:51Z)
• Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models [26.002982722748726]
  ResFlow-Tuner is an image restoration framework based on the state-of-the-art flow matching model, FLUX.1-dev.<n>We propose a training-free test-time scaling paradigm tailored for image restoration.
  arXiv  Detail & Related papers  (2026-03-23T14:33:43Z)
• OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework [16.89102936125974]
  We propose OmniDiT, an omni Virtual Try-On framework based on the Diffusion Transformer.<n>We first establish a self-evolving data curation pipeline to continuously produce data, and construct a large VTON dataset Omni-TryOn.<n>We are the first to introduce Shifted Window Attention into the diffusion model, thus achieving a linear complexity.
  arXiv  Detail & Related papers  (2026-03-20T05:04:55Z)
• VTONGuard: Automatic Detection and Authentication of AI-Generated Virtual Try-On Content [18.869017622630647]
  We present VTONGuard, a benchmark dataset containing over 775,000 real and synthetic try-on images.<n>The dataset covers diverse real-world conditions, including variations in pose, background, and garment styles.<n>Our results reveal each method's strengths and weaknesses and highlight the persistent challenge of cross-paradigm generalization.
  arXiv  Detail & Related papers  (2026-01-20T13:26:06Z)
• DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transform [11.691992316667287]
  Diffusion models enable high-quality virtual try-on (VTO) with their established image synthesis abilities.<n>Doob's h-transform efficient fine-tuning (DEFT) for adapting large pre-trained unconditional models for downstream image-conditioned VTO abilities.<n>DEFT freezes the pre-trained model's parameters and trains a small h-transform network to learn a conditional h-transform.
  arXiv  Detail & Related papers  (2025-09-16T20:11:48Z)
• Enhancing Variational Autoencoders with Smooth Robust Latent Encoding [54.74721202894622]
  Variational Autoencoders (VAEs) have played a key role in scaling up diffusion-based generative models.<n>We introduce Smooth Robust Latent VAE, a novel adversarial training framework that boosts both generation quality and robustness.<n>Experiments show that SRL-VAE improves both generation quality, in image reconstruction and text-guided image editing, and robustness, against Nightshade attacks and image editing attacks.
  arXiv  Detail & Related papers  (2025-04-24T03:17:57Z)
• InvFussion: Bridging Supervised and Zero-shot Diffusion for Inverse Problems [76.39776789410088]
  This work introduces a framework that combines the strong performance of supervised approaches and the flexibility of zero-shot methods.<n>A novel architectural design seamlessly integrates the degradation operator directly into the denoiser.<n> Experimental results on the FFHQ and ImageNet datasets demonstrate state-of-the-art posterior-sampling performance.
  arXiv  Detail & Related papers  (2025-04-02T12:40:57Z)
• CTSR: Controllable Fidelity-Realness Trade-off Distillation for Real-World Image Super Resolution [52.93785843453579]
  Real-world image super-resolution is a critical image processing task, where two key evaluation criteria are the fidelity to the original image and the visual realness of the generated results.<n>We propose a distillation-based approach that leverages the geometric decomposition of both fidelity and realness, alongside the performance advantages of multiple teacher models.<n> Experiments conducted on several real-world image super-resolution benchmarks demonstrate that our method surpasses existing state-of-the-art approaches.
  arXiv  Detail & Related papers  (2025-03-18T14:06:39Z)
• ITVTON: Virtual Try-On Diffusion Transformer Based on Integrated Image and Text [1.7071356210178177]
  ITVTON is an efficient framework that leverages the Diffusion Transformer (DiT) as its single generator to improve image fidelity.<n>ITVTON effectively captures garment and person images along the width dimension and incorporating textual descriptions from both.<n>Experiments on 10,257 image pairs from IGPair confirm ITVTON's robustness in real-world scenarios.
  arXiv  Detail & Related papers  (2025-01-28T07:24:15Z)
• 1-2-1: Renaissance of Single-Network Paradigm for Virtual Try-On [17.226542332700607]
  We propose a novel single-network VTON method that overcomes the limitations of existing techniques.<n>Our method, namely MNVTON, introduces a Modality-specific Normalization strategy that separately processes text, image and video inputs.<n>Our results suggest that the single-network paradigm can rival the performance of dualnetwork approaches.
  arXiv  Detail & Related papers  (2025-01-09T16:49:04Z)
• ViR: Towards Efficient Vision Retention Backbones [97.93707844681893]
  We propose a new class of computer vision models, dubbed Vision Retention Networks (ViR) ViR has dual parallel and recurrent formulations, which strike an optimal balance between fast inference and parallel training with competitive performance. We have validated the effectiveness of ViR through extensive experiments with different dataset sizes and various image resolutions.
  arXiv  Detail & Related papers  (2023-10-30T16:55:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.