Layering Virtual Try-On
- URL: http://arxiv.org/abs/2607.22924v1
- Date: Fri, 24 Jul 2026 21:25:58 GMT
- Title: Layering Virtual Try-On
- Abstract summary: Existing Virtual Try-On methods excel at single-layer replacement but are not designed to layer or de-layer an existing outfit.<n>This paper proposes Layering Virtual Try-On (LVTON), a layering benchmark and method that preserves an existing outfit while enabling sequential layering.
- Score: 12.074302866636884
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the real world, fashion is about layering: adding a jacket over a shirt, or a sequence of adding and removing layers, rather than just a single-layer swap. This fundamental real-world task remains a challenge in existing Virtual Try-On (VTON) methods, which excel at single-layer replacement but are not designed to layer or de-layer an existing outfit. This paper proposes Layering Virtual Try-On (LVTON), a layering benchmark and method that preserves an existing outfit while enabling sequential layering. We find that current VTON paradigms are fundamentally ill-equipped for LVTON, as their reliance on cloth-agnostic representations and single-item datasets discards essential layering context. Our key insight is that the LVTON challenge must be disentangled into two distinct competencies: (1) General VTON Priors (e.g., deformation, identity preservation) and (2) Specific Layering Knowledge (e.g., layering order and occlusion reasoning). First, our model obtains general VTON priors by being trained on data produced by an automatic data generation pipeline that synthesizes samples from fashion videos via segmentation and inpainting. Second, the model is fine-tuned on a small, dedicated LVTON dataset to learn the layering logic. Our method achieves state-of-the-art results on our LVTON benchmark and demonstrates superior generalizability on traditional VTON benchmarks, setting new state-of-the-art results when fine-tuned and exhibiting zero-shot capabilities.
Related papers
- Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On [50.93194436640413]
Oxygen-TryOn is a unified foundation model for any-item virtual try-on.<n>It is built for try-on through a dedicated data engine and try-on-specific training.
arXiv Detail & Related papers (2026-07-23T17:45:56Z) - Structure-Detail Decoupled Autoregressive Generation for Fast and High-Fidelity Virtual Try-On [51.92060872944388]
Virtual try-on (VTON) is a bi-conditional image generation problem.<n> Diffusion-based VTON methods suffer from high-frequency detail loss due to inherent latent compression.<n>Recent visual autoregressive models offer a promising alternative for high-quality generation.
arXiv Detail & Related papers (2026-07-13T08:21:43Z) - OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework [16.89102936125974]
We propose OmniDiT, an omni Virtual Try-On framework based on the Diffusion Transformer.<n>We first establish a self-evolving data curation pipeline to continuously produce data, and construct a large VTON dataset Omni-TryOn.<n>We are the first to introduce Shifted Window Attention into the diffusion model, thus achieving a linear complexity.
arXiv Detail & Related papers (2026-03-20T05:04:55Z) - GO-MLVTON: Garment Occlusion-Aware Multi-Layer Virtual Try-On with Diffusion Models [37.32099831689131]
Existing image-based virtual try-on (VTON) methods primarily focus on single-layer or multi-garment VTON.<n>We propose GO-MLVTON, the first multi-layer VTON method, introducing the Garment Occlusion Learning module and the StableDiffusion-based Garment Morphing & Fitting module.<n>We present the MLG dataset for this task and propose a new metric named Layered Appearance Coherence Difference (LACD) for evaluation.
arXiv Detail & Related papers (2026-01-20T02:20:34Z) - Rethinking Garment Conditioning in Diffusion-based Virtual Try-On [7.386027762996787]
We develop Re-CatVTON, an efficient single UNet model that achieves high performance.<n>The proposed Re-CatVTON significantly improves performance compared to its predecessor.<n>Our results demonstrate improved FID, KID, and LPIPS scores, with only a marginal decrease in SSIM.
arXiv Detail & Related papers (2025-11-24T05:19:44Z) - Undress to Redress: A Training-Free Framework for Virtual Try-On [19.00614787972817]
We propose UR-VTON (Undress-Redress Virtual Try-ON), a training-free framework that can be seamlessly integrated with any existing VTON method.<n> UR-VTON introduces an ''undress-to-redress'' mechanism: it first reveals the user's torso by virtually ''undressing'', then applies the target short-sleeve garment.<n>We also present LS-TON, a new benchmark for long-sleeve-to-short-sleeve try-on.
arXiv Detail & Related papers (2025-08-11T06:55:49Z) - OmniVTON: Training-Free Universal Virtual Try-On [53.31945401098557]
Image-based Virtual Try-On (VTON) techniques rely on either supervised in-shop approaches, or unsupervised in-the-wild methods, which improve adaptability but remain constrained by data biases and limited universality.<n>We propose OmniVTON, the first training-free universal VTON framework that decouples garment and pose conditioning to achieve both texture fidelity and pose consistency across diverse settings.
arXiv Detail & Related papers (2025-07-20T16:37:53Z) - MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Input [69.33864837012202]
We propose a Mask-Free VITON framework that achieves realistic VITON using only a single person image and a target garment.<n>We leverage existing Mask-based VITON models to synthesize a high-quality dataset.<n>This dataset contains diverse, realistic pairs of person images and corresponding garments, augmented with varied backgrounds to mimic real-world scenarios.
arXiv Detail & Related papers (2025-03-11T17:40:59Z) - CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models [77.39903417768967]
CatVTON is a virtual try-on diffusion model that transfers in-shop or worn garments of arbitrary categories to target individuals.<n>CatVTON consists only of a VAE and a simplified denoising UNet, removing redundant image and text encoders.<n>Experiments demonstrate that CatVTON achieves superior qualitative and quantitative results compared to baseline methods.
arXiv Detail & Related papers (2024-07-21T11:58:53Z) - WAS-VTON: Warping Architecture Search for Virtual Try-on Network [57.52118202523266]
We introduce a NAS-Warping Module and elaborately design a bilevel hierarchical search space.
We learn a combination of repeatable warping cells and convolution operations specifically for the clothing-person alignment.
A NAS-Fusion Module is proposed to synthesize more natural final try-on results.
arXiv Detail & Related papers (2021-08-01T07:52:56Z) - LV-BERT: Exploiting Layer Variety for BERT [85.27287501885807]
We introduce convolution into the layer type set, which is experimentally found beneficial to pre-trained models.
We then adopt an evolutionary algorithm guided by pre-training accuracy to find the optimal architecture.
LV-BERT model obtained by our method outperforms BERT and its variants on various downstream tasks.
arXiv Detail & Related papers (2021-06-22T13:20:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.