LPH-VTON: Resolving the Structure-Texture Dilemma of Virtual Try-On via Latent Process Handover
- URL: http://arxiv.org/abs/2605.14874v1
- Date: Thu, 14 May 2026 14:18:56 GMT
- Title: LPH-VTON: Resolving the Structure-Texture Dilemma of Virtual Try-On via Latent Process Handover
- Abstract summary: Virtual Try-On aims to synthesize photorealistic images of garments precisely aligned with a person's body and pose.<n>Current diffusion-based methods, however, face a fundamental trade-off between structural integrity and textural fidelity.<n>We propose LPH-VTON, a new synergistic framework that resolves this tension within a single, continuous denoising process.
- Score: 15.242291833451882
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Virtual Try-On (VTON) aims to synthesize photorealistic images of garments precisely aligned with a person's body and pose. Current diffusion-based methods, however, face a fundamental trade-off between structural integrity and textural fidelity. In this paper, we formalize this challenge as a consequence of complementary inductive biases inherent in prevailing architectures: models heavily reliant on spatial constraints naturally favor geometric alignment but often suppress textures, whereas models dominated by unconstrained generative priors excel at vibrant detail rendering but are prone to structural drift. Based on this diagnosis, we propose LPH-VTON, a new synergistic framework that resolves this tension within a single, continuous denoising process. LPH-VTON strategically decomposes the generation, leveraging a structure-biased model to establish a geometrically consistent latent scaffold in the early stages, before handing over control to a texture-biased model for high-fidelity detail rendering. Extensive experiments validate our approach. Our model achieves a superior Pareto-optimal balance, establishing new benchmarks in perceptual faithfulness while maintaining highly competitive structural alignment across the standard dataset VITON-HD, proving the efficacy of temporal architectural decoupling.
Related papers
- LHMCF-Net: A Learned Hyperbolic Mean Curvature Flow Network for Medical Images Segmentation [1.3366171693054767]
We develop a segmentation model that integrates feature space data fidelity and deep structural priors.<n>To solve the continuous LHMCF model, we construct a deep unfolding network, named LHMCF-Net.<n>Experiments on three publicly available medical segmentation datasets demonstrate that LHMCF-Net achieves superior performance.
arXiv Detail & Related papers (2026-08-21T10:05:30Z) - Structure-Detail Decoupled Autoregressive Generation for Fast and High-Fidelity Virtual Try-On [51.92060872944388]
Virtual try-on (VTON) is a bi-conditional image generation problem.<n> Diffusion-based VTON methods suffer from high-frequency detail loss due to inherent latent compression.<n>Recent visual autoregressive models offer a promising alternative for high-quality generation.
arXiv Detail & Related papers (2026-07-13T08:21:43Z) - IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation [9.17007090517294]
Few-step distillation targeting the Free Guidance trajectory has emerged as the prevalent dual-dimensional compression paradigm.<n>We re-examine the distillation procedure through the theoretical lens of Information Theory.<n>We propose an instance-aware selection mechanism that transmutes the intractable KL divergence constraint into a zero-overhead closed-form solution.
arXiv Detail & Related papers (2026-07-10T06:43:43Z) - Learning Spatio-Temporal Foundation Models from Pure Synthetic Data [85.23980441738811]
NeoST is a scalable synthetic-training corpus to real-world bias, a latent-space reasoning architecture that generates and iteratively refines multiple future trajectories, and latent-space objectives that emphasize structural dynamics and enable inference-time correction under distribution shifts.<n>Extensive experiments across diverse real-world benchmarks show that NeoST consistently outperforms existing STFMs in diverse real-worldtemporal systems.
arXiv Detail & Related papers (2026-06-27T02:56:46Z) - Spatial Gram Alignment for Ultra-High-Resolution Image Synthesis [38.08544812796336]
Modern ultra-high-resolution image synthesis relies heavily on the robust generative capacity of large-scale pre-trained Latent Diffusion Models (LDMs)<n>We propose a novel framework that explicitly leverages the representation priors of vision foundation models while preserving the native generative capacity of LDMs.
arXiv Detail & Related papers (2026-05-20T06:59:12Z) - Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers [93.3976834364707]
We propose sREPA, a structural REPresentation Alignment framework to enforce consistency in the relational geometry of feature maps.<n>By encouraging the model to internalize holistic spatial layouts and structural correlations from pre-trained features, sREPA achieves faster and more stable convergence.
arXiv Detail & Related papers (2026-05-16T12:01:04Z) - InpaintSLat: Inpainting Structured 3D Latents via Initial Noise Optimization [56.525920531932606]
We present a training-free approach for controllable 3D inpainting based on initial noise optimization.<n>In this paper, we introduce a strategy to optimize the initial noise within the structured 3D latent diffusion framework.
arXiv Detail & Related papers (2026-05-01T13:45:25Z) - RopeDreamer: A Kinematic Recurrent State Space Model for Dynamics of Flexible Deformable Linear Objects [12.045392054359551]
We propose a latent dynamics framework that combines a Recurrent State Space Model with a Quaternionic Kinematic Chain representation.<n>We evaluate our approach on a large-scale simulated dataset of complex pick-and-place trajectories involving self-intersections.<n>Our results demonstrate that the proposed model achieves a 40.52% reduction in open-loop prediction error over 50-step horizons compared to the state-of-the-art baseline.
arXiv Detail & Related papers (2026-04-30T17:47:44Z) - Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis [48.809049043865905]
Image deraining plays a pivotal role in low-level computer vision.<n>Deep learning paradigms often suffer from severe performance degradation when generalized to unseen Out-of-Distribution scenarios.<n>This paper proposes a pioneering cross-scenario deraining adaptation framework.
arXiv Detail & Related papers (2026-03-23T07:38:55Z) - Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework [52.632217600064344]
Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements.<n>FWI methods are limited by their notorious sensitivity to the accuracy of the initial models.<n>Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models.
arXiv Detail & Related papers (2026-03-23T03:22:33Z) - StepVAR: Structure-Texture Guided Pruning for Visual Autoregressive Models [98.72926158261937]
We propose a training-free token pruning framework for Visual AutoRegressive models.<n>We employ a lightweight high-pass filter to capture local texture details, while leveraging Principal Component Analysis (PCA) to preserve global structural information.<n>To maintain valid next-scale prediction under sparse tokens, we introduce a nearest neighbor feature propagation strategy.
arXiv Detail & Related papers (2026-03-02T11:35:05Z) - RichControl: Structure- and Appearance-Rich Training-Free Spatial Control for Text-to-Image Generation [10.956556608715035]
Text-to-image (T2I) diffusion models have shown remarkable success in generating high-quality images from text prompts.<n>We propose a flexible training-free framework that decouples the sampling schedule of condition features from the denoising process.<n>We further enhance the sampling process by introducing a restart refinement schedule, and improve the visual quality with an appearance-rich prompting strategy.
arXiv Detail & Related papers (2025-07-03T16:56:15Z) - DS-VTON: An Enhanced Dual-Scale Coarse-to-Fine Framework for Virtual Try-On [33.05238077456732]
We propose DS-VTON, an enhanced dual-scale coarse-to-fine framework for virtual try-on.<n> DS-VTON consists of two stages: the first generates a low-resolution try-on result to capture the semantic correspondence between garment and body.<n>In the second stage, a blend-refine diffusion process reconstructs high-resolution outputs by refining the residual between scales.
arXiv Detail & Related papers (2025-06-01T08:52:57Z) - Latent Traversals in Generative Models as Potential Flows [113.4232528843775]
We propose to model latent structures with a learned dynamic potential landscape.
Inspired by physics, optimal transport, and neuroscience, these potential landscapes are learned as physically realistic partial differential equations.
Our method achieves both more qualitatively and quantitatively disentangled trajectories than state-of-the-art baselines.
arXiv Detail & Related papers (2023-04-25T15:53:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.