CtrlVTON: Controllable Virtual Try-On via Visual-Instance-Prompt Segmentation

• URL: http://arxiv.org/abs/2607.09362v1
• Date: Fri, 10 Jul 2026 12:40:06 GMT
• Title: CtrlVTON: Controllable Virtual Try-On via Visual-Instance-Prompt Segmentation
• Abstract summary: We develop a controllable VTO framework that recasts try-on as an image editing problem.<n>In particular, CtrlVTON generates images that follow user-provided layouts far more faithfully than the strongest proprietary editing systems.
• Score: 4.652822321195438
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Virtual try-on (VTO) has made significant progress in realistically transferring garments onto a target person. Yet most systems give the user little control over how a garment should be worn -- its size (loose or fitted), style (e.g., tucked in or untucked, open or closed), and spatial placement on the body. We address this gap with two complementary contributions. First, we define and solve Visual-Instance-Prompt Segmentation via VIP-SAM: given a flatlay image of a garment, segment that specific instance in a photograph of a person wearing it. This is an instance-level task, distinct from the typically studied category-level segmentation. Second, we introduce CtrlVTON, a controllable VTO framework that recasts try-on as an image editing problem and adds segmentation masks as pixel-level control over garment layout, including style, size, and spatial placement on the body. VIP-SAM and CtrlVTON each achieve state-of-the-art results on their respective tasks. In particular, CtrlVTON generates images that follow user-provided layouts far more faithfully than the strongest proprietary editing systems while matching them on garment fidelity.

Related papers

• FitControler: Toward Fit-Aware Virtual Try-On [54.18033917605626]
  Garment fit is a fundamental element in fashion design.<n>We introduce fit-aware VTON and present FitControler, a learnable plug-in that can seamlessly integrate into modern VTON models.<n>In particular, we build a fit-aware VTON dataset termed Fit4Men, including 13,000 body-garment pairs of different fits.
  arXiv  Detail & Related papers  (2025-12-30T06:31:19Z)
• OmniVTON: Training-Free Universal Virtual Try-On [53.31945401098557]
  Image-based Virtual Try-On (VTON) techniques rely on either supervised in-shop approaches, or unsupervised in-the-wild methods, which improve adaptability but remain constrained by data biases and limited universality.<n>We propose OmniVTON, the first training-free universal VTON framework that decouples garment and pose conditioning to achieve both texture fidelity and pose consistency across diverse settings.
  arXiv  Detail & Related papers  (2025-07-20T16:37:53Z)
• Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individuals [76.96387718150542]
  We present Text-Enhanced MUlti-category Virtual Try-Off (TEMU-VTOFF)<n>Our architecture is designed to receive garment information from multiple modalities like images, text, and masks to work in a multi-category setting.<n> Experiments on VITON-HD and Dress Code datasets show that TEMU-VTOFF sets a new state-of-the-art on the VTOFF task.
  arXiv  Detail & Related papers  (2025-05-27T11:47:51Z)
• MGT: Extending Virtual Try-Off to Multi-Garment Scenarios [8.158200403139196]
  We introduce Multi-Garment TryOffDiff (MGT), a diffusion-based VTOFF model capable of handling diverse garment types.<n>MGT incorporates class-specific embeddings, achieving state-of-the-art VTOFF results on VITON-HD and competitive performance on DressCode.
  arXiv  Detail & Related papers  (2025-04-17T16:45:18Z)
• IMAGDressing-v1: Customizable Virtual Dressing [58.44155202253754]
  IMAGDressing-v1 is a virtual dressing task that generates freely editable human images with fixed garments and optional conditions. IMAGDressing-v1 incorporates a garment UNet that captures semantic features from CLIP and texture features from VAE. We present a hybrid attention module, including a frozen self-attention and a trainable cross-attention, to integrate garment features from the garment UNet into a frozen denoising UNet.
  arXiv  Detail & Related papers  (2024-07-17T16:26:30Z)
• M&M VTO: Multi-Garment Virtual Try-On and Editing [31.45715245587691]
  M&M VTO is a mix and match virtual try-on method that takes as input multiple garment images, text description for garment layout and an image of a person. An example input includes: an image of a shirt, an image of a pair of pants, "rolled sleeves, shirt tucked in", and an image of a person. The output is a visualization of how those garments (in the desired layout) would look like on the given person.
  arXiv  Detail & Related papers  (2024-06-06T22:46:37Z)
• MV-VTON: Multi-View Virtual Try-On with Diffusion Models [91.71150387151042]
  The goal of image-based virtual try-on is to generate an image of the target person naturally wearing the given clothing.<n>Existing methods solely focus on the frontal try-on using the frontal clothing.<n>We introduce Multi-View Virtual Try-ON (MV-VTON), which aims to reconstruct the dressing results from multiple views using the given clothes.
  arXiv  Detail & Related papers  (2024-04-26T12:27:57Z)
• Style-Based Global Appearance Flow for Virtual Try-On [119.95115739956661]
  A novel global appearance flow estimation model is proposed in this work. Experiment results on a popular virtual try-on benchmark show that our method achieves new state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-04-03T10:58:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.