GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation

• URL: http://arxiv.org/abs/2504.20409v1
• Date: Tue, 29 Apr 2025 04:15:33 GMT
• Title: GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation
• Authors: Jingfeng Guo, Jinnan Chen, Weikai Chen, Zhenyu Sun, Lanjiong Li, Baozhu Zhao, Lingting Zhu, Xin Wang, Qi Liu,
• Abstract summary: GarmentX is a novel framework for generating diverse, high-fidelity, and wearable 3D garments from a single input image.<n>We introduce GarmentX dataset, a large-scale dataset of 378,682 garment parameter-image pairs.
• Score: 15.345904761472106
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work presents GarmentX, a novel framework for generating diverse, high-fidelity, and wearable 3D garments from a single input image. Traditional garment reconstruction methods directly predict 2D pattern edges and their connectivity, an overly unconstrained approach that often leads to severe self-intersections and physically implausible garment structures. In contrast, GarmentX introduces a structured and editable parametric representation compatible with GarmentCode, ensuring that the decoded sewing patterns always form valid, simulation-ready 3D garments while allowing for intuitive modifications of garment shape and style. To achieve this, we employ a masked autoregressive model that sequentially predicts garment parameters, leveraging autoregressive modeling for structured generation while mitigating inconsistencies in direct pattern prediction. Additionally, we introduce GarmentX dataset, a large-scale dataset of 378,682 garment parameter-image pairs, constructed through an automatic data generation pipeline that synthesizes diverse and high-quality garment images conditioned on parametric garment representations. Through integrating our method with GarmentX dataset, we achieve state-of-the-art performance in geometric fidelity and input image alignment, significantly outperforming prior approaches. We will release GarmentX dataset upon publication.

Related papers

• GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers [9.228577662928673]
  generative modeling of sewing patterns is crucial for creating diversified garments. We present textbftextitGarmentDiffusion, a new generative model capable of producing centimeter-precise, vectorized 3D sewing patterns.
  arXiv  Detail & Related papers  (2025-04-30T09:56:59Z)
• GarmageNet: A Dataset and Scalable Representation for Generic Garment Modeling [31.086617193645022]
  Garmage is a neural-network-and-CG-friendly representation for complex multi-layered garments.<n>GarmageNet produces detailed garments with body-conforming initial geometries and intricate sewing patterns.<n>We release an industrial-standard, large-scale, high-fidelity garment dataset.
  arXiv  Detail & Related papers  (2025-04-02T08:37:32Z)
• DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animation [10.9550231281676]
  We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model.<n>Our approach is able to synthesize high-quality 3D animations for a wide variety of garments and body shapes.
  arXiv  Detail & Related papers  (2025-03-24T06:08:26Z)
• GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing [85.67881477813592]
  GarmentCrafter is a new approach that enables non-professional users to create and modify 3D garments from a single-view image. Our method achieves superior visual fidelity and inter-view coherence compared to state-of-the-art single-view 3D garment reconstruction methods.
  arXiv  Detail & Related papers  (2025-03-11T17:56:03Z)
• Fine-Grained Controllable Apparel Showcase Image Generation via Garment-Centric Outpainting [39.50293003775675]
  We propose a novel garment-centric outpainting (GCO) framework based on the latent diffusion model (LDM)<n>The proposed framework aims at customizing a fashion model wearing a given garment via text prompts and facial images.
  arXiv  Detail & Related papers  (2025-03-03T08:30:37Z)
• ChatGarment: Garment Estimation, Generation and Editing via Large Language Models [79.46056192947924]
  ChatGarment is a novel approach that leverages large vision-language models (VLMs) to automate the estimation, generation, and editing of 3D garments.<n>It can estimate sewing patterns from in-the-wild images or sketches, generate them from text descriptions, and edit garments based on user instructions.
  arXiv  Detail & Related papers  (2024-12-23T18:59:28Z)
• FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-on [73.13242624924814]
  Garment perception enhancement technique, FitDiT, is designed for high-fidelity virtual try-on using Diffusion Transformers (DiT) We introduce a garment texture extractor that incorporates garment priors evolution to fine-tune garment feature, facilitating to better capture rich details such as stripes, patterns, and text. We also employ a dilated-relaxed mask strategy that adapts to the correct length of garments, preventing the generation of garments that fill the entire mask area during cross-category try-on.
  arXiv  Detail & Related papers  (2024-11-15T11:02:23Z)
• Improving Virtual Try-On with Garment-focused Diffusion Models [91.95830983115474]
  Diffusion models have led to the revolutionizing of generative modeling in numerous image synthesis tasks. We shape a new Diffusion model, namely GarDiff, which triggers the garment-focused diffusion process. Experiments on VITON-HD and DressCode datasets demonstrate the superiority of our GarDiff when compared to state-of-the-art VTON approaches.
  arXiv  Detail & Related papers  (2024-09-12T17:55:11Z)
• GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patterns [18.513707884523072]
  We present the first large-scale synthetic dataset of 3D made-to-measure garments with sewing patterns. GarmentCodeData contains 115,000 data points that cover a variety of designs in many common garment categories. We propose an automatic, open-source 3D garment draping pipeline based on a fast XPBD simulator.
  arXiv  Detail & Related papers  (2024-05-27T19:14:46Z)
• Garment Recovery with Shape and Deformation Priors [51.41962835642731]
  We propose a method that delivers realistic garment models from real-world images, regardless of garment shape or deformation. Not only does our approach recover the garment geometry accurately, it also yields models that can be directly used by downstream applications such as animation and simulation.
  arXiv  Detail & Related papers  (2023-11-17T07:06:21Z)
• Structure-Preserving 3D Garment Modeling with Neural Sewing Machines [190.70647799442565]
  We propose a novel Neural Sewing Machine (NSM), a learning-based framework for structure-preserving 3D garment modeling. NSM is capable of representing 3D garments under diverse garment shapes and topologies, realistically reconstructing 3D garments from 2D images with the preserved structure, and accurately manipulating the 3D garment categories, shapes, and topologies.
  arXiv  Detail & Related papers  (2022-11-12T16:43:29Z)
• Generating Datasets of 3D Garments with Sewing Patterns [10.729374293332281]
  We create the first large-scale synthetic dataset of 3D garment models with their sewing patterns. The dataset contains more than 20000 garment design variations produced from 19 different base types.
  arXiv  Detail & Related papers  (2021-09-12T23:03:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.