GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers

• URL: http://arxiv.org/abs/2504.21476v1
• Date: Wed, 30 Apr 2025 09:56:59 GMT
• Title: GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers
• Authors: Xinyu Li, Qi Yao, Yuanda Wang,
• Abstract summary: generative modeling of sewing patterns is crucial for creating diversified garments.<n>We present textbftextitGarmentDiffusion, a new generative model capable of producing centimeter-precise, vectorized 3D sewing patterns.
• Score: 9.228577662928673
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Garment sewing patterns are fundamental design elements that bridge the gap between design concepts and practical manufacturing. The generative modeling of sewing patterns is crucial for creating diversified garments. However, existing approaches are limited either by reliance on a single input modality or by suboptimal generation efficiency. In this work, we present \textbf{\textit{GarmentDiffusion}}, a new generative model capable of producing centimeter-precise, vectorized 3D sewing patterns from multimodal inputs (text, image, and incomplete sewing pattern). Our method efficiently encodes 3D sewing pattern parameters into compact edge token representations, achieving a sequence length that is $\textbf{10}\times$ shorter than that of the autoregressive SewingGPT in DressCode. By employing a diffusion transformer, we simultaneously denoise all edge tokens along the temporal axis, while maintaining a constant number of denoising steps regardless of dataset-specific edge and panel statistics. With all combination of designs of our model, the sewing pattern generation speed is accelerated by $\textbf{100}\times$ compared to SewingGPT. We achieve new state-of-the-art results on DressCodeData, as well as on the largest sewing pattern dataset, namely GarmentCodeData. The project website is available at https://shenfu-research.github.io/Garment-Diffusion/.

Related papers

• GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation [15.345904761472106]
  GarmentX is a novel framework for generating diverse, high-fidelity, and wearable 3D garments from a single input image.<n>We introduce GarmentX dataset, a large-scale dataset of 378,682 garment parameter-image pairs.
  arXiv  Detail & Related papers  (2025-04-29T04:15:33Z)
• ChatGarment: Garment Estimation, Generation and Editing via Large Language Models [79.46056192947924]
  ChatGarment is a novel approach that leverages large vision-language models (VLMs) to automate the estimation, generation, and editing of 3D garments. It can estimate sewing patterns from in-the-wild images or sketches, generate them from text descriptions, and edit garments based on user instructions.
  arXiv  Detail & Related papers  (2024-12-23T18:59:28Z)
• Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation [52.13927859375693]
  We propose SewingLDM, a multi-modal generative model that generates sewing patterns controlled by text prompts, body shapes, and garment sketches.<n>To learn the sewing pattern distribution in the latent space, we design a two-step training strategy.<n> Comprehensive qualitative and quantitative experiments show the effectiveness of our proposed method.
  arXiv  Detail & Related papers  (2024-12-19T02:05:28Z)
• AIpparel: A Multimodal Foundation Model for Digital Garments [71.12933771326279]
  We introduce AIpparel, a multimodal foundation model for generating and editing sewing patterns.<n>Our model fine-tunes state-of-the-art large multimodal models on a custom-curated large-scale dataset of over 120,000 unique garments.<n>We propose a novel tokenization scheme that concisely encodes these complex sewing patterns so that LLMs can learn to predict them efficiently.
  arXiv  Detail & Related papers  (2024-12-05T07:35:19Z)
• GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patterns [18.513707884523072]
  We present the first large-scale synthetic dataset of 3D made-to-measure garments with sewing patterns. GarmentCodeData contains 115,000 data points that cover a variety of designs in many common garment categories. We propose an automatic, open-source 3D garment draping pipeline based on a fast XPBD simulator.
  arXiv  Detail & Related papers  (2024-05-27T19:14:46Z)
• DressCode: Autoregressively Sewing and Generating Garments from Text Guidance [61.48120090970027]
  DressCode aims to democratize design for novices and offer immense potential in fashion design, virtual try-on, and digital human creation. We first introduce SewingGPT, a GPT-based architecture integrating cross-attention with text-conditioned embedding to generate sewing patterns. We then tailor a pre-trained Stable Diffusion to generate tile-based Physically-based Rendering (PBR) textures for the garments.
  arXiv  Detail & Related papers  (2024-01-29T16:24:21Z)
• Towards Garment Sewing Pattern Reconstruction from a Single Image [76.97825595711444]
  Garment sewing pattern represents the intrinsic rest shape of a garment, and is the core for many applications like fashion design, virtual try-on, and digital avatars. We first synthesize a versatile dataset, named SewFactory, which consists of around 1M images and ground-truth sewing patterns. We then propose a two-level Transformer network called Sewformer, which significantly improves the sewing pattern prediction performance.
  arXiv  Detail & Related papers  (2023-11-07T18:59:51Z)
• DrapeNet: Garment Generation and Self-Supervised Draping [95.0315186890655]
  We rely on self-supervision to train a single network to drape multiple garments. This is achieved by predicting a 3D deformation field conditioned on the latent codes of a generative network. Our pipeline can generate and drape previously unseen garments of any topology.
  arXiv  Detail & Related papers  (2022-11-21T09:13:53Z)
• Generating Datasets of 3D Garments with Sewing Patterns [10.729374293332281]
  We create the first large-scale synthetic dataset of 3D garment models with their sewing patterns. The dataset contains more than 20000 garment design variations produced from 19 different base types.
  arXiv  Detail & Related papers  (2021-09-12T23:03:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.