FabricGen: Microstructure-Aware Woven Fabric Generation
- URL: http://arxiv.org/abs/2603.07240v1
- Date: Sat, 07 Mar 2026 14:49:37 GMT
- Title: FabricGen: Microstructure-Aware Woven Fabric Generation
- Abstract summary: FabricGen is an end-to-end framework for generating high-quality woven fabric materials from textual descriptions.<n>A key insight of our method is the decomposition of macro-scale textures and micro-scale weaving patterns.<n>We develop an enhanced procedural geometric model capable of synthesizing natural yarn-level geometry with yarn sliding and flyaway fibers.
- Score: 21.93495205080579
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have explored diffusion models to streamline this process; however, pre-trained diffusion models often struggle to generate intricate yarn-level details that conform to weaving rules. To address this, we present FabricGen, an end-to-end framework for generating high-quality woven fabric materials from textual descriptions. A key insight of our method is the decomposition of macro-scale textures and micro-scale weaving patterns. To generate macro-scale textures free from microstructures, we fine-tune pre-trained diffusion models on a collected dataset of microstructure-free fabrics. As for micro-scale weaving patterns, we develop an enhanced procedural geometric model capable of synthesizing natural yarn-level geometry with yarn sliding and flyaway fibers. The procedural model is driven by a specialized large language model, WeavingLLM, which is fine-tuned on an annotated dataset of formatted weaving drafts, and prompt-tuned with domain-specific fabric expertise. Through fine-tuning and prompt tuning, WeavingLLM learns to design weaving drafts and fabric parameters from textual prompts, enabling the procedural model to produce diverse weaving patterns that stick to weaving principles. The generated macro-scale texture, along with the micro-scale geometry, can be used for fabric rendering. Consequently, our framework produces materials with significantly richer detail and realism compared to prior generative models.
Related papers
- PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments [52.50602518973252]
We present PatternGSL, a structured garment representation in the form of a template-free and learnable specification language.<n>We propose a vision-language framework that predicts PatternGSL specifications directly from a single image and decodes them into garments.
arXiv Detail & Related papers (2026-06-23T13:32:04Z) - Data-Efficient Brushstroke Generation with Diffusion Models for Oil Painting [60.15416769662556]
We study the problem of learning human-like brushstroke generation from a small set of hand-drawn samples.<n>We propose StrokeDiff, a diffusion-based framework with Smooth Regularization (SmR)<n>We show how the learned primitives can be made controllable through a Bézier-based conditioning module.
arXiv Detail & Related papers (2026-03-01T13:42:35Z) - GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling [35.49678134341859]
GarmageNet is a generative framework that automates the creation of 2D sewing patterns.<n>Garmage is a novel garment representation that encodes each panel as a structured geometry image.<n>GarmageSet is a large-scale dataset comprising 14,801 professionally designed garments.
arXiv Detail & Related papers (2025-04-02T08:37:32Z) - SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generation [70.76810765911499]
We introduce SuperCarver, a 3D geometry super-resolution pipeline for supplementing texture-consistent surface details onto a given coarse mesh.<n> Experiments demonstrate that our SuperCarver is capable of generating realistic and expressive surface details depicted by the actual texture appearance.
arXiv Detail & Related papers (2025-03-12T14:38:45Z) - Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation [52.13927859375693]
We propose SewingLDM, a multi-modal generative model that generates sewing patterns controlled by text prompts, body shapes, and garment sketches.<n>To learn the sewing pattern distribution in the latent space, we design a two-step training strategy.<n> Comprehensive qualitative and quantitative experiments show the effectiveness of our proposed method.
arXiv Detail & Related papers (2024-12-19T02:05:28Z) - FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Images [56.63824638417697]
FabricDiffusion is a method for transferring fabric textures from a single clothing image to 3D garments of arbitrary shapes.
We show that FabricDiffusion can transfer various features from a single clothing image including texture patterns, material properties, and detailed prints and logos.
arXiv Detail & Related papers (2024-10-02T17:57:12Z) - Single Mesh Diffusion Models with Field Latents for Texture Generation [18.78126579775479]
We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes.
We consider a single-textured-mesh paradigm, where our models are trained to generate variations of a given texture on a mesh.
Our models can also be adapted for user-controlled editing tasks such as inpainting and label-guided generation.
arXiv Detail & Related papers (2023-12-14T18:59:36Z) - NRST: Non-rigid Surface Tracking from Monocular Video [97.2743051142748]
We propose an efficient method for non-rigid surface tracking from monocular RGB videos.
Given a video and a template mesh, our algorithm sequentially registers the template non-rigidly to each frame.
Results demonstrate the effectiveness of our method on both general textured non-rigid objects and monochromatic fabrics.
arXiv Detail & Related papers (2021-07-06T06:06:45Z) - Texture Generation with Neural Cellular Automata [64.70093734012121]
We learn a texture generator from a single template image.
We make claims that the behaviour exhibited by the NCA model is a learned, distributed, local algorithm to generate a texture.
arXiv Detail & Related papers (2021-05-15T22:05:46Z) - Fabric Surface Characterization: Assessment of Deep Learning-based
Texture Representations Using a Challenging Dataset [12.747154890227721]
We introduce a new, large-scale challenging microscopic material surface dataset (CoMMonS)
We then conduct a comprehensive evaluation of state-of-the-art deep learning-based methods for texture classification using CoMMonS.
Our results show that, in comparison with the state-of-the-art deep texture descriptors, MuLTER yields higher accuracy not only on our CoMMonS dataset for material characterization, but also on established datasets such as MINC-2500 and GTOS-mobile for material recognition.
arXiv Detail & Related papers (2020-03-16T05:37:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.