Property-Informed Diffusion-Based Text-to-Microstructure Generation

• URL: http://arxiv.org/abs/2606.08150v1
• Date: Sat, 06 Jun 2026 13:00:34 GMT
• Title: Property-Informed Diffusion-Based Text-to-Microstructure Generation
• Abstract summary: A property-informed diffusion-based network is proposed that enables the generation of 3D microstructures directly from textual descriptions.<n>We show that the model is capable of generating semantically meaningful and physically plausible structures across a wide range of material categories.<n>Our approach has good potential for interactive microstructure design and opens up new directions for combining language-based interfaces with inverse material discovery.
• Score: 25.492080916045012
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Designing 3D metamaterial microstructures that meet the intended functions remains a major challenge, as it typically requires domain expertise, iterative simulations, and extensive manual tuning. Existing work on inverse design that automatically generates microstructures based on desired target properties often suffers from limited design diversity and faces challenges in ensuring the physical feasibility of the generated structures. To address this issue, a property-informed diffusion-based network is proposed that enables the generation of 3D microstructures directly from textual descriptions. Unlike traditional property conditioning methods, our approach leverages rich guidance in terms of semantics and physical properties in the text input to support diverse structure synthesis. To enforce consistency between the generated structures and the target textual prompts, a dual alignment strategy is adopted, including contrastive text-structure alignment and test-time reward-guided alignment. Experimental results show that the model is capable of generating semantically meaningful and physically plausible structures across a wide range of material categories. Our approach has good potential for interactive microstructure design and opens up new directions for combining language-based interfaces with inverse material discovery. Code is available at: https://github.com/hongsong-wang/PropDiff-TMG

Related papers

• StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation [72.84181869780627]
  StructDiff is a generative framework based on a single-scale diffusion model for single-image generation.<n>It incorporates 3D positional encoding (PE) as a spatial prior, allowing flexible control over positions, scale, and local details of generated objects.<n>It also demonstrates broad applicability across downstream tasks, such as text-guided image generation, image editing, outpainting, and paint-to-image synthesis.
  arXiv  Detail & Related papers  (2026-04-14T10:55:43Z)
• AULLM++: Structural Reasoning with Large Language Models for Micro-Expression Recognition [30.62262381459829]
  AULLM++ is a reasoning-oriented framework leveraging Large Language Models (LLMs)<n>It formulates AU prediction into three stages: evidence construction, structure modeling, and deduction-based prediction.<n>Experiments demonstrate AULLM++ achieves state-of-the-art performance on standard benchmarks.
  arXiv  Detail & Related papers  (2026-03-09T13:45:21Z)
• StdGEN++: A Comprehensive System for Semantic-Decomposed 3D Character Generation [57.06461272772509]
  StdGEN++ is a novel and comprehensive system for generating high-fidelity, semantically decomposed 3D characters from diverse inputs.<n>It achieves state-of-the-art performance, significantly outperforming existing methods in geometric accuracy and semantic disentanglement.<n>The resulting structural independence unlocks advanced downstream capabilities, including non-destructive editing, physics-compliant animation, and gaze tracking.
  arXiv  Detail & Related papers  (2026-01-12T15:41:27Z)
• OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas [57.49565459553627]
  We introduce OmniStruct, a benchmark for assessing Large Language Models' capabilities on text-to-structure tasks.<n>We collect high-quality training data via synthetic task generation to facilitate the development of efficient text-to-structure models.<n>Our experiments demonstrate the possibility of fine-tuning much smaller models on synthetic data into universal structured generation models.
  arXiv  Detail & Related papers  (2025-11-23T08:18:12Z)
• DiffuMeta: Algebraic Language Models for Inverse Design of Metamaterials via Diffusion Transformers [0.6531893282486697]
  We present DiffuMeta, a generative framework integrating diffusion transformers with a novel algebraic language representation, encoding 3D geometries as mathematical sentences.<n>This compact, unified parameterization spans diverse topologies while enabling direct application of transformers to structural design.<n>Our approach enables simultaneous control over multiple mechanical objectives, including linear and nonlinear responses beyond training domains.
  arXiv  Detail & Related papers  (2025-07-21T16:09:26Z)
• Spatial Understanding from Videos: Structured Prompts Meet Simulation Data [89.77871049500546]
  We present a unified framework for enhancing 3D spatial reasoning in pre-trained vision-language models without modifying their architecture.<n>This framework combines SpatialMind, a structured prompting strategy that decomposes complex scenes and questions into interpretable reasoning steps, with ScanForgeQA, a scalable question-answering dataset built from diverse 3D simulation scenes.
  arXiv  Detail & Related papers  (2025-06-04T07:36:33Z)
• NEXT: Multi-Grained Mixture of Experts via Text-Modulation for Multi-Modal Object Re-Identification [17.10113184019939]
  Multi-modal object Re-Identification (ReID) aims to obtain accurate identity features across heterogeneous modalities.<n>In this paper, we propose a reliable caption generation pipeline based on attribute confidence.<n>We also propose a novel ReID framework, named NEXT, to model diverse identity patterns.
  arXiv  Detail & Related papers  (2025-05-26T13:52:28Z)
• Periodic Materials Generation using Text-Guided Joint Diffusion Model [23.137596469096824]
  TGDMat is a novel text-guided diffusion model designed for 3D periodic material generation.<n>Our approach integrates global structural knowledge through textual descriptions at each denoising step.<n>Our experiments reveal that TGDMat outperforms existing baseline methods by a good margin.
  arXiv  Detail & Related papers  (2025-03-01T14:56:44Z)
• MIND: Microstructure INverse Design with Generative Hybrid Neural Representation [25.55691106041371]
  inverse design of microstructures plays a pivotal role in optimizing metamaterials with specific, targeted physical properties.<n>We present a novel generative model that integrates latent diffusion with Holoplane, an advanced hybrid neural representation that simultaneously encodes both geometric and physical properties.<n>Our approach generalizes across multiple microstructure classes, enabling the generation of diverse, tileable microstructures with significantly improved property accuracy and enhanced control over geometric validity.
  arXiv  Detail & Related papers  (2025-02-01T20:25:47Z)
• A Large Language Model and Denoising Diffusion Framework for Targeted Design of Microstructures with Commands in Natural Language [0.0]
  We propose a framework that integrates Natural Language Processing (NLP), Large Language Models (LLMs), and Denoising Diffusion Probabilistic Models (DDPMs) Our framework employs contextual data augmentation, driven by a pretrained LLM, to generate and expand a diverse dataset of microstructure descriptors. A retrained NER model extracts relevant microstructure descriptors from user-provided natural language inputs, which are then used by the DDPM to generate microstructures with targeted mechanical properties and topological features.
  arXiv  Detail & Related papers  (2024-09-22T14:45:22Z)
• Unified Structure Generation for Universal Information Extraction [58.89057387608414]
  UIE can universally model different IE tasks, adaptively generate targeted structures, and collaboratively learn general IE abilities from different knowledge sources. Experiments show that UIE achieved the state-of-the-art performance on 4 IE tasks, 13 datasets, and on all supervised, low-resource, and few-shot settings.
  arXiv  Detail & Related papers  (2022-03-23T08:49:29Z)
• Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design [70.27706384570723]
  We propose Fold2Seq, a novel framework for designing protein sequences conditioned on a specific target fold. We show improved or comparable performance of Fold2Seq in terms of speed, coverage, and reliability for sequence design. The unique advantages of fold-based Fold2Seq, in comparison to a structure-based deep model and RosettaDesign, become more evident on three additional real-world challenges.
  arXiv  Detail & Related papers  (2021-06-24T14:34:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.