MatBind: A Shared Embedding Space for Multimodal Materials Characterization

• URL: http://arxiv.org/abs/2607.08470v1
• Date: Thu, 09 Jul 2026 13:28:14 GMT
• Title: MatBind: A Shared Embedding Space for Multimodal Materials Characterization
• Abstract summary: We present MatBind, a contrastive learning framework that aligns four materials modalities into a unified embedding space.<n>Results show that treating heterogeneous materials data as complementary projections of a single physical reality is not a practical choice but is consistent with the underlying physics.
• Score: 5.373373592868313
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fully characterizing a crystalline material requires integrating heterogeneous data sources -- atomic structures, diffraction patterns, electronic density of states, and natural language -- each of which captures a different facet of the same physical object. In practice, however, these modalities are stored and analyzed in isolation, making it difficult to relate or query materials across representational boundaries. We present MatBind, a contrastive learning framework that aligns four materials modalities -- crystal structure, powder X-ray diffraction (pXRD) simulated from structures, density of states (DOS), and text -- into a unified embedding space using crystal structure as the central physical anchor. The framework induces alignment between modalities never explicitly paired during training, enabling emergent zero-shot cross-modal retrieval as a direct consequence of the shared representation. The learned embedding space organizes materials according to physically meaningful properties without explicit supervision, and retrieval performance improves systematically when modalities are combined at query time. These results demonstrate that treating heterogeneous materials data as complementary projections of a single physical reality, rather than as isolated data sources, is not a practical choice but is consistent with the underlying physics.

Related papers

• Learning the Constitutive Behavior of Materials via Neural Operators and Causal Attention: Case Studies in Plasticity and Damage [0.0]
  We propose a data-driven modeling framework based on the concept of a material operator.<n>The model is trained directly on full loading paths as function-to-function mappings.<n>Results demonstrate accurate and robust predictions of irreversible deformation mechanisms.
  arXiv  Detail & Related papers  (2026-09-02T06:58:00Z)
• The internal law of a material can be discovered from its boundary [4.3344158108954485]
  We introduce Neural-DFEM, a method that enables unsupervised discovery of hyperelastic material laws.<n>The method embeds a differentiable finite element solver within the learning loop, directly linking candidate energy functionals to available measurements.<n>Our results demonstrate that reliable identification of material laws is achievable even under partial observability.
  arXiv  Detail & Related papers  (2026-03-27T15:27:04Z)
• Exploring Physical Intelligence Emergence via Omni-Modal Architecture and Physical Data Engine [50.62040226184694]
  We present OmniFysics, a compact omni-modal model that unifies understanding across images, audio, video, and text.<n>To inject explicit physical knowledge, we build a physical data engine with two components.<n>Experiments show competitive performance on standard multimodal benchmarks and improved results on physics-oriented evaluations.
  arXiv  Detail & Related papers  (2026-02-05T14:04:51Z)
• Learning ORDER-Aware Multimodal Representations for Composite Materials Design [15.819480337529741]
  We introduce ORDinal-aware imagE-tabulaR alignment (ORDER), a multimodal pretraining framework that establishes ordinality as a core principle for composite material representations.<n>ORDER ensures that materials with similar target properties occupy nearby regions in the latent space, which effectively preserves the continuous nature of composite properties.
  arXiv  Detail & Related papers  (2026-01-23T06:39:01Z)
• MASIV: Toward Material-Agnostic System Identification from Videos [76.36666848173141]
  MASIV is a vision-based framework for material-agnostic system identification.<n>It employs learnable neural models, inferring object dynamics without assuming a scene-specific material prior.<n>It achieves state-of-the-art performance in geometric accuracy, rendering quality, and generalization ability.
  arXiv  Detail & Related papers  (2025-08-01T23:23:45Z)
• Causal Discovery from Data Assisted by Large Language Models [50.193740129296245]
  It is essential to integrate experimental data with prior domain knowledge for knowledge driven discovery.<n>Here we demonstrate this approach by combining high-resolution scanning transmission electron microscopy (STEM) data with insights derived from large language models (LLMs)<n>By fine-tuning ChatGPT on domain-specific literature, we construct adjacency matrices for Directed Acyclic Graphs (DAGs) that map the causal relationships between structural, chemical, and polarization degrees of freedom in Sm-doped BiFeO3 (SmBFO)
  arXiv  Detail & Related papers  (2025-03-18T02:14:49Z)
• MaRI: Material Retrieval Integration across Domains [13.686066106732696]
  Existing methods rely on datasets that capture shape-invariant and lighting-varied representations of materials.<n>We introduce MaRI, a framework designed to bridge the feature space gap between synthetic and real-world materials.
  arXiv  Detail & Related papers  (2025-03-11T07:23:11Z)
• Efficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks [52.13486402193811]
  New solid-state materials require rapidly exploring the vast space of crystal structures and locating stable regions. Existing methods struggle to explore large material spaces and generate diverse samples with desired properties and requirements. We propose a novel generative model employing a hierarchical exploration strategy to efficiently exploit the symmetry of the materials space to generate crystal structures given desired properties.
  arXiv  Detail & Related papers  (2024-11-06T23:53:34Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Modeling Dislocation Dynamics Data Using Semantic Web Technologies [0.0]
  An important class of materials that is widely investigated are crystalline materials, including metals and semiconductors. Dislocation affects various material properties, including strength, fracture, and ductility. This paper presents how data from dislocation dynamics simulations can be modeled using web technologies.
  arXiv  Detail & Related papers  (2023-09-13T13:03:44Z)
• Learning Stochastic Behaviour from Aggregate Data [52.012857267317784]
  Learning nonlinear dynamics from aggregate data is a challenging problem because the full trajectory of each individual is not available. We propose a novel method using the weak form of Fokker Planck Equation (FPE) to describe the density evolution of data in a sampled form. In such a sample-based framework we are able to learn the nonlinear dynamics from aggregate data without explicitly solving the partial differential equation (PDE) FPE.
  arXiv  Detail & Related papers  (2020-02-10T03:20:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.