CrysMMNet: Multimodal Representation for Crystal Property Prediction

• URL: http://arxiv.org/abs/2307.05390v1
• Date: Fri, 9 Jun 2023 11:16:01 GMT
• Title: CrysMMNet: Multimodal Representation for Crystal Property Prediction
• Authors: Kishalay Das, Pawan Goyal, Seung-Cheol Lee, Satadeep Bhattacharjee, Niloy Ganguly
• Abstract summary: We propose CrysMMNet, a simple multi-modal framework, which fuses both structural and textual representation together to generate a joint multimodal representation of crystalline materials. We conduct extensive experiments on two benchmark datasets across ten different properties to show that CrysMMNet outperforms existing state-of-the-art baseline methods with a good margin.
• Score: 22.576167897068956
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine Learning models have emerged as a powerful tool for fast and accurate prediction of different crystalline properties. Exiting state-of-the-art models rely on a single modality of crystal data i.e. crystal graph structure, where they construct multi-graph by establishing edges between nearby atoms in 3D space and apply GNN to learn materials representation. Thereby, they encode local chemical semantics around the atoms successfully but fail to capture important global periodic structural information like space group number, crystal symmetry, rotational information, etc, which influence different crystal properties. In this work, we leverage textual descriptions of materials to model global structural information into graph structure and learn a more robust and enriched representation of crystalline materials. To this effect, we first curate a textual dataset for crystalline material databases containing descriptions of each material. Further, we propose CrysMMNet, a simple multi-modal framework, which fuses both structural and textual representation together to generate a joint multimodal representation of crystalline materials. We conduct extensive experiments on two benchmark datasets across ten different properties to show that CrysMMNet outperforms existing state-of-the-art baseline methods with a good margin. We also observe that fusing the textual representation with crystal graph structure provides consistent improvement for all the SOTA GNN models compared to their own vanilla versions. We have shared the textual dataset, that we have curated for both the benchmark material databases, with the community for future use.

Related papers

• Material Property Prediction with Element Attribute Knowledge Graphs and Multimodal Representation Learning [8.523289773617503]
  We build an element property knowledge graph and utilize an embedding model to encode the element attributes within the knowledge graph. A multimodal fusion framework, ESNet, integrates element property features with crystal structure features to generate joint multimodal representations. This provides a more comprehensive perspective for predicting the performance of crystalline materials.
  arXiv  Detail & Related papers  (2024-11-13T08:07:21Z)
• Efficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks [52.13486402193811]
  New solid-state materials require rapidly exploring the vast space of crystal structures and locating stable regions. Existing methods struggle to explore large material spaces and generate diverse samples with desired properties and requirements. We propose a novel generative model employing a hierarchical exploration strategy to efficiently exploit the symmetry of the materials space to generate crystal structures given desired properties.
  arXiv  Detail & Related papers  (2024-11-06T23:53:34Z)
• Generative Hierarchical Materials Search [91.93125016916463]
  We propose Generative Hierarchical Materials Search (GenMS) for controllable generation of crystal structures. GenMS consists of (1) a language model that takes high-level natural language as input and generates intermediate textual information about a crystal. GenMS additionally uses a graph neural network to predict properties (e.g., formation energy) from the generated crystal structures.
  arXiv  Detail & Related papers  (2024-09-10T17:51:28Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• PerCNet: Periodic Complete Representation for Crystal Graphs [3.7050297294650716]
  A reasonable crystal representation method should capture the local and global information. We propose a periodic complete representation and calculation algorithm for infinite extended crystal materials. Based on the proposed representation, we then propose a network for predicting crystal material properties, PerCNet.
  arXiv  Detail & Related papers  (2023-12-03T08:55:35Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• DeepCrysTet: A Deep Learning Approach Using Tetrahedral Mesh for Predicting Properties of Crystalline Materials [0.0]
  We propose DeepCrysTet, a novel deep learning approach for predicting material properties. DeepCrysTet uses crystal structures represented as a 3D tetrahedral mesh generated by Delaunay tetrahedralization. Experiments show that DeepCrysTet significantly outperforms existing GNN models in classifying crystal structures and state-of-the-art performance in predicting elastic properties.
  arXiv  Detail & Related papers  (2023-09-07T05:23:52Z)
• Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling [96.75821232222201]
  Existing research on multimodal relation extraction (MRE) faces two co-existing challenges, internal-information over-utilization and external-information under-exploitation. We propose a novel framework that simultaneously implements the idea of internal-information screening and external-information exploiting.
  arXiv  Detail & Related papers  (2023-05-19T14:56:57Z)
• CrysGNN : Distilling pre-trained knowledge to enhance property prediction for crystalline materials [25.622724168215097]
  This paper presents CrysGNN, a new pre-trained GNN framework for crystalline materials. It captures both node and graph level structural information of crystal graphs using unlabelled material data. We conduct extensive experiments to show that with distilled knowledge from the pre-trained model, all the SOTA algorithms are able to outperform their own vanilla version with good margins.
  arXiv  Detail & Related papers  (2023-01-14T08:12:01Z)
• Leveraging Orbital Information and Atomic Feature in Deep Learning Model [0.413365552362244]
  We propose a crystal representation learning framework, Orbital CrystalNet, OCrystalNet, which consists of two parts: atomic descriptor generation and graph representation learning. To demonstrate the capabilities of OCrystalNet we performed a number of prediction tasks on Material Project dataset and JARVIS dataset. Results show that our model have various advantages over other state of art models.
  arXiv  Detail & Related papers  (2022-10-29T06:22:29Z)
• How to See Hidden Patterns in Metamaterials with Interpretable Machine Learning [82.67551367327634]
  We develop a new interpretable, multi-resolution machine learning framework for finding patterns in the unit-cells of materials. Specifically, we propose two new interpretable representations of metamaterials, called shape-frequency features and unit-cell templates.
  arXiv  Detail & Related papers  (2021-11-10T21:19:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.