Complete and Efficient Graph Transformers for Crystal Material Property Prediction

• URL: http://arxiv.org/abs/2403.11857v1
• Date: Mon, 18 Mar 2024 15:06:37 GMT
• Title: Complete and Efficient Graph Transformers for Crystal Material Property Prediction
• Authors: Keqiang Yan, Cong Fu, Xiaofeng Qian, Xiaoning Qian, Shuiwang Ji,
• Abstract summary: Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
• Score: 53.32754046881189
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. The periodic and infinite nature of crystals poses unique challenges for geometric graph representation learning. Specifically, constructing graphs that effectively capture the complete geometric information of crystals and handle chiral crystals remains an unsolved and challenging problem. In this paper, we introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom, enabling efficient and expressive graph representations of crystals. Furthermore, we propose ComFormer, a SE(3) transformer designed specifically for crystalline materials. ComFormer includes two variants; namely, iComFormer that employs invariant geometric descriptors of Euclidean distances and angles, and eComFormer that utilizes equivariant vector representations. Experimental results demonstrate the state-of-the-art predictive accuracy of ComFormer variants on various tasks across three widely-used crystal benchmarks. Our code is publicly available as part of the AIRS library (https://github.com/divelab/AIRS).

Related papers

• Generative Hierarchical Materials Search [91.93125016916463]
  We propose Generative Hierarchical Materials Search (GenMS) for controllable generation of crystal structures. GenMS consists of (1) a language model that takes high-level natural language as input and generates intermediate textual information about a crystal. GenMS additionally uses a graph neural network to predict properties (e.g., formation energy) from the generated crystal structures.
  arXiv  Detail & Related papers  (2024-09-10T17:51:28Z)
• CrysToGraph: A Comprehensive Predictive Model for Crystal Materials Properties and the Benchmark [16.456990796982186]
  We propose CrysToGraph ($textbfCrys$tals with $textbfT$ransformers $textbfo$n $textbfGraph$s), a novel transformer-based graph geometric network designed specifically for unconventional crystalline systems. CrysToGraph effectively captures short-range interactions with transformer-based graph convolution blocks as well as long-range interactions with graph-wise transformer blocks. It outperforms most existing methods, achieving new state-of-the-art results on the benchmarks of both unconventional crystals and traditional crystals
  arXiv  Detail & Related papers  (2024-07-23T02:31:06Z)
• A Space Group Symmetry Informed Network for O(3) Equivariant Crystal Tensor Prediction [89.38877696273364]
  We consider the prediction of general tensor properties of crystalline materials. We propose a General Materials Network (GMTNet), which is carefully designed to satisfy the required symmetries. Experimental results show that our GMTNet achieves promising performance on crystal tensors of various orders.
  arXiv  Detail & Related papers  (2024-06-03T16:26:16Z)
• Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding [10.170537065646323]
  Predicting physical properties of materials from their crystal structures is a fundamental problem in materials science. We show that crystal structures are infinitely repeating, periodic arrangements of atoms, whose fully connected attention results in infinitely connected attention. We propose a simple yet effective Transformer-based encoder architecture for crystal structures called Crystalformer.
  arXiv  Detail & Related papers  (2024-03-18T11:37:42Z)
• Accelerating Material Property Prediction using Generically Complete Isometry Invariants [3.031375888004876]
  We adapt the Pointwise Distance Distribution (PDD) as a representation for our learning algorithm. We develop a transformer model with a modified self-attention mechanism that combines PDD with compositional information via a spatial encoding method. This model is tested on the crystals of the Materials Project and Jarvis-DFT databases and shown to produce accuracy on par with state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-22T15:14:22Z)
• PerCNet: Periodic Complete Representation for Crystal Graphs [3.7050297294650716]
  A reasonable crystal representation method should capture the local and global information. We propose a periodic complete representation and calculation algorithm for infinite extended crystal materials. Based on the proposed representation, we then propose a network for predicting crystal material properties, PerCNet.
  arXiv  Detail & Related papers  (2023-12-03T08:55:35Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns [48.53244254413104]
  We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images. We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
  arXiv  Detail & Related papers  (2022-02-01T03:53:39Z)
• Dense Non-Rigid Structure from Motion: A Manifold Viewpoint [162.88686222340962]
  Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geometry of a deforming object from its 2D feature correspondences across multiple frames. We show that our approach significantly improves accuracy, scalability, and robustness against noise.
  arXiv  Detail & Related papers  (2020-06-15T09:15:54Z)
• An invertible crystallographic representation for general inverse design of inorganic crystals with targeted properties [10.853822721106205]
  We present a framework capable of general inverse design (not limited to a given set of elements or crystal structures) The framework generates new crystals with user-defined formation energies, bandgap, thermoelectric (TE) power factor, and combinations thereof. Results represent a significant step toward property-driven general inverse design using generative models.
  arXiv  Detail & Related papers  (2020-05-15T15:58:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.