Crystals with Transformers on Graphs, for Prediction of Unconventional Crystal Material Properties and the Benchmark

• URL: http://arxiv.org/abs/2407.16131v1
• Date: Tue, 23 Jul 2024 02:31:06 GMT
• Title: Crystals with Transformers on Graphs, for Prediction of Unconventional Crystal Material Properties and the Benchmark
• Authors: Hongyi Wang, Ji Sun, Jinzhe Liang, Li Zhai, Zitian Tang, Zijian Li, Wei Zhai, Xusheng Wang, Weihao Gao, Sheng Gong, Bolong Huang, Hua Zhang,
• Abstract summary: We propose CrysToGraph ($textbfCrys$tals with $textbfT$ransformers $textbfo$n $textbfGraph$s), a novel transformer-based graph geometric network designed specifically for unconventional crystalline systems. CrysToGraph effectively captures short-range interactions with transformer-based graph convolution blocks as well as long-range interactions with graph-wise transformer blocks. It outperforms most existing methods, achieving new state-of-the-art results on the benchmarks of both unconventional crystals and traditional crystals
• Score: 17.592470095351654
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The ionic bonding across the lattice and ordered microscopic structures endow crystals with unique symmetry and determine their macroscopic properties. Unconventional crystals, in particular, exhibit non-traditional lattice structures or possess exotic physical properties, making them intriguing subjects for investigation. Therefore, to accurately predict the physical and chemical properties of crystals, it is crucial to consider long-range orders. While GNN excels at capturing the local environment of atoms in crystals, they often face challenges in effectively capturing longer-ranged interactions due to their limited depth. In this paper, we propose CrysToGraph ($\textbf{Crys}$tals with $\textbf{T}$ransformers $\textbf{o}$n $\textbf{Graph}$s), a novel transformer-based geometric graph network designed specifically for unconventional crystalline systems, and UnconvBench, a comprehensive benchmark to evaluate models' predictive performance on unconventional crystal materials such as defected crystals, low-dimension crystals and MOF. CrysToGraph effectively captures short-range interactions with transformer-based graph convolution blocks as well as long-range interactions with graph-wise transformer blocks. CrysToGraph proofs its effectiveness in modelling unconventional crystal materials in multiple tasks, and moreover, it outperforms most existing methods, achieving new state-of-the-art results on the benchmarks of both unconventional crystals and traditional crystals.

Related papers

• A Space Group Symmetry Informed Network for O(3) Equivariant Crystal Tensor Prediction [89.38877696273364]
  We consider the prediction of general tensor properties of crystalline materials. We propose a General Materials Network (GMTNet), which is carefully designed to satisfy the required symmetries. Experimental results show that our GMTNet achieves promising performance on crystal tensors of various orders.
  arXiv  Detail & Related papers  (2024-06-03T16:26:16Z)
• Space Group Informed Transformer for Crystalline Materials Generation [2.405914457225118]
  We introduce CrystalFormer, a transformer-based autoregressive model for space group-controlled generation of crystalline materials. CrystalFormer learns to generate crystals by directly predicting the species and locations of symmetry-inequivalent atoms in the unit cell. Our results demonstrate that CrystalFormer matches state-of-the-art performance on standard benchmarks for both validity, novelty, and stability of the generated crystalline materials.
  arXiv  Detail & Related papers  (2024-03-23T06:01:45Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• PerCNet: Periodic Complete Representation for Crystal Graphs [3.7050297294650716]
  A reasonable crystal representation method should capture the local and global information. We propose a periodic complete representation and calculation algorithm for infinite extended crystal materials. Based on the proposed representation, we then propose a network for predicting crystal material properties, PerCNet.
  arXiv  Detail & Related papers  (2023-12-03T08:55:35Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Data-Driven Score-Based Models for Generating Stable Structures with Adaptive Crystal Cells [1.515687944002438]
  This work aims at the generation of new crystal structures with desired properties, such as chemical stability and specified chemical composition. The novelty of the presented approach resides in the fact that the lattice of the crystal cell is not fixed. A multigraph crystal representation is introduced that respects symmetry constraints, yielding computational advantages.
  arXiv  Detail & Related papers  (2023-10-16T02:53:24Z)
• Crystal-GFN: sampling crystals with desirable properties and constraints [103.79058968784163]
  We introduce Crystal-GFN, a generative model of crystal structures that sequentially samples structural properties of crystalline materials. In this paper, we use as objective the formation energy per atom of a crystal structure predicted by a new proxy machine learning model trained on MatBench. The results demonstrate that Crystal-GFN is able to sample highly diverse crystals with low (median -3.1 eV/atom) predicted formation energy.
  arXiv  Detail & Related papers  (2023-10-07T21:36:55Z)
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data [137.47124933818066]
  We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture. We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
  arXiv  Detail & Related papers  (2022-02-22T15:39:00Z)
• An invertible crystallographic representation for general inverse design of inorganic crystals with targeted properties [10.853822721106205]
  We present a framework capable of general inverse design (not limited to a given set of elements or crystal structures) The framework generates new crystals with user-defined formation energies, bandgap, thermoelectric (TE) power factor, and combinations thereof. Results represent a significant step toward property-driven general inverse design using generative models.
  arXiv  Detail & Related papers  (2020-05-15T15:58:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.