Space Group Informed Transformer for Crystalline Materials Generation

• URL: http://arxiv.org/abs/2403.15734v1
• Date: Sat, 23 Mar 2024 06:01:45 GMT
• Title: Space Group Informed Transformer for Crystalline Materials Generation
• Authors: Zhendong Cao, Xiaoshan Luo, Jian Lv, Lei Wang,
• Abstract summary: We introduce CrystalFormer, a transformer-based autoregressive model for space group-controlled generation of crystalline materials. CrystalFormer learns to generate crystals by directly predicting the species and locations of symmetry-inequivalent atoms in the unit cell. Our results demonstrate that CrystalFormer matches state-of-the-art performance on standard benchmarks for both validity, novelty, and stability of the generated crystalline materials.
• Score: 2.405914457225118
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce CrystalFormer, a transformer-based autoregressive model specifically designed for space group-controlled generation of crystalline materials. The space group symmetry significantly simplifies the crystal space, which is crucial for data and compute efficient generative modeling of crystalline materials. Leveraging the prominent discrete and sequential nature of the Wyckoff positions, CrystalFormer learns to generate crystals by directly predicting the species and locations of symmetry-inequivalent atoms in the unit cell. Our results demonstrate that CrystalFormer matches state-of-the-art performance on standard benchmarks for both validity, novelty, and stability of the generated crystalline materials. Our analysis also shows that CrystalFormer ingests sensible solid-state chemistry information from data for generative modeling. The CrystalFormer unifies symmetry-based structure search and generative pre-training in the realm of crystalline materials. The simplicity, generality, and flexibility of CrystalFormer position it as a promising architecture to be the foundational model of the entire crystalline materials space, heralding a new era in materials modeling and discovery.

Related papers

• Crystals with Transformers on Graphs, for Prediction of Unconventional Crystal Material Properties and the Benchmark [17.592470095351654]
  We propose CrysToGraph ($textbfCrys$tals with $textbfT$ransformers $textbfo$n $textbfGraph$s), a novel transformer-based graph geometric network designed specifically for unconventional crystalline systems. CrysToGraph effectively captures short-range interactions with transformer-based graph convolution blocks as well as long-range interactions with graph-wise transformer blocks. It outperforms most existing methods, achieving new state-of-the-art results on the benchmarks of both unconventional crystals and traditional crystals
  arXiv  Detail & Related papers  (2024-07-23T02:31:06Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Data-Driven Score-Based Models for Generating Stable Structures with Adaptive Crystal Cells [1.515687944002438]
  This work aims at the generation of new crystal structures with desired properties, such as chemical stability and specified chemical composition. The novelty of the presented approach resides in the fact that the lattice of the crystal cell is not fixed. A multigraph crystal representation is introduced that respects symmetry constraints, yielding computational advantages.
  arXiv  Detail & Related papers  (2023-10-16T02:53:24Z)
• Crystal-GFN: sampling crystals with desirable properties and constraints [103.79058968784163]
  We introduce Crystal-GFN, a generative model of crystal structures that sequentially samples structural properties of crystalline materials. In this paper, we use as objective the formation energy per atom of a crystal structure predicted by a new proxy machine learning model trained on MatBench. The results demonstrate that Crystal-GFN is able to sample highly diverse crystals with low (median -3.1 eV/atom) predicted formation energy.
  arXiv  Detail & Related papers  (2023-10-07T21:36:55Z)
• Unified Model for Crystalline Material Generation [9.940728137241214]
  We propose two unified models that act at the same time on crystal lattice and atomic positions. Our models are capable to learn any arbitrary crystal lattice deformation by lowering the total energy to reach thermodynamic stability.
  arXiv  Detail & Related papers  (2023-06-07T15:23:59Z)
• Equivariant Parameter Sharing for Porous Crystalline Materials [4.271235935891555]
  Existing methods for crystal property prediction either have constraints that are too restrictive or only incorporate symmetries between unit cells. We develop a model which incorporates the symmetries of the unit cell of a crystal in its architecture and explicitly models the porous structure. Our results confirm that our method performs better than existing methods for crystal property prediction and that the inclusion of symmetry results in a more efficient model.
  arXiv  Detail & Related papers  (2023-04-04T08:33:13Z)
• Enhancing the robustness of coupling between a single emitter and a photonic crystal waveguide [62.997667081978825]
  We use this model to propose approaches to the design of a photonic crystal waveguide maximizing the Purcell enhancement at a target wavelength. Numerical simulations indicate that the proposed structures exhibit robustness to fabrication defects introduced into photonic crystal geometry.
  arXiv  Detail & Related papers  (2022-10-13T21:01:46Z)
• Normalizing flows for atomic solids [67.70049117614325]
  We present a machine-learning approach, based on normalizing flows, for modelling atomic solids. We report Helmholtz free energy estimates for cubic and hexagonal ice modelled as monatomic water as well as for a truncated and shifted Lennard-Jones system. Our results thus demonstrate that normalizing flows can provide high-quality samples and free energy estimates of solids, without the need for multi-staging or for imposing restrictions on the crystal geometry.
  arXiv  Detail & Related papers  (2021-11-16T18:54:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.