A Crystal-Specific Pre-Training Framework for Crystal Material Property Prediction

• URL: http://arxiv.org/abs/2306.05344v2
• Date: Fri, 9 Jun 2023 08:27:55 GMT
• Title: A Crystal-Specific Pre-Training Framework for Crystal Material Property Prediction
• Authors: Haomin Yu, Yanru Song, Jilin Hu, Chenjuan Guo, Bin Yang
• Abstract summary: labeling crystal properties is intrinsically difficult due to the high cost and time involved in physical simulations or lab experiments. crystals adhere to a specific quantum chemical principle known as periodic invariance, which is often not captured by existing machine learning methods. We propose the crystal-specific pre-training framework for learning crystal representations with self-supervision.
• Score: 12.957415185028948
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Crystal property prediction is a crucial aspect of developing novel materials. However, there are two technical challenges to be addressed for speeding up the investigation of crystals. First, labeling crystal properties is intrinsically difficult due to the high cost and time involved in physical simulations or lab experiments. Second, crystals adhere to a specific quantum chemical principle known as periodic invariance, which is often not captured by existing machine learning methods. To overcome these challenges, we propose the crystal-specific pre-training framework for learning crystal representations with self-supervision. The framework designs a mutex mask strategy for enhancing representation learning so as to alleviate the limited labels available for crystal property prediction. Moreover, we take into account the specific periodic invariance in crystal structures by developing a periodic invariance multi-graph module and periodic attribute learning within our framework. This framework has been tested on eight different tasks. The experimental results on these tasks show that the framework achieves promising prediction performance and is able to outperform recent strong baselines.

Related papers

• CrystalX: Ultra-Precision Crystal Structure Resolution and Error Correction Using Deep Learning [44.02107704258412]
  We develop CrystalX, a model for ultra-precise structural analysis at the full-atom level. To validate the model, we employed over 50,000 X-ray diffraction measurements. This deep learning model revolutionizes the time frame for crystal structure analysis, slashing it down to seconds.
  arXiv  Detail & Related papers  (2024-10-17T16:12:55Z)
• Space Group Informed Transformer for Crystalline Materials Generation [2.405914457225118]
  We introduce CrystalFormer, a transformer-based autoregressive model specifically designed for space group-controlled generation of crystalline materials. The incorporation of space group symmetry significantly simplifies the crystal space, which is crucial for data and compute efficient generative modeling of crystalline materials.
  arXiv  Detail & Related papers  (2024-03-23T06:01:45Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Data-Driven Score-Based Models for Generating Stable Structures with Adaptive Crystal Cells [1.515687944002438]
  This work aims at the generation of new crystal structures with desired properties, such as chemical stability and specified chemical composition. The novelty of the presented approach resides in the fact that the lattice of the crystal cell is not fixed. A multigraph crystal representation is introduced that respects symmetry constraints, yielding computational advantages.
  arXiv  Detail & Related papers  (2023-10-16T02:53:24Z)
• Crystal-GFN: sampling crystals with desirable properties and constraints [103.79058968784163]
  We introduce Crystal-GFN, a generative model of crystal structures that sequentially samples structural properties of crystalline materials. In this paper, we use as objective the formation energy per atom of a crystal structure predicted by a new proxy machine learning model trained on MatBench. The results demonstrate that Crystal-GFN is able to sample highly diverse crystals with low (median -3.1 eV/atom) predicted formation energy.
  arXiv  Detail & Related papers  (2023-10-07T21:36:55Z)
• Shotgun crystal structure prediction using machine-learned formation energies [3.2563787689949133]
  Crystal structures of assembled atoms can be predicted by finding the global or local minima of the energy surface within a broad space of atomic configurations. Here, we present significant progress toward solving the crystal structure prediction problem. We performed noniterative, single-shot screening using a large library of virtually created crystal structures with a machine-learning energy predictor.
  arXiv  Detail & Related papers  (2023-05-03T14:46:16Z)
• Equivariant Message Passing Neural Network for Crystal Material Discovery [8.481798330936975]
  We propose a periodic equivariant message-passing neural network that learns crystal lattice deformation in an unsupervised fashion. Our model equivalently acts on lattice according to the deformation action that must be performed, making it suitable for crystal generation, relaxation and optimisation.
  arXiv  Detail & Related papers  (2023-02-01T14:48:18Z)
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data [137.47124933818066]
  We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture. We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
  arXiv  Detail & Related papers  (2022-02-22T15:39:00Z)
• Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns [48.53244254413104]
  We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images. We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
  arXiv  Detail & Related papers  (2022-02-01T03:53:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.