Generative Design of inorganic compounds using deep diffusion language models

• URL: http://arxiv.org/abs/2310.00475v1
• Date: Sat, 30 Sep 2023 19:46:19 GMT
• Title: Generative Design of inorganic compounds using deep diffusion language models
• Authors: Rongzhi Dong, Nihang Fu, dirisuriya M. D. Siriwardane, Jianjun Hu
• Abstract summary: We introduce a deep learning-based generative model for material composition and structure design. Our pipeline first uses deep diffusion language models as the generator of compositions and then applies a template-based crystal structure prediction algorithm. Based on the DFT calculation results, six new materials, including Ti2$HfO5, TaNbP, YMoN2, TaReO4, HfTiO2, and HfMnO2, with formation energy less than zero have been found.
• Score: 0.6827423171182154
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Due to the vast chemical space, discovering materials with a specific function is challenging. Chemical formulas are obligated to conform to a set of exacting criteria such as charge neutrality, balanced electronegativity, synthesizability, and mechanical stability. In response to this formidable task, we introduce a deep learning-based generative model for material composition and structure design by learning and exploiting explicit and implicit chemical knowledge. Our pipeline first uses deep diffusion language models as the generator of compositions and then applies a template-based crystal structure prediction algorithm to predict their corresponding structures, which is then followed by structure relaxation using a universal graph neural network-based potential. The density functional theory (DFT) calculations of the formation energies and energy-above-the-hull analysis are used to validate new structures generated through our pipeline. Based on the DFT calculation results, six new materials, including Ti2HfO5, TaNbP, YMoN2, TaReO4, HfTiO2, and HfMnO2, with formation energy less than zero have been found. Remarkably, among these, four materials, namely Ti2$HfO5, TaNbP, YMoN2, and TaReO4, exhibit an e-above-hull energy of less than 0.3 eV. These findings have proved the effectiveness of our approach.

Related papers

• Unleashing the power of novel conditional generative approaches for new materials discovery [3.972733741872872]
  We propose two generative approaches to the problem of crystal structure design. One is conditional structure modification, using the energy difference between the most energetically favorable structure and all its less stable polymorphs. The other is conditional structure generation, using the energy difference between the most energetically favorable structure and all its less stable polymorphs.
  arXiv  Detail & Related papers  (2024-11-05T14:58:31Z)
• Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials [0.5812062802134551]
  We show the results of adjusting and fine-tuning the pretrained EquiformerV2 model from the Open Catalyst Project. By applying an energy filter based on the local environment of the binding site the zero-shot inference is markedly improved. It is also found that EquiformerV2, assuming the role of general machine learning potential, is able to inform a smaller, more focused direct inference model.
  arXiv  Detail & Related papers  (2024-03-14T18:59:54Z)
• Molecule Design by Latent Prompt Transformer [76.2112075557233]
  This work explores the challenging problem of molecule design by framing it as a conditional generative modeling task. We propose a novel generative model comprising three components: (1) a latent vector with a learnable prior distribution; (2) a molecule generation model based on a causal Transformer, which uses the latent vector as a prompt; and (3) a property prediction model that predicts a molecule's target properties and/or constraint values using the latent prompt.
  arXiv  Detail & Related papers  (2024-02-27T03:33:23Z)
• Fine-Tuned Language Models Generate Stable Inorganic Materials as Text [57.01994216693825]
  Fine-tuning large language models on text-encoded atomistic data is simple to implement yet reliable. We show that our strongest model can generate materials predicted to be metastable at about twice the rate of CDVAE. Because of text prompting's inherent flexibility, our models can simultaneously be used for unconditional generation of stable material.
  arXiv  Detail & Related papers  (2024-02-06T20:35:28Z)
• Data Distillation for Neural Network Potentials toward Foundational Dataset [6.373914211316965]
  generative models can swiftly propose promising materials for targeted applications. However, the predicted properties of materials through the generative models often do not match with calculated properties through ab initio calculations. This study utilized extended ensemble molecular dynamics (MD) to secure a broad range of liquid- and solid-phase configurations in one of the metallic systems, nickel. We found that the NNP trained from the distilled data could predict different energy-minimized closed-pack crystal structures even though those structures were not explicitly part of the initial data.
  arXiv  Detail & Related papers  (2023-11-09T14:41:45Z)
• Investigating the Behavior of Diffusion Models for Accelerating Electronic Structure Calculations [24.116064925926914]
  Investigation driven by their potential to significantly accelerate electronic structure calculations using machine learning. We show that the model learns about the first-order structure of the potential energy surface, and then later learns about higher-order structure. For structure relaxations, the model finds geometries with 10x lower energy than those produced by a classical force field for small organic molecules.
  arXiv  Detail & Related papers  (2023-11-02T17:58:37Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Crystal-GFN: sampling crystals with desirable properties and constraints [103.79058968784163]
  We introduce Crystal-GFN, a generative model of crystal structures that sequentially samples structural properties of crystalline materials. In this paper, we use as objective the formation energy per atom of a crystal structure predicted by a new proxy machine learning model trained on MatBench. The results demonstrate that Crystal-GFN is able to sample highly diverse crystals with low (median -3.1 eV/atom) predicted formation energy.
  arXiv  Detail & Related papers  (2023-10-07T21:36:55Z)
• Multi-Task Mixture Density Graph Neural Networks for Predicting Cu-based Single-Atom Alloy Catalysts for CO2 Reduction Reaction [61.9212585617803]
  Graph neural networks (GNNs) have drawn more and more attention from material scientists. We develop a multi-task (MT) architecture based on DimeNet++ and mixture density networks to improve the performance of such task.
  arXiv  Detail & Related papers  (2022-09-15T13:52:15Z)
• BIGDML: Towards Exact Machine Learning Force Fields for Materials [55.944221055171276]
  Machine-learning force fields (MLFF) should be accurate, computationally and data efficient, and applicable to molecules, materials, and interfaces thereof. Here, we introduce the Bravais-Inspired Gradient-Domain Machine Learning approach and demonstrate its ability to construct reliable force fields using a training set with just 10-200 atoms.
  arXiv  Detail & Related papers  (2021-06-08T10:14:57Z)
• MLSolv-A: A Novel Machine Learning-Based Prediction of Solvation Free Energies from Pairwise Atomistic Interactions [0.0]
  We introduce a novel ML-based solvation model, which calculates the solvation energy from pairwise atomistic interactions. Results on 6,493 experimental measurements achieve outstanding performance and transferability for enlarging training data.
  arXiv  Detail & Related papers  (2020-05-13T06:53:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.