Diffusion probabilistic models enhance variational autoencoder for crystal structure generative modeling

• URL: http://arxiv.org/abs/2308.02165v1
• Date: Fri, 4 Aug 2023 06:53:22 GMT
• Title: Diffusion probabilistic models enhance variational autoencoder for crystal structure generative modeling
• Authors: Teerachote Pakornchote, Natthaphon Choomphon-anomakhun, Sorrjit Arrerut, Chayanon Atthapak, Sakarn Khamkaeo, Thiparat Chotibut, Thiti Bovornratanaraks
• Abstract summary: In this study, we leverage novel diffusion probabilistic (DP) models to denoise atomic coordinates. Our proposed DP-CDVAE model can reconstruct and generate crystal structures whose qualities are statistically comparable to those of the original CDVAE. The energy differences between these structures and the true ground states are, on average, 68.1 meV/atom lower than those generated by the original CDVAE.
• Score: 2.524526956420465
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The crystal diffusion variational autoencoder (CDVAE) is a machine learning model that leverages score matching to generate realistic crystal structures that preserve crystal symmetry. In this study, we leverage novel diffusion probabilistic (DP) models to denoise atomic coordinates rather than adopting the standard score matching approach in CDVAE. Our proposed DP-CDVAE model can reconstruct and generate crystal structures whose qualities are statistically comparable to those of the original CDVAE. Furthermore, notably, when comparing the carbon structures generated by the DP-CDVAE model with relaxed structures obtained from density functional theory calculations, we find that the DP-CDVAE generated structures are remarkably closer to their respective ground states. The energy differences between these structures and the true ground states are, on average, 68.1 meV/atom lower than those generated by the original CDVAE. This significant improvement in the energy accuracy highlights the effectiveness of the DP-CDVAE model in generating crystal structures that better represent their ground-state configurations.

Related papers

• Manifold-Constrained Nucleus-Level Denoising Diffusion Model for Structure-Based Drug Design [81.95343363178662]
  atoms must maintain a minimum pairwise distance to avoid separation violations. NucleusDiff models the interactions between atomic nuclei and their surrounding electron clouds by enforcing the distance constraint. It reduces violation rate by up to 1000% and enhances binding affinity by up to 22.16%, surpassing state-of-the-art models for structure-based drug design.
  arXiv  Detail & Related papers  (2024-09-16T08:42:46Z)
• Isomorphic Pruning for Vision Models [56.286064975443026]
  Structured pruning reduces the computational overhead of deep neural networks by removing redundant sub-structures. We present Isomorphic Pruning, a simple approach that demonstrates effectiveness across a range of network architectures.
  arXiv  Detail & Related papers  (2024-07-05T16:14:53Z)
• Improving Antibody Design with Force-Guided Sampling in Diffusion Models [39.94753945046461]
  We propose a novel approach to enhance the sampling process of diffusion models by integrating force field energy-based feedback. Our model, DiffForce, employs forces to guide the diffusion sampling process, effectively blending the two distributions.
  arXiv  Detail & Related papers  (2024-06-09T15:50:35Z)
• Diffusion Model for Data-Driven Black-Box Optimization [54.25693582870226]
  We focus on diffusion models, a powerful generative AI technology, and investigate their potential for black-box optimization. We study two practical types of labels: 1) noisy measurements of a real-valued reward function and 2) human preference based on pairwise comparisons. Our proposed method reformulates the design optimization problem into a conditional sampling problem, which allows us to leverage the power of diffusion models.
  arXiv  Detail & Related papers  (2024-03-20T00:41:12Z)
• N-representable one-electron reduced density matrix reconstruction with frozen core electrons [0.0]
  Recent advances in quantum crystallography have shown that a one-electron reduced density matrix (1-RDM) satisfying N-representability conditions can be reconstructed. An improved model, including symmetry constraints and frozen-core electron contribution, is introduced to better handle the increasing system complexity. The robustness of the model and the strategy are shown to be well-adapted to address the reconstruction problem from actual experimental scattering data.
  arXiv  Detail & Related papers  (2024-03-01T13:48:05Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Crystal Structure Prediction by Joint Equivariant Diffusion [27.52168842448489]
  Crystal Structure Prediction (CSP) is crucial in various scientific disciplines. This paper proposes DiffCSP, a novel diffusion model to learn the structure distribution from stable crystals.
  arXiv  Detail & Related papers  (2023-07-30T15:46:33Z)
• EigenFold: Generative Protein Structure Prediction with Diffusion Models [10.24107243529341]
  EigenFold is a diffusion generative modeling framework for sampling a distribution of structures from a given protein sequence. On recent CAMEO targets, EigenFold achieves a median TMScore of 0.84, while providing a more comprehensive picture of model uncertainty.
  arXiv  Detail & Related papers  (2023-04-05T02:46:13Z)
• An Energy-Based Prior for Generative Saliency [62.79775297611203]
  We propose a novel generative saliency prediction framework that adopts an informative energy-based model as a prior distribution. With the generative saliency model, we can obtain a pixel-wise uncertainty map from an image, indicating model confidence in the saliency prediction. Experimental results show that our generative saliency model with an energy-based prior can achieve not only accurate saliency predictions but also reliable uncertainty maps consistent with human perception.
  arXiv  Detail & Related papers  (2022-04-19T10:51:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.