PDDFormer: Pairwise Distance Distribution Graph Transformer for Crystal Material Property Prediction

• URL: http://arxiv.org/abs/2408.12984v4
• Date: Sun, 24 Nov 2024 08:10:52 GMT
• Title: PDDFormer: Pairwise Distance Distribution Graph Transformer for Crystal Material Property Prediction
• Authors: Xiangxiang Shen, Zheng Wan, Lingfeng Wen, Licheng Sun, Ou Yang Ming Jie, JiJUn Cheng, Xuan Tang, Xian Wei,
• Abstract summary: We propose the atom-Weighted Pairwise Distance Distribution (WPDD) and Unit cell Pairwise Distance Distribution (UPDD) for the first time, incorporating them into the construction of multi-edge crystal graphs. We demonstrate that this method maintains the continuity and completeness of crystal graphs even under slight perturbations in atomic positions.
• Score: 8.36720478795747
• License:
• Abstract: The crystal structure can be simplified as a periodic point set repeating across the entire three-dimensional space along an underlying lattice. Traditionally, methods for representing crystals rely on descriptors like lattice parameters, symmetry, and space groups to characterize the structure. However, in reality, atoms in material always vibrate above absolute zero, causing continuous fluctuations in their positions. This dynamic behavior disrupts the underlying periodicity of the lattice, making crystal graphs based on static lattice parameters and conventional descriptors discontinuous under even slight perturbations. To this end, chemists proposed the Pairwise Distance Distribution (PDD) method, which has been used to distinguish all periodic structures in the world's largest real materials collection, the Cambridge Structural Database. However, achieving the completeness of PDD requires defining a large number of neighboring atoms, resulting in high computational costs. Moreover, it does not account for atomic information, making it challenging to directly apply PDD to crystal material property prediction tasks. To address these challenges, we propose the atom-Weighted Pairwise Distance Distribution (WPDD) and Unit cell Pairwise Distance Distribution (UPDD) for the first time, incorporating them into the construction of multi-edge crystal graphs. Based on this, we further developed WPDDFormer and UPDDFormer, graph transformer architecture constructed using WPDD and UPDD crystal graphs. We demonstrate that this method maintains the continuity and completeness of crystal graphs even under slight perturbations in atomic positions.

Related papers

• CrysToGraph: A Comprehensive Predictive Model for Crystal Materials Properties and the Benchmark [16.456990796982186]
  We propose CrysToGraph ($textbfCrys$tals with $textbfT$ransformers $textbfo$n $textbfGraph$s), a novel transformer-based graph geometric network designed specifically for unconventional crystalline systems. CrysToGraph effectively captures short-range interactions with transformer-based graph convolution blocks as well as long-range interactions with graph-wise transformer blocks. It outperforms most existing methods, achieving new state-of-the-art results on the benchmarks of both unconventional crystals and traditional crystals
  arXiv  Detail & Related papers  (2024-07-23T02:31:06Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• Accelerating Material Property Prediction using Generically Complete Isometry Invariants [3.031375888004876]
  We adapt the Pointwise Distance Distribution (PDD) as a representation for our learning algorithm. We develop a transformer model with a modified self-attention mechanism that combines PDD with compositional information via a spatial encoding method. This model is tested on the crystals of the Materials Project and Jarvis-DFT databases and shown to produce accuracy on par with state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-22T15:14:22Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Crystal Structure Prediction by Joint Equivariant Diffusion [27.52168842448489]
  Crystal Structure Prediction (CSP) is crucial in various scientific disciplines. This paper proposes DiffCSP, a novel diffusion model to learn the structure distribution from stable crystals.
  arXiv  Detail & Related papers  (2023-07-30T15:46:33Z)
• Higher-order topological Peierls insulator in a two-dimensional atom-cavity system [58.720142291102135]
  We show how photon-mediated interactions give rise to a plaquette-ordered bond pattern in the atomic ground state. The pattern opens a non-trivial topological gap in 2D, resulting in a higher-order topological phase hosting corner states. Our work shows how atomic quantum simulators can be harnessed to investigate novel strongly-correlated topological phenomena.
  arXiv  Detail & Related papers  (2023-05-05T10:25:14Z)
• DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion [66.21290235237808]
  We introduce an energy constrained diffusion model which encodes a batch of instances from a dataset into evolutionary states. We provide rigorous theory that implies closed-form optimal estimates for the pairwise diffusion strength among arbitrary instance pairs. Experiments highlight the wide applicability of our model as a general-purpose encoder backbone with superior performance in various tasks.
  arXiv  Detail & Related papers  (2023-01-23T15:18:54Z)
• Material Property Prediction using Graphs based on Generically Complete Isometry Invariants [3.031375888004876]
  This work adapts the Pointwise Distance Distribution for a simpler graph whose vertices set is not larger than the asymmetric unit of a crystal structure. The Distribution Graph reduces mean-absolute-error by 0.6%-12% while having 44%-88% of the number of vertices when compared to the crystal graph.
  arXiv  Detail & Related papers  (2022-12-19T18:48:58Z)
• Fast Gravitational Approach for Rigid Point Set Registration with Ordinary Differential Equations [79.71184760864507]
  This article introduces a new physics-based method for rigid point set alignment called Fast Gravitational Approach (FGA) In FGA, the source and target point sets are interpreted as rigid particle swarms with masses interacting in a globally multiply-linked manner while moving in a simulated gravitational force field. We show that the new method class has characteristics not found in previous alignment methods.
  arXiv  Detail & Related papers  (2020-09-28T15:05:39Z)
• Radiative topological biphoton states in modulated qubit arrays [105.54048699217668]
  We study topological properties of bound pairs of photons in spatially-modulated qubit arrays coupled to a waveguide. For open boundary condition, we find exotic topological bound-pair edge states with radiative losses. By joining two structures with different spatial modulations, we find long-lived interface states which may have applications in storage and quantum information processing.
  arXiv  Detail & Related papers  (2020-02-24T04:44:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.