Wyckoff Transformer: Generation of Symmetric Crystals

• URL: http://arxiv.org/abs/2503.02407v2
• Date: Fri, 07 Mar 2025 07:46:34 GMT
• Title: Wyckoff Transformer: Generation of Symmetric Crystals
• Authors: Nikita Kazeev, Wei Nong, Ignat Romanov, Ruiming Zhu, Andrey Ustyuzhanin, Shuya Yamazaki, Kedar Hippalgaonkar,
• Abstract summary: Internal symmetry plays a fundamental role in determining physical, chemical, and electronic properties.<n>We propose WyFormer, a generative model for materials conditioned on space group symmetry.
• Score: 0.5968063252533801
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Symmetry rules that atoms obey when they bond together to form an ordered crystal play a fundamental role in determining their physical, chemical, and electronic properties such as electrical and thermal conductivity, optical and polarization behavior, and mechanical strength. Almost all known crystalline materials have internal symmetry. Consistently generating stable crystal structures is still an open challenge, specifically because such symmetry rules are not accounted for. To address this issue, we propose WyFormer, a generative model for materials conditioned on space group symmetry. We use Wyckoff positions as the basis for an elegant, compressed, and discrete structure representation. To model the distribution, we develop a permutation-invariant autoregressive model based on the Transformer and an absence of positional encoding. WyFormer has a unique and powerful synergy of attributes, proven by extensive experimentation: best-in-class symmetry-conditioned generation, physics-motivated inductive bias, competitive stability of the generated structures, competitive material property prediction quality, and unparalleled inference speed.

Related papers

• Observation of non-Hermitian bulk-boundary correspondence in non-chiral non-unitary quantum dynamics of single photons [31.05848822220465]
  In non-Hermitian systems, preserved chiral symmetry is one of the key ingredients, which plays a pivotal role in determining non-Hermitian topology.<n>We theoretically predict and experimentally demonstrate the bulk-boundary correspondence of a one-dimensional (1D) non-Hermitian system with chiral symmetry breaking.
  arXiv  Detail & Related papers  (2025-04-07T09:43:43Z)
• Controlling Symmetries and Quantum Criticality in the Anisotropic Coupled-Top Model [32.553027955412986]
  We investigate the anisotropic coupled-top model, which describes the interactions between two large spins along both $x-$ and $y-$directions.<n>We can manipulate the system's symmetry, inducing either discrete $Z$ or continuous U(1) symmetry.<n>The framework provides an ideal platform for experimentally controlling symmetries and investigating associated physical phenomena.
  arXiv  Detail & Related papers  (2025-02-13T15:14:29Z)
• WyckoffDiff - A Generative Diffusion Model for Crystal Symmetry [10.650073214237207]
  We propose a generative model, Wyckoff Diffusion, which generates symmetry-based descriptions of crystals.<n>This is enabled by considering a crystal structure representation that encodes all symmetry.<n>In addition to respecting symmetry by construction, the discrete nature of our model enables fast generation.
  arXiv  Detail & Related papers  (2025-02-10T14:04:23Z)
• SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Models [20.39521603857931]
  We propose SymmCD, a novel generative model that incorporates crystallographic symmetry into the generative process.<n>We decompose crystals into two components and learn their joint distribution through diffusion.<n>We showcase the competitive performance of SymmCD on a subset of the Materials Project, obtaining diverse and valid crystals with realistic symmetries and predicted properties.
  arXiv  Detail & Related papers  (2025-02-05T21:48:48Z)
• CrystalGRW: Generative Modeling of Crystal Structures with Targeted Properties via Geodesic Random Walks [1.2141052067494946]
  We introduce CrystalGRW, a diffusion-based generative model that can predict stable phases validated by density functional theory.<n>CrystalGRW demonstrates the ability to generate realistic crystal structures that are close to their ground states with accuracy comparable to existing models.<n>These features help accelerate materials discovery and inverse design by offering stable, symmetry-consistent crystal candidates for experimental validation.
  arXiv  Detail & Related papers  (2025-01-15T18:26:35Z)
• Tensor product random matrix theory [39.58317527488534]
  We introduce a real-time field theory approach to the evolution of correlated quantum systems. We describe the full range of such crossover dynamics, from initial product states to a maximum entropy ergodic state.
  arXiv  Detail & Related papers  (2024-04-16T21:40:57Z)
• Complete and Efficient Graph Transformers for Crystal Material Property Prediction [53.32754046881189]
  Crystal structures are characterized by atomic bases within a primitive unit cell that repeats along a regular lattice throughout 3D space. We introduce a novel approach that utilizes the periodic patterns of unit cells to establish the lattice-based representation for each atom. We propose ComFormer, a SE(3) transformer designed specifically for crystalline materials.
  arXiv  Detail & Related papers  (2024-03-18T15:06:37Z)
• Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding [10.170537065646323]
  Predicting physical properties of materials from their crystal structures is a fundamental problem in materials science. We show that crystal structures are infinitely repeating, periodic arrangements of atoms, whose fully connected attention results in infinitely connected attention. We propose a simple yet effective Transformer-based encoder architecture for crystal structures called Crystalformer.
  arXiv  Detail & Related papers  (2024-03-18T11:37:42Z)
• Amorphous quantum magnets in a two-dimensional Rydberg atom array [44.99833362998488]
  We propose to explore amorphous quantum magnets with an analog quantum simulator. We first present an algorithm to generate amorphous quantum magnets, suitable for Rydberg simulators of the Ising model. We then use semiclassical approaches to get a preliminary insight of the physics of the model.
  arXiv  Detail & Related papers  (2024-02-05T10:07:10Z)
• Quench dynamics in higher-dimensional Holstein models: Insights from Truncated Wigner Approaches [41.94295877935867]
  We study the melting of charge-density waves in a Holstein model after a sudden switch-on of the electronic hopping. A comparison with exact data obtained for a Holstein chain shows that a semiclassical treatment of both the electrons and phonons is required in order to correctly describe the phononic dynamics.
  arXiv  Detail & Related papers  (2023-12-19T16:14:01Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Latent Conservative Objective Models for Data-Driven Crystal Structure Prediction [62.36797874900395]
  In computational chemistry, crystal structure prediction is an optimization problem. One approach to tackle this problem involves building simulators based on density functional theory (DFT) followed by running search in simulation. We show that our approach, dubbed LCOMs (latent conservative objective models), performs comparably to the best current approaches in terms of success rate of structure prediction.
  arXiv  Detail & Related papers  (2023-10-16T04:35:44Z)
• Data-Driven Score-Based Models for Generating Stable Structures with Adaptive Crystal Cells [1.515687944002438]
  This work aims at the generation of new crystal structures with desired properties, such as chemical stability and specified chemical composition. The novelty of the presented approach resides in the fact that the lattice of the crystal cell is not fixed. A multigraph crystal representation is introduced that respects symmetry constraints, yielding computational advantages.
  arXiv  Detail & Related papers  (2023-10-16T02:53:24Z)
• Unconditional Wigner-negative mechanical entanglement with linear-and-quadratic optomechanical interactions [62.997667081978825]
  We propose two schemes for generating Wigner-negative entangled states unconditionally in mechanical resonators. We show analytically that both schemes stabilize a Wigner-negative entangled state that combines the entanglement of a two-mode squeezed vacuum with a cubic nonlinearity. We then perform extensive numerical simulations to test the robustness of Wigner-negative entanglement attained by approximate CPE states stabilized in the presence of thermal decoherence.
  arXiv  Detail & Related papers  (2023-02-07T19:00:08Z)
• Fast electrons interacting with chiral matter: mirror symmetry breaking of quantum decoherence and lateral momentum transfer [91.3755431537592]
  We show that matter chirality breaks mirror symmetry of scattered electrons quantum decoherence. We also prove that mirror asymmetry also shows up in the distribution of the electron lateral momentum.
  arXiv  Detail & Related papers  (2022-04-07T15:06:27Z)
• Crystal Diffusion Variational Autoencoder for Periodic Material Generation [29.558155407825115]
  We propose a Crystal Diffusion Variational Autoencoder (CDVAE) that captures the inductive bias of material stability. By learning from the data distribution of stable materials, the decoder generates materials in a diffusion process that moves atomic coordinates towards a lower energy state. We significantly outperform past methods in three tasks: 1) reconstructing the input structure, 2) generating valid, diverse, and realistic materials, and 3) generating materials that optimize a specific property.
  arXiv  Detail & Related papers  (2021-10-12T17:49:49Z)
• Spin Entanglement and Magnetic Competition via Long-range Interactions in Spinor Quantum Optical Lattices [62.997667081978825]
  We study the effects of cavity mediated long range magnetic interactions and optical lattices in ultracold matter. We find that global interactions modify the underlying magnetic character of the system while introducing competition scenarios. These allow new alternatives toward the design of robust mechanisms for quantum information purposes.
  arXiv  Detail & Related papers  (2020-11-16T08:03:44Z)
• Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers [42.93754828584075]
  We present a new Transformer architecture, Performer, based on Fast Attention Via Orthogonal Random features (FAVOR) Our mechanism scales linearly rather than quadratically in the number of tokens in the sequence, is characterized by sub-quadratic space complexity and does not incorporate any sparsity pattern priors. It provides strong theoretical guarantees: unbiased estimation of the attention matrix and uniform convergence.
  arXiv  Detail & Related papers  (2020-06-05T17:09:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.