Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials

• URL: http://arxiv.org/abs/2403.09811v1
• Date: Thu, 14 Mar 2024 18:59:54 GMT
• Title: Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials
• Authors: Christian M. Clausen, Jan Rossmeisl, Zachary W. Ulissi,
• Abstract summary: We show the results of adjusting and fine-tuning the pretrained EquiformerV2 model from the Open Catalyst Project. By applying an energy filter based on the local environment of the binding site the zero-shot inference is markedly improved. It is also found that EquiformerV2, assuming the role of general machine learning potential, is able to inform a smaller, more focused direct inference model.
• Score: 0.5812062802134551
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Computational high-throughput studies, especially in research on high-entropy materials and catalysts, are hampered by high-dimensional composition spaces and myriad structural microstates. They present bottlenecks to the conventional use of density functional theory calculations, and consequently, the use of machine-learned potentials is becoming increasingly prevalent in atomic structure simulations. In this communication, we show the results of adjusting and fine-tuning the pretrained EquiformerV2 model from the Open Catalyst Project to infer adsorption energies of *OH and *O on the out-of-domain high-entropy alloy Ag-Ir-Pd-Pt-Ru. By applying an energy filter based on the local environment of the binding site the zero-shot inference is markedly improved and through few-shot fine-tuning the model yields state-of-the-art accuracy. It is also found that EquiformerV2, assuming the role of general machine learning potential, is able to inform a smaller, more focused direct inference model. This knowledge distillation setup boosts performance on complex binding sites. Collectively, this shows that foundational knowledge learned from ordered intermetallic structures, can be extrapolated to the highly disordered structures of solid-solutions. With the vastly accelerated computational throughput of these models, hitherto infeasible research in the high-entropy material space is now readily accessible.

Related papers

• Investigating the Behavior of Diffusion Models for Accelerating Electronic Structure Calculations [24.116064925926914]
  Investigation driven by their potential to significantly accelerate electronic structure calculations using machine learning. We show that the model learns about the first-order structure of the potential energy surface, and then later learns about higher-order structure. For structure relaxations, the model finds geometries with 10x lower energy than those produced by a classical force field for small organic molecules.
  arXiv  Detail & Related papers  (2023-11-02T17:58:37Z)
• Scalable Diffusion for Materials Generation [99.71001883652211]
  We develop a unified crystal representation that can represent any crystal structure (UniMat) UniMat can generate high fidelity crystal structures from larger and more complex chemical systems. We propose additional metrics for evaluating generative models of materials.
  arXiv  Detail & Related papers  (2023-10-18T15:49:39Z)
• Low-cost machine learning approach to the prediction of transition metal phosphor excited state properties [0.4306143768014156]
  Photoactive iridium complexes are of broad interest due to their applications ranging from lighting to photocatalysis. We leverage low-cost machine learning (ML) models to predict the excited state properties of iridium complexes.
  arXiv  Detail & Related papers  (2022-09-18T16:24:07Z)
• Multi-Task Mixture Density Graph Neural Networks for Predicting Cu-based Single-Atom Alloy Catalysts for CO2 Reduction Reaction [61.9212585617803]
  Graph neural networks (GNNs) have drawn more and more attention from material scientists. We develop a multi-task (MT) architecture based on DimeNet++ and mixture density networks to improve the performance of such task.
  arXiv  Detail & Related papers  (2022-09-15T13:52:15Z)
• Improving Molecular Representation Learning with Metric Learning-enhanced Optimal Transport [49.237577649802034]
  We develop a novel optimal transport-based algorithm termed MROT to enhance their generalization capability for molecular regression problems. MROT significantly outperforms state-of-the-art models, showing promising potential in accelerating the discovery of new substances.
  arXiv  Detail & Related papers  (2022-02-13T04:56:18Z)
• BIGDML: Towards Exact Machine Learning Force Fields for Materials [55.944221055171276]
  Machine-learning force fields (MLFF) should be accurate, computationally and data efficient, and applicable to molecules, materials, and interfaces thereof. Here, we introduce the Bravais-Inspired Gradient-Domain Machine Learning approach and demonstrate its ability to construct reliable force fields using a training set with just 10-200 atoms.
  arXiv  Detail & Related papers  (2021-06-08T10:14:57Z)
• Enhancement of quantum correlations and geometric phase for a driven bipartite quantum system in a structured environment [77.34726150561087]
  We study the role of driving in an initial maximally entangled state evolving under a structured environment. This knowledge can aid the search for physical setups that best retain quantum properties under dissipative dynamics.
  arXiv  Detail & Related papers  (2021-03-18T21:11:37Z)
• A Universal Framework for Featurization of Atomistic Systems [0.0]
  Reactive force fields based on physics or machine learning can be used to bridge the gap in time and length scales. We introduce the Gaussian multi-pole (GMP) featurization scheme that utilizes physically-relevant multi-pole expansions of the electron density around atoms. We demonstrate that GMP-based models can achieve chemical accuracy for the QM9 dataset, and their accuracy remains reasonable even when extrapolating to new elements.
  arXiv  Detail & Related papers  (2021-02-04T03:11:00Z)
• Deep learning for synthetic microstructure generation in a materials-by-design framework for heterogeneous energetic materials [0.0]
  Multi-scale predictive models of chemical reactions account for the physics at the meso-scale. Meso-scale physics is infused in machine-learned closure models informed by resolved meso-scale simulations. We propose utilizing generative adversarial networks (GAN) to spawn ensembles of synthetic heterogeneous energetic material microstructures.
  arXiv  Detail & Related papers  (2020-04-05T16:58:31Z)
• Machine Learning Enabled Discovery of Application Dependent Design Principles for Two-dimensional Materials [1.1470070927586016]
  We train an ensemble of models to predict thermodynamic, mechanical, and electronic properties. We carry out a screening of nearly 45,000 structures for two largely disjoint applications. We find that hybrid organic-inorganic perovskites with lead and tin tend to be good candidates for solar cell applications.
  arXiv  Detail & Related papers  (2020-03-19T23:13:50Z)
• Explainable Deep Relational Networks for Predicting Compound-Protein Affinities and Contacts [80.69440684790925]
  DeepRelations is a physics-inspired deep relational network with intrinsically explainable architecture. It shows superior interpretability to the state-of-the-art. It boosts the AUPRC of contact prediction 9.5, 16.9, 19.3 and 5.7-fold for the test, compound-unique, protein-unique, and both-unique sets.
  arXiv  Detail & Related papers  (2019-12-29T00:14:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.