Fast and Sample-Efficient Interatomic Neural Network Potentials for Molecules and Materials Based on Gaussian Moments

• URL: http://arxiv.org/abs/2109.09569v1
• Date: Mon, 20 Sep 2021 14:23:34 GMT
• Title: Fast and Sample-Efficient Interatomic Neural Network Potentials for Molecules and Materials Based on Gaussian Moments
• Abstract summary: We present an improved NN architecture based on the previous GM-NN model. The improved methodology is a pre-requisite for training-heavy such as active learning or learning-on-the-fly.
• Score: 3.1829446824051195
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Artificial neural networks (NNs) are one of the most frequently used machine learning approaches to construct interatomic potentials and enable efficient large-scale atomistic simulations with almost ab initio accuracy. However, the simultaneous training of NNs on energies and forces, which are a prerequisite for, e.g., molecular dynamics simulations, can be demanding. In this work, we present an improved NN architecture based on the previous GM-NN model [V. Zaverkin and J. K\"astner, J. Chem. Theory Comput. 16, 5410-5421 (2020)], which shows an improved prediction accuracy and considerably reduced training times. Moreover, we extend the applicability of Gaussian moment-based interatomic potentials to periodic systems and demonstrate the overall excellent transferability and robustness of the respective models. The fast training by the improved methodology is a pre-requisite for training-heavy workflows such as active learning or learning-on-the-fly.

Related papers

• Improving Molecular Force Fields with Minimal Temporal Information [16.891516426181763]
  We introduce a novel training strategy called FRAMES, that use an auxiliary loss function for exploiting the temporal relationships within MD trajectories.<n>On the widely used MD17 and ISO17 benchmarks, FRAMES significantly outperforms its Equiformer baseline, achieving highly competitive results in both energy and force accuracy.
  arXiv  Detail & Related papers  (2026-04-14T04:05:09Z)
• Autotuning T-PaiNN: Enabling Data-Efficient GNN Interatomic Potential Development via Classical-to-Quantum Transfer Learning [0.0]
  We introduce a transfer learning framework, Transfer-PaiNN, that substantially improves the data efficiency of GNN-MLIPs by leveraging inexpensive classical force field data.<n>We demonstrate the effectiveness of autotuning T-PaiNN on both gas-phase molecular systems and condensed-phase liquid water.<n>For example, using the QM9 data set, error reductions of up to 25 times are observed in low-data regimes, while liquid water simulations show improved predictions of energies, forces, and experimentally relevant properties such as density and diffusion.
  arXiv  Detail & Related papers  (2026-03-25T19:22:56Z)
• Universal and efficient graph neural networks with dynamic attention for machine learning interatomic potentials [3.2024465912572015]
  Machine learning interatomic potentials (MLIPs) promise near-quantum accuracy at linear cost, but existing models still face challenges in efficiency and stability.<n>We present Machine Learning Advances Neural Network (MLANet), an efficient and robust graph neural network framework.
  arXiv  Detail & Related papers  (2026-03-24T05:14:33Z)
• FORT: Forward-Only Regression Training of Normalizing Flows [85.66894616735752]
  We revisit classical normalizing flows as one-step generative models with exact likelihoods.<n>We propose a novel, scalable training objective that does not require computing the expensive change of variable formula used in conventional maximum likelihood training.
  arXiv  Detail & Related papers  (2025-06-01T20:32:27Z)
• The Bigger the Better? Accurate Molecular Potential Energy Surfaces from Minimalist Neural Networks [0.0]
  KerNN is a combined kernel/neural network-based approach to represent molecular PESs. Compared to state-of-the-art neural network PESs the number of learnable parameters of KerNN is significantly reduced. KerNN shows excellent performance on test set statistics and observables including vibrational bands computed from classical and quantum simulations.
  arXiv  Detail & Related papers  (2024-11-27T08:01:21Z)
• Scalable Mechanistic Neural Networks [52.28945097811129]
  We propose an enhanced neural network framework designed for scientific machine learning applications involving long temporal sequences. By reformulating the original Mechanistic Neural Network (MNN) we reduce the computational time and space complexities from cubic and quadratic with respect to the sequence length, respectively, to linear. Extensive experiments demonstrate that S-MNN matches the original MNN in precision while substantially reducing computational resources.
  arXiv  Detail & Related papers  (2024-10-08T14:27:28Z)
• How neural networks learn to classify chaotic time series [77.34726150561087]
  We study the inner workings of neural networks trained to classify regular-versus-chaotic time series. We find that the relation between input periodicity and activation periodicity is key for the performance of LKCNN models.
  arXiv  Detail & Related papers  (2023-06-04T08:53:27Z)
• Transfer learning for atomistic simulations using GNNs and kernel mean embeddings [24.560340485988128]
  We propose a transfer learning algorithm that leverages the ability of graph neural networks (GNNs) to represent chemical environments together with kernel mean embeddings. We test our approach on a series of realistic datasets of increasing complexity, showing excellent generalization and transferability performance.
  arXiv  Detail & Related papers  (2023-06-02T14:58:16Z)
• Denoise Pretraining on Nonequilibrium Molecules for Accurate and Transferable Neural Potentials [8.048439531116367]
  We propose denoise pretraining on nonequilibrium molecular conformations to achieve more accurate and transferable GNN potential predictions. Our models pretrained on small molecules demonstrate remarkable transferability, improving performance when fine-tuned on diverse molecular systems.
  arXiv  Detail & Related papers  (2023-03-03T21:15:22Z)
• Transfer learning for chemically accurate interatomic neural network potentials [0.0]
  We show that pre-training the network parameters on data obtained from density functional calculations improves the sample efficiency of models trained on more accurate ab-initio data. We provide GM-NN potentials pre-trained and fine-tuned on the ANI-1x and ANI-1ccx data sets, which can easily be fine-tuned on and applied to organic molecules.
  arXiv  Detail & Related papers  (2022-12-07T19:21:01Z)
• Intelligence Processing Units Accelerate Neuromorphic Learning [52.952192990802345]
  Spiking neural networks (SNNs) have achieved orders of magnitude improvement in terms of energy consumption and latency. We present an IPU-optimized release of our custom SNN Python package, snnTorch.
  arXiv  Detail & Related papers  (2022-11-19T15:44:08Z)
• Enhanced physics-constrained deep neural networks for modeling vanadium redox flow battery [62.997667081978825]
  We propose an enhanced version of the physics-constrained deep neural network (PCDNN) approach to provide high-accuracy voltage predictions. The ePCDNN can accurately capture the voltage response throughout the charge--discharge cycle, including the tail region of the voltage discharge curve.
  arXiv  Detail & Related papers  (2022-03-03T19:56:24Z)
• EINNs: Epidemiologically-Informed Neural Networks [75.34199997857341]
  We introduce a new class of physics-informed neural networks-EINN-crafted for epidemic forecasting. We investigate how to leverage both the theoretical flexibility provided by mechanistic models as well as the data-driven expressability afforded by AI models.
  arXiv  Detail & Related papers  (2022-02-21T18:59:03Z)
• ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations [86.41674945012369]
  We develop a scalable and expressive Graph Neural Networks model, ForceNet, to approximate atomic forces. Our proposed ForceNet is able to predict atomic forces more accurately than state-of-the-art physics-based GNNs.
  arXiv  Detail & Related papers  (2021-03-02T03:09:06Z)
• SE(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials [0.17590081165362778]
  NequIP is a SE(3)-equivariant neural network approach for learning interatomic potentials from ab-initio calculations for molecular dynamics simulations. The method achieves state-of-the-art accuracy on a challenging set of diverse molecules and materials while exhibiting remarkable data efficiency.
  arXiv  Detail & Related papers  (2021-01-08T18:49:10Z)
• U(1) symmetric recurrent neural networks for quantum state reconstruction [0.4014524824655105]
  We employ a recurrent neural network (RNN) to reconstruct the ground state of the spin-1/2 XY model. We show that imposing U(1) symmetry on the RNN significantly increases the efficiency of learning.
  arXiv  Detail & Related papers  (2020-10-27T18:00:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.