Forces are not Enough: Benchmark and Critical Evaluation for Machine
Learning Force Fields with Molecular Simulations
- URL: http://arxiv.org/abs/2210.07237v2
- Date: Sat, 26 Aug 2023 21:43:19 GMT
- Title: Forces are not Enough: Benchmark and Critical Evaluation for Machine
Learning Force Fields with Molecular Simulations
- Authors: Xiang Fu, Zhenghao Wu, Wujie Wang, Tian Xie, Sinan Keten, Rafael
Gomez-Bombarelli, Tommi Jaakkola
- Abstract summary: Molecular dynamics (MD) simulation techniques are widely used for various natural science applications.
We benchmark a collection of state-of-the-art (SOTA) ML FF models and illustrate, in particular, how the commonly benchmarked force accuracy is not well aligned with relevant simulation metrics.
- Score: 5.138982355658199
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Molecular dynamics (MD) simulation techniques are widely used for various
natural science applications. Increasingly, machine learning (ML) force field
(FF) models begin to replace ab-initio simulations by predicting forces
directly from atomic structures. Despite significant progress in this area,
such techniques are primarily benchmarked by their force/energy prediction
errors, even though the practical use case would be to produce realistic MD
trajectories. We aim to fill this gap by introducing a novel benchmark suite
for learned MD simulation. We curate representative MD systems, including
water, organic molecules, a peptide, and materials, and design evaluation
metrics corresponding to the scientific objectives of respective systems. We
benchmark a collection of state-of-the-art (SOTA) ML FF models and illustrate,
in particular, how the commonly benchmarked force accuracy is not well aligned
with relevant simulation metrics. We demonstrate when and how selected SOTA
methods fail, along with offering directions for further improvement.
Specifically, we identify stability as a key metric for ML models to improve.
Our benchmark suite comes with a comprehensive open-source codebase for
training and simulation with ML FFs to facilitate future work.
Related papers
- Benchmarks as Microscopes: A Call for Model Metrology [76.64402390208576]
Modern language models (LMs) pose a new challenge in capability assessment.
To be confident in our metrics, we need a new discipline of model metrology.
arXiv Detail & Related papers (2024-07-22T17:52:12Z) - Physics Informed Machine Learning (PIML) methods for estimating the remaining useful lifetime (RUL) of aircraft engines [0.0]
This paper is aimed at using the newly developing field of physics informed machine learning (PIML) to develop models for predicting the remaining useful lifetime (RUL) aircraft engines.
We consider the well-known benchmark NASA Commercial Modular Aero-Propulsion System Simulation System (C-MAPSS) data as the main data for this paper.
C-MAPSS is a well-studied dataset with much existing work in the literature that address RUL prediction with classical and deep learning methods.
arXiv Detail & Related papers (2024-06-21T19:55:34Z) - A Multi-Grained Symmetric Differential Equation Model for Learning
Protein-Ligand Binding Dynamics [74.93549765488103]
In drug discovery, molecular dynamics simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites.
We propose NeuralMD, the first machine learning surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding.
We show the efficiency and effectiveness of NeuralMD, with a 2000$times$ speedup over standard numerical MD simulation and outperforming all other ML approaches by up to 80% under the stability metric.
arXiv Detail & Related papers (2024-01-26T09:35:17Z) - Uncertainty-biased molecular dynamics for learning uniformly accurate
interatomic potentials [20.574068788623798]
Active learning (AL) uses either biased or unbiased molecular dynamics (MD) simulations to generate candidate pools.
We use the proposed uncertainty-driven AL approach to develop machine-learned interatomic potentials (MLIPs) for two benchmark systems.
MLIPs trained with the proposed data-generation method more accurately represent the relevant configurational space for both atomic systems.
arXiv Detail & Related papers (2023-12-03T14:39:14Z) - Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous
Driving Research [76.93956925360638]
Waymax is a new data-driven simulator for autonomous driving in multi-agent scenes.
It runs entirely on hardware accelerators such as TPUs/GPUs and supports in-graph simulation for training.
We benchmark a suite of popular imitation and reinforcement learning algorithms with ablation studies on different design decisions.
arXiv Detail & Related papers (2023-10-12T20:49:15Z) - Real-time simulation of viscoelastic tissue behavior with physics-guided
deep learning [0.8250374560598492]
We propose a deep learning method for predicting displacement fields of soft tissues with viselastic properties.
The proposed method achieves a better accuracy over the conventional CNN models.
It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality.
arXiv Detail & Related papers (2023-01-11T18:17:10Z) - Evaluating the Transferability of Machine-Learned Force Fields for
Material Property Modeling [2.494740426749958]
We present a more comprehensive set of benchmarking tests for evaluating the transferability of machine-learned force fields.
We use a graph neural network (GNN)-based force field coupled with the OpenMM package to carry out MD simulations for Argon.
Our results show that the model can accurately capture the behavior of the solid phase only when the configurations from the solid phase are included in the training dataset.
arXiv Detail & Related papers (2023-01-10T00:25:48Z) - Accurate Machine Learned Quantum-Mechanical Force Fields for
Biomolecular Simulations [51.68332623405432]
Molecular dynamics (MD) simulations allow atomistic insights into chemical and biological processes.
Recently, machine learned force fields (MLFFs) emerged as an alternative means to execute MD simulations.
This work proposes a general approach to constructing accurate MLFFs for large-scale molecular simulations.
arXiv Detail & Related papers (2022-05-17T13:08:28Z) - An Extensible Benchmark Suite for Learning to Simulate Physical Systems [60.249111272844374]
We introduce a set of benchmark problems to take a step towards unified benchmarks and evaluation protocols.
We propose four representative physical systems, as well as a collection of both widely used classical time-based and representative data-driven methods.
arXiv Detail & Related papers (2021-08-09T17:39:09Z) - Machine Learning Force Fields [54.48599172620472]
Machine Learning (ML) has enabled numerous advances in computational chemistry.
One of the most promising applications is the construction of ML-based force fields (FFs)
This review gives an overview of applications of ML-FFs and the chemical insights that can be obtained from them.
arXiv Detail & Related papers (2020-10-14T13:14:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.