Best Practices for Multi-Fidelity Bayesian Optimization in Materials and Molecular Research

• URL: http://arxiv.org/abs/2410.00544v1
• Date: Tue, 1 Oct 2024 09:37:36 GMT
• Title: Best Practices for Multi-Fidelity Bayesian Optimization in Materials and Molecular Research
• Authors: Víctor Sabanza-Gil, Riccardo Barbano, Daniel Pacheco Gutiérrez, Jeremy S. Luterbacher, José Miguel Hernández-Lobato, Philippe Schwaller, Loïc Roch,
• Abstract summary: Multi-fidelity Bayesian Optimization (MFBO) is a promising framework to speed up materials and molecular discovery. Despite its potential use in chemical tasks, there is a lack of systematic evaluation of the many parameters playing a role in MFBO. We provide guidelines and recommendations to decide when to use MFBO in experimental settings.
• Score: 23.891927943934768
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-fidelity Bayesian Optimization (MFBO) is a promising framework to speed up materials and molecular discovery as sources of information of different accuracies are at hand at increasing cost. Despite its potential use in chemical tasks, there is a lack of systematic evaluation of the many parameters playing a role in MFBO. In this work, we provide guidelines and recommendations to decide when to use MFBO in experimental settings. We investigate MFBO methods applied to molecules and materials problems. First, we test two different families of acquisition functions in two synthetic problems and study the effect of the informativeness and cost of the approximate function. We use our implementation and guidelines to benchmark three real discovery problems and compare them against their single-fidelity counterparts. Our results may help guide future efforts to implement MFBO as a routine tool in the chemical sciences.

Related papers

• Applying Multi-Fidelity Bayesian Optimization in Chemistry: Open Challenges and Major Considerations [0.0]
  Multi fidelity Bayesian optimization (MFBO) leverages experimental and or computational data of varying quality and resource cost to optimize towards desired maxima cost effectively. Here, we investigate the application of MFBO to accelerate the identification of promising molecules or materials.
  arXiv  Detail & Related papers  (2024-09-11T11:22:17Z)
• CAGES: Cost-Aware Gradient Entropy Search for Efficient Local Multi-Fidelity Bayesian Optimization [0.0]
  We propose a novel algorithm, Cost-Aware Gradient Entropy Search (CAGES), for local BO of multi-fidelity black-box functions. We demonstrate CAGES can achieve significant performance improvements compared to other state-of-the-art methods on a variety of synthetic and benchmark RL problems.
  arXiv  Detail & Related papers  (2024-05-13T14:00:02Z)
• A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics [74.93549765488103]
  In drug discovery, molecular dynamics simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites. We propose NeuralMD, the first machine learning surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding. We show the efficiency and effectiveness of NeuralMD, with a 2000$times$ speedup over standard numerical MD simulation and outperforming all other ML approaches by up to 80% under the stability metric.
  arXiv  Detail & Related papers  (2024-01-26T09:35:17Z)
• Multi-fidelity Bayesian Optimization in Engineering Design [3.9160947065896803]
  Multi-fidelity optimization (MFO) and Bayesian optimization (BO) MF BO has found a niche in solving expensive engineering design optimization problems. Recent developments of two essential ingredients of MF BO: GP-based MF surrogates and acquisition functions.
  arXiv  Detail & Related papers  (2023-11-21T23:22:11Z)
• Multi-Fidelity Bayesian Optimization with Unreliable Information Sources [12.509709549771385]
  We propose rMFBO (robust MFBO) to make GP-based MFBO schemes robust to the addition of unreliable information sources. We demonstrate the effectiveness of the proposed methodology on a number of numerical benchmarks. We expect rMFBO to be particularly useful to reliably include human experts with varying knowledge within BO processes.
  arXiv  Detail & Related papers  (2022-10-25T11:47:33Z)
• Multi-Objective GFlowNets [59.16787189214784]
  We study the problem of generating diverse candidates in the context of Multi-Objective Optimization. In many applications of machine learning such as drug discovery and material design, the goal is to generate candidates which simultaneously optimize a set of potentially conflicting objectives. We propose Multi-Objective GFlowNets (MOGFNs), a novel method for generating diverse optimal solutions, based on GFlowNets.
  arXiv  Detail & Related papers  (2022-10-23T16:15:36Z)
• Reenvisioning Collaborative Filtering vs Matrix Factorization [65.74881520196762]
  Collaborative filtering models based on matrix factorization and learned similarities using Artificial Neural Networks (ANNs) have gained significant attention in recent years. Announcement of ANNs within the recommendation ecosystem has been recently questioned, raising several comparisons in terms of efficiency and effectiveness. We show the potential these techniques may have on beyond-accuracy evaluation while analyzing effect on complementary evaluation dimensions.
  arXiv  Detail & Related papers  (2021-07-28T16:29:38Z)
• Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning [89.31889875864599]
  We propose an efficient model-based reinforcement learning algorithm for learning in multi-agent systems. Our main theoretical contributions are the first general regret bounds for model-based reinforcement learning for MFC. We provide a practical parametrization of the core optimization problem.
  arXiv  Detail & Related papers  (2021-07-08T18:01:02Z)
• Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domains [3.9478770908139085]
  We evaluate the efficiency of BO as a general optimization algorithm across a broad range of experimental materials science domains. We find that for surrogate model selection, Gaussian Process (GP) with anisotropic kernels (automatic relevance detection, ARD) and Random Forests (RF) have comparable performance and both outperform the commonly used GP without ARD.
  arXiv  Detail & Related papers  (2021-05-23T22:04:07Z)
• Optimizing Molecules using Efficient Queries from Property Evaluations [66.66290256377376]
  We propose QMO, a generic query-based molecule optimization framework. QMO improves the desired properties of an input molecule based on efficient queries. We show that QMO outperforms existing methods in the benchmark tasks of optimizing small organic molecules.
  arXiv  Detail & Related papers  (2020-11-03T18:51:18Z)
• Face Anti-Spoofing with Human Material Perception [76.4844593082362]
  Face anti-spoofing (FAS) plays a vital role in securing the face recognition systems from presentation attacks. We rephrase face anti-spoofing as a material recognition problem and combine it with classical human material perception. We propose the Bilateral Convolutional Networks (BCN), which is able to capture intrinsic material-based patterns.
  arXiv  Detail & Related papers  (2020-07-04T18:25:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.