De novo Drug Design using Reinforcement Learning with Multiple GPT Agents

• URL: http://arxiv.org/abs/2401.06155v1
• Date: Thu, 21 Dec 2023 13:24:03 GMT
• Title: De novo Drug Design using Reinforcement Learning with Multiple GPT Agents
• Authors: Xiuyuan Hu, Guoqing Liu, Yang Zhao, Hao Zhang
• Abstract summary: MolRL-MGPT is a reinforcement learning algorithm with multiple GPT agents for drug molecular generation. Our algorithm has shown promising results on the GuacaMol benchmark and exhibits efficacy in designing inhibitors against SARS-CoV-2 protein targets.
• Score: 16.508471997999496
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: De novo drug design is a pivotal issue in pharmacology and a new area of focus in AI for science research. A central challenge in this field is to generate molecules with specific properties while also producing a wide range of diverse candidates. Although advanced technologies such as transformer models and reinforcement learning have been applied in drug design, their potential has not been fully realized. Therefore, we propose MolRL-MGPT, a reinforcement learning algorithm with multiple GPT agents for drug molecular generation. To promote molecular diversity, we encourage the agents to collaborate in searching for desirable molecules in diverse directions. Our algorithm has shown promising results on the GuacaMol benchmark and exhibits efficacy in designing inhibitors against SARS-CoV-2 protein targets. The codes are available at: https://github.com/HXYfighter/MolRL-MGPT.

Related papers

• FARM: Functional Group-Aware Representations for Small Molecules [55.281754551202326]
  We introduce Functional Group-Aware Representations for Small Molecules (FARM) FARM is a foundation model designed to bridge the gap between SMILES, natural language, and molecular graphs. We rigorously evaluate FARM on the MoleculeNet dataset, where it achieves state-of-the-art performance on 10 out of 12 tasks.
  arXiv  Detail & Related papers  (2024-10-02T23:04:58Z)
• DecompDiff: Diffusion Models with Decomposed Priors for Structure-Based Drug Design [62.68420322996345]
  Existing structured-based drug design methods treat all ligand atoms equally. We propose a new diffusion model, DecompDiff, with decomposed priors over arms and scaffold. Our approach achieves state-of-the-art performance in generating high-affinity molecules.
  arXiv  Detail & Related papers  (2024-02-26T05:21:21Z)
• Multi-objective Molecular Optimization for Opioid Use Disorder Treatment Using Generative Network Complex [5.33208055504216]
  Opioid Use Disorder (OUD) has emerged as a significant global health issue. In this study, we propose a deep generative model that combines a differential equation (SDE)-based diffusion modeling with the latent space of a pretrained autoencoder model. The molecular generator enables efficient generation of molecules that are effective on multiple targets.
  arXiv  Detail & Related papers  (2023-06-13T01:12:31Z)
• Optimizing Drug Design by Merging Generative AI With Active Learning Frameworks [2.6062146828550903]
  We have developed a Generative AI (GM) workflow based on a variational autoencoder and active learning steps. The designed GM workflow iteratively learns from molecular metrics, including drug likeliness, synthesizability, similarity, and docking scores. The proportion of high-affinity molecules inferred by our GM workflow was significantly greater than that in the training data.
  arXiv  Detail & Related papers  (2023-05-04T13:25:14Z)
• Utilizing Reinforcement Learning for de novo Drug Design [2.5740778707024305]
  We develop a unified framework for using reinforcement learning for de novo drug design. We study various on- and off-policy reinforcement learning algorithms and replay buffers to learn an RNN-based policy. Our findings suggest that it is advantageous to use at least both top-scoring and low-scoring molecules for updating the policy.
  arXiv  Detail & Related papers  (2023-03-30T07:40:50Z)
• Target Specific De Novo Design of Drug Candidate Molecules with Graph Transformer-based Generative Adversarial Networks [0.0]
  We propose an end-to-end generative system, DrugGEN, for the de novo design of drug candidate molecules. The system is trained using a large dataset of drug-like compounds and target-specific bioactive molecules. Using the open-access DrugGEN, it is possible to easily train models for other druggable proteins.
  arXiv  Detail & Related papers  (2023-02-15T18:59:27Z)
• Tailoring Molecules for Protein Pockets: a Transformer-based Generative Solution for Structured-based Drug Design [133.1268990638971]
  De novo drug design based on the structure of a target protein can provide novel drug candidates. We present a generative solution named TamGent that can directly generate candidate drugs from scratch for a given target.
  arXiv  Detail & Related papers  (2022-08-30T09:32:39Z)
• Retrieval-based Controllable Molecule Generation [63.44583084888342]
  We propose a new retrieval-based framework for controllable molecule generation. We use a small set of molecules to steer the pre-trained generative model towards synthesizing molecules that satisfy the given design criteria. Our approach is agnostic to the choice of generative models and requires no task-specific fine-tuning.
  arXiv  Detail & Related papers  (2022-08-23T17:01:16Z)
• PGMG: A Pharmacophore-Guided Deep Learning Approach for Bioactive Molecular Generation [5.168827506745199]
  We propose PGMG, a pharmacophore-guided deep learning approach for bioactivate molecule generation. We show that PGMG can generate molecules matching given pharmacophore models while maintaining a high level of validity, uniqueness, and novelty. Overall, the flexibility and effectiveness of PGMG make it a useful tool for accelerating the drug discovery process.
  arXiv  Detail & Related papers  (2022-07-02T12:31:17Z)
• Exploring Chemical Space with Score-based Out-of-distribution Generation [57.15855198512551]
  We propose a score-based diffusion scheme that incorporates out-of-distribution control in the generative differential equation (SDE) Since some novel molecules may not meet the basic requirements of real-world drugs, MOOD performs conditional generation by utilizing the gradients from a property predictor. We experimentally validate that MOOD is able to explore the chemical space beyond the training distribution, generating molecules that outscore ones found with existing methods, and even the top 0.01% of the original training pool.
  arXiv  Detail & Related papers  (2022-06-06T06:17:11Z)
• MIMOSA: Multi-constraint Molecule Sampling for Molecule Optimization [51.00815310242277]
  generative models and reinforcement learning approaches made initial success, but still face difficulties in simultaneously optimizing multiple drug properties. We propose the MultI-constraint MOlecule SAmpling (MIMOSA) approach, a sampling framework to use input molecule as an initial guess and sample molecules from the target distribution.
  arXiv  Detail & Related papers  (2020-10-05T20:18:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.