Applications of Modular Co-Design for De Novo 3D Molecule Generation

• URL: http://arxiv.org/abs/2505.18392v1
• Date: Fri, 23 May 2025 21:41:56 GMT
• Title: Applications of Modular Co-Design for De Novo 3D Molecule Generation
• Authors: Danny Reidenbach, Filipp Nikitin, Olexandr Isayev, Saee Paliwal,
• Abstract summary: We present Megalodon, a family of scalable transformer models.<n>These models are enhanced with basic equivariant layers and trained using a joint continuous and discrete denoising co-design objective.<n>We show that Megalodon achieves state-of-the-art results in 3D molecule generation, conditional structure generation, and structure energy benchmarks using diffusion and flow matching.
• Score: 0.6903111965769448
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: De novo 3D molecule generation is a pivotal task in drug discovery. However, many recent geometric generative models struggle to produce high-quality 3D structures, even if they maintain 2D validity and topological stability. To tackle this issue and enhance the learning of effective molecular generation dynamics, we present Megalodon-a family of scalable transformer models. These models are enhanced with basic equivariant layers and trained using a joint continuous and discrete denoising co-design objective. We assess Megalodon's performance on established molecule generation benchmarks and introduce new 3D structure benchmarks that evaluate a model's capability to generate realistic molecular structures, particularly focusing on energetics. We show that Megalodon achieves state-of-the-art results in 3D molecule generation, conditional structure generation, and structure energy benchmarks using diffusion and flow matching. Furthermore, doubling the number of parameters in Megalodon to 40M significantly enhances its performance, generating up to 49x more valid large molecules and achieving energy levels that are 2-10x lower than those of the best prior generative models.

Related papers

• Zatom-1: A Multimodal Flow Foundation Model for 3D Molecules and Materials [51.342983349686556]
  General-purpose 3D chemical modeling encompasses molecules and materials, requiring both generative and predictive capabilities.<n>We introduce Zatom-1, the first end-to-end, fully open-source foundation model that unifies generative and predictive learning of 3D molecules and materials.
  arXiv  Detail & Related papers  (2026-02-24T20:52:39Z)
• Uncertainty-Aware Multi-Objective Reinforcement Learning-Guided Diffusion Models for 3D De Novo Molecular Design [0.8749675983608171]
  We propose an uncertainty-aware Reinforcement Learning framework to guide the optimization of 3D molecular diffusion models.<n>Our results demonstrate the strong potential of RL-guided generative diffusion models for advancing automated molecular design.
  arXiv  Detail & Related papers  (2025-10-24T04:49:23Z)
• FlowMol3: Flow Matching for 3D De Novo Small-Molecule Generation [0.0]
  FlowMol3 is an open-source, multi-modal flow matching model that advances the state of the art for all-atom, small-molecule generation.<n>Our results highlight simple, transferable strategies for improving the stability and quality of diffusion- and flow-based molecular generative models.
  arXiv  Detail & Related papers  (2025-08-18T05:13:27Z)
• Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling [77.26556208024633]
  3D molecule generation is crucial for drug discovery and material science.<n>Existing approaches typically maintain separate latent spaces for invariant and equivariant modalities.<n>We propose textbfUAE-3D, a multi-modal VAE that compresses 3D molecules into latent sequences from a unified latent space.
  arXiv  Detail & Related papers  (2025-03-19T08:56:13Z)
• NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation [72.22099363325145]
  We propose a foundation model -- NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation.<n>NExT-Mol uses an extensively pretrained molecule LM for 1D molecule generation, and subsequently predicts the generated molecule's 3D conformers.<n>We enhance NExT-Mol's performance by scaling up the LM's model size, refining the diffusion neural architecture, and applying 1D to 3D transfer learning.
  arXiv  Detail & Related papers  (2025-02-18T08:40:13Z)
• LMDM:Latent Molecular Diffusion Model For 3D Molecule Generation [6.720821935934759]
  We propose a latent molecular diffusion model that can make generated 3D molecules rich in diversity and maintain rich geometric features.<n>The model captures the information of the forces and local constraints between atoms so that the generated molecules can maintain Euclidean transformation.<n>In the experiment, the quality of the samples we generated and the convergence speed of the model have been significantly improved.
  arXiv  Detail & Related papers  (2024-12-05T15:25:18Z)
• Neural P$^3$M: A Long-Range Interaction Modeling Enhancer for Geometric GNNs [66.98487644676906]
  We introduce Neural P$3$M, a versatile enhancer of geometric GNNs to expand the scope of their capabilities. It exhibits flexibility across a wide range of molecular systems and demonstrates remarkable accuracy in predicting energies and forces. It also achieves an average improvement of 22% on the OE62 dataset while integrating with various architectures.
  arXiv  Detail & Related papers  (2024-09-26T08:16:59Z)
• Diffusion Models in $\textit{De Novo}$ Drug Design [0.0]
  Diffusion models have emerged as powerful tools for molecular generation, particularly in the context of 3D molecular structures. This review focuses on the technical implementation of diffusion models tailored for 3D molecular generation.
  arXiv  Detail & Related papers  (2024-06-07T06:34:13Z)
• Geometric Latent Diffusion Models for 3D Molecule Generation [172.15028281732737]
  Generative models, especially diffusion models (DMs), have achieved promising results for generating feature-rich geometries. We propose a novel and principled method for 3D molecule generation named Geometric Latent Diffusion Models (GeoLDM)
  arXiv  Detail & Related papers  (2023-05-02T01:07:22Z)
• An Equivariant Generative Framework for Molecular Graph-Structure Co-Design [54.92529253182004]
  We present MolCode, a machine learning-based generative framework for underlineMolecular graph-structure underlineCo-design. In MolCode, 3D geometric information empowers the molecular 2D graph generation, which in turn helps guide the prediction of molecular 3D structure. Our investigation reveals that the 2D topology and 3D geometry contain intrinsically complementary information in molecule design.
  arXiv  Detail & Related papers  (2023-04-12T13:34:22Z)
• Geometry-Complete Diffusion for 3D Molecule Generation and Optimization [3.8366697175402225]
  We introduce the Geometry-Complete Diffusion Model (GCDM) for 3D molecule generation. GCDM outperforms existing 3D molecular diffusion models by significant margins across conditional and unconditional settings. We also show that GCDM's geometric features can be repurposed to consistently optimize the geometry and chemical composition of existing 3D molecules.
  arXiv  Detail & Related papers  (2023-02-08T20:01:51Z)
• Equivariant Shape-Conditioned Generation of 3D Molecules for Ligand-Based Drug Design [3.032184156362992]
  We introduce a new 3D generative model that enables shape-conditioned 3D molecular design by encoding molecular shape and variationally encoding chemical identity. We evaluate our 3D generative model in tasks relevant to drug design including shape-conditioned generation of chemically diverse molecular structures and shape-constrained molecular property optimization.
  arXiv  Detail & Related papers  (2022-10-06T19:37:34Z)
• Learning Neural Generative Dynamics for Molecular Conformation Generation [89.03173504444415]
  We study how to generate molecule conformations (textiti.e., 3D structures) from a molecular graph. We propose a novel probabilistic framework to generate valid and diverse conformations given a molecular graph.
  arXiv  Detail & Related papers  (2021-02-20T03:17:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.