EquiFlow: Equivariant Conditional Flow Matching with Optimal Transport for 3D Molecular Conformation Prediction

• URL: http://arxiv.org/abs/2412.11082v1
• Date: Sun, 15 Dec 2024 06:48:22 GMT
• Title: EquiFlow: Equivariant Conditional Flow Matching with Optimal Transport for 3D Molecular Conformation Prediction
• Authors: Qingwen Tian, Yuxin Xu, Yixuan Yang, Zhen Wang, Ziqi Liu, Pengju Yan, Xiaolin Li,
• Abstract summary: We propose EquiFlow, an equivariant conditional flow matching model with optimal transport. It uses a modified Equiformer model to encode molecular conformations along with their atomic and bond properties into higher-degree embeddings. Experiments on the QM9 dataset show that EquiFlow predicts small molecule conformations more accurately than current state-of-the-art models.
• Score: 14.664189950787739
• License:
• Abstract: Molecular 3D conformations play a key role in determining how molecules interact with other molecules or protein surfaces. Recent deep learning advancements have improved conformation prediction, but slow training speeds and difficulties in utilizing high-degree features limit performance. We propose EquiFlow, an equivariant conditional flow matching model with optimal transport. EquiFlow uniquely applies conditional flow matching in molecular 3D conformation prediction, leveraging simulation-free training to address slow training speeds. It uses a modified Equiformer model to encode Cartesian molecular conformations along with their atomic and bond properties into higher-degree embeddings. Additionally, EquiFlow employs an ODE solver, providing faster inference speeds compared to diffusion models with SDEs. Experiments on the QM9 dataset show that EquiFlow predicts small molecule conformations more accurately than current state-of-the-art models.

Related papers

• Conformation Generation using Transformer Flows [55.2480439325792]
  We present ConfFlow, a flow-based model for conformation generation based on transformer networks. ConfFlow directly samples in the coordinate space without enforcing any explicit physical constraints. ConfFlow improve accuracy by up to $40%$ relative to state-of-the-art learning-based methods.
  arXiv  Detail & Related papers  (2024-11-16T14:42:05Z)
• Conditional Synthesis of 3D Molecules with Time Correction Sampler [58.0834973489875]
  Time-Aware Conditional Synthesis (TACS) is a novel approach to conditional generation on diffusion models. It integrates adaptively controlled plug-and-play "online" guidance into a diffusion model, driving samples toward the desired properties.
  arXiv  Detail & Related papers  (2024-11-01T12:59:25Z)
• ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generation [3.4146914514730633]
  We introduce Equivariant Transformer Flow (ET-Flow) to predict low-energy molecular conformations. Our approach results in a straightforward and scalable method that operates on all-atom coordinates with minimal assumptions. ET-Flow significantly increases the precision and physical validity of the generated conformers, while being a lighter model and faster at inference.
  arXiv  Detail & Related papers  (2024-10-29T16:44:10Z)
• Efficient 3D Molecular Generation with Flow Matching and Scale Optimal Transport [43.56824843205882]
  Semla is a scalable E(3)-equivariant message passing architecture. SemlaFlow is trained using flow matching along with scale optimal transport. Our model produces state-of-the-art results on benchmark datasets with just 100 sampling steps.
  arXiv  Detail & Related papers  (2024-06-11T13:51:51Z)
• Mixed Continuous and Categorical Flow Matching for 3D De Novo Molecule Generation [0.0]
  Flow matching is a recently proposed generative modeling framework that generalizes diffusion models. We extend the flow matching framework to categorical data by constructing flows that are constrained to exist on a continuous representation of categorical data known as the probability simplex. We find that, in practice, a simpler approach that makes no accommodations for the categorical nature of the data yields equivalent or superior performance.
  arXiv  Detail & Related papers  (2024-04-30T17:37:21Z)
• Equivariant Flow Matching with Hybrid Probability Transport [69.11915545210393]
  Diffusion Models (DMs) have demonstrated effectiveness in generating feature-rich geometries. DMs typically suffer from unstable probability dynamics with inefficient sampling speed. We introduce geometric flow matching, which enjoys the advantages of both equivariant modeling and stabilized probability dynamics.
  arXiv  Detail & Related papers  (2023-12-12T11:13:13Z)
• SE(3)-Stochastic Flow Matching for Protein Backbone Generation [54.951832422425454]
  We introduce FoldFlow, a series of novel generative models of increasing modeling power based on the flow-matching paradigm over $3mathrmD$ rigid motions. Our family of FoldFlowgenerative models offers several advantages over previous approaches to the generative modeling of proteins.
  arXiv  Detail & Related papers  (2023-10-03T19:24:24Z)
• May the Force be with You: Unified Force-Centric Pre-Training for 3D Molecular Conformations [19.273404278711794]
  We propose a force-centric pretraining model for 3D molecular conformations covering both equilibrium and off-equilibrium data. For equilibrium data, we introduce zero-force regularization and forced-based denoising techniques to approximate near-equilibrium forces. Experiments show that, with our pre-training objective, we increase forces accuracy by around 3 times compared to the un-pre-trained Equivariant Transformer model.
  arXiv  Detail & Related papers  (2023-08-24T01:54:02Z)
• Equivariant Diffusion for Molecule Generation in 3D [74.289191525633]
  This work introduces a diffusion model for molecule computation generation in 3D that is equivariant to Euclidean transformations. Experimentally, the proposed method significantly outperforms previous 3D molecular generative methods regarding the quality of generated samples and efficiency at training time.
  arXiv  Detail & Related papers  (2022-03-31T12:52:25Z)
• E(n) Equivariant Normalizing Flows for Molecule Generation in 3D [87.12477361140716]
  This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs) To the best of our knowledge, this is the first likelihood-based deep generative model that generates molecules in 3D.
  arXiv  Detail & Related papers  (2021-05-19T09:28:54Z)
• A Physics-Constrained Deep Learning Model for Simulating Multiphase Flow in 3D Heterogeneous Porous Media [1.4050836886292868]
  A physics-constrained deep learning model is developed for solving multiphase flow in 3D heterogeneous porous media. The model is trained from physics-based simulation data and emulates the physics process. The model performs prediction with a speedup of 1400 times compared to physics-based simulations.
  arXiv  Detail & Related papers  (2021-04-30T02:15:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.