Generalist Equivariant Transformer Towards 3D Molecular Interaction Learning

• URL: http://arxiv.org/abs/2306.01474v6
• Date: Thu, 30 May 2024 02:38:01 GMT
• Title: Generalist Equivariant Transformer Towards 3D Molecular Interaction Learning
• Authors: Xiangzhe Kong, Wenbing Huang, Yang Liu,
• Abstract summary: We propose to represent an arbitrary 3D complex as a geometric graph of sets, shedding light on encoding all types of molecules with one model. We then propose a Generalist Equivariant Transformer (GET) to effectively capture both domain-specific hierarchies and domain-agnostic interaction physics.
• Score: 20.60450267217201
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Many processes in biology and drug discovery involve various 3D interactions between molecules, such as protein and protein, protein and small molecule, etc. Given that different molecules are usually represented in different granularity, existing methods usually encode each type of molecules independently with different models, leaving it defective to learn the various underlying interaction physics. In this paper, we first propose to universally represent an arbitrary 3D complex as a geometric graph of sets, shedding light on encoding all types of molecules with one model. We then propose a Generalist Equivariant Transformer (GET) to effectively capture both domain-specific hierarchies and domain-agnostic interaction physics. To be specific, GET consists of a bilevel attention module, a feed-forward module and a layer normalization module, where each module is E(3) equivariant and specialized for handling sets of variable sizes. Notably, in contrast to conventional pooling-based hierarchical models, our GET is able to retain fine-grained information of all levels. Extensive experiments on the interactions between proteins, small molecules and RNA/DNAs verify the effectiveness and generalization capability of our proposed method across different domains.

Related papers

• Structure Language Models for Protein Conformation Generation [66.42864253026053]
  Traditional physics-based simulation methods often struggle with sampling equilibrium conformations. Deep generative models have shown promise in generating protein conformations as a more efficient alternative. We introduce Structure Language Modeling as a novel framework for efficient protein conformation generation.
  arXiv  Detail & Related papers  (2024-10-24T03:38:51Z)
• GeoMFormer: A General Architecture for Geometric Molecular Representation Learning [84.02083170392764]
  We introduce a novel Transformer-based molecular model called GeoMFormer to achieve this goal. We show that GeoMFormer achieves strong performance on both invariant and equivariant tasks of different types and scales.
  arXiv  Detail & Related papers  (2024-06-24T17:58:13Z)
• UniIF: Unified Molecule Inverse Folding [67.60267592514381]
  We propose a unified model UniIF for inverse folding of all molecules. Our proposed method surpasses state-of-the-art methods on all tasks.
  arXiv  Detail & Related papers  (2024-05-29T10:26:16Z)
• Functional-Group-Based Diffusion for Pocket-Specific Molecule Generation and Elaboration [63.23362798102195]
  We propose D3FG, a functional-group-based diffusion model for pocket-specific molecule generation and elaboration. D3FG decomposes molecules into two categories of components: functional groups defined as rigid bodies and linkers as mass points. In the experiments, our method can generate molecules with more realistic 3D structures, competitive affinities toward the protein targets, and better drug properties.
  arXiv  Detail & Related papers  (2023-05-30T06:41:20Z)
• MUDiff: Unified Diffusion for Complete Molecule Generation [104.7021929437504]
  We present a new model for generating a comprehensive representation of molecules, including atom features, 2D discrete molecule structures, and 3D continuous molecule coordinates. We propose a novel graph transformer architecture to denoise the diffusion process. Our model is a promising approach for designing stable and diverse molecules and can be applied to a wide range of tasks in molecular modeling.
  arXiv  Detail & Related papers  (2023-04-28T04:25:57Z)
• DiffBP: Generative Diffusion of 3D Molecules for Target Protein Binding [51.970607704953096]
  Previous works usually generate atoms in an auto-regressive way, where element types and 3D coordinates of atoms are generated one by one. In real-world molecular systems, the interactions among atoms in an entire molecule are global, leading to the energy function pair-coupled among atoms. In this work, a generative diffusion model for molecular 3D structures based on target proteins is established, at a full-atom level in a non-autoregressive way.
  arXiv  Detail & Related papers  (2022-11-21T07:02:15Z)
• 3D-Transformer: Molecular Representation with Transformer in 3D Space [11.947499562836953]
  3D-Transformer is a variant of the Transformer for molecular representations that incorporates 3D spatial information. Our experiments show significant improvements over state-of-the-art models on the crystal property prediction task and the protein-ligand binding affinity prediction task.
  arXiv  Detail & Related papers  (2021-10-04T05:11:23Z)
• Deep learning based mixed-dimensional GMM for characterizing variability in CryoEM [0.0]
  CryoEM provides direct visualization of individual macromolecules in different conformational and compositional states. We present a machine learning algorithm to determine a conformational landscape for proteins or complexes. We demonstrate this method on several different biomolecular systems to explore compositional and conformational changes at a range of scales.
  arXiv  Detail & Related papers  (2021-01-25T19:05:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.