Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scales

• URL: http://arxiv.org/abs/2012.11816v3
• Date: Tue, 26 Dec 2023 09:32:19 GMT
• Title: Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scales
• Authors: Jun Zhang, Yao-Kun Lei, Yaqiang Zhou, Yi Isaac Yang and Yi Qin Gao
• Abstract summary: A new deep neural network architecture, Molecular Configuration Transformer ( Molecular CT), is introduced for this purpose. The computational efficiency and universality make Molecular CT versatile for a variety of molecular learning scenarios. As examples, we show that Molecular CT enables representational learning for molecular systems at different scales, and achieves comparable or improved results on common benchmarks.
• Score: 3.987395340580183
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Deep learning is changing many areas in molecular physics, and it has shown great potential to deliver new solutions to challenging molecular modeling problems. Along with this trend arises the increasing demand of expressive and versatile neural network architectures which are compatible with molecular systems. A new deep neural network architecture, Molecular Configuration Transformer (Molecular CT), is introduced for this purpose. Molecular CT is composed of a relation-aware encoder module and a computationally universal geometry learning unit, thus able to account for the relational constraints between particles meanwhile scalable to different particle numbers and invariant with respect to the trans-rotational transforms. The computational efficiency and universality make Molecular CT versatile for a variety of molecular learning scenarios and especially appealing for transferable representation learning across different molecular systems. As examples, we show that Molecular CT enables representational learning for molecular systems at different scales, and achieves comparable or improved results on common benchmarks using a more light-weighted structure compared to baseline models.

Related papers

• GraphXForm: Graph transformer for computer-aided molecular design with application to extraction [73.1842164721868]
  We present GraphXForm, a decoder-only graph transformer architecture, which is pretrained on existing compounds and then fine-tuned. We evaluate it on two solvent design tasks for liquid-liquid extraction, showing that it outperforms four state-of-the-art molecular design techniques.
  arXiv  Detail & Related papers  (2024-11-03T19:45:15Z)
• GeoMFormer: A General Architecture for Geometric Molecular Representation Learning [84.02083170392764]
  We introduce a novel Transformer-based molecular model called GeoMFormer to achieve this goal. We show that GeoMFormer achieves strong performance on both invariant and equivariant tasks of different types and scales.
  arXiv  Detail & Related papers  (2024-06-24T17:58:13Z)
• Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning [60.02391969049972]
  We introduce a novel deep learning framework, called Distributional Graphormer (DiG), in an attempt to predict the equilibrium distribution of molecular systems. DiG employs deep neural networks to transform a simple distribution towards the equilibrium distribution, conditioned on a descriptor of a molecular system.
  arXiv  Detail & Related papers  (2023-06-08T17:12:08Z)
• MUDiff: Unified Diffusion for Complete Molecule Generation [104.7021929437504]
  We present a new model for generating a comprehensive representation of molecules, including atom features, 2D discrete molecule structures, and 3D continuous molecule coordinates. We propose a novel graph transformer architecture to denoise the diffusion process. Our model is a promising approach for designing stable and diverse molecules and can be applied to a wide range of tasks in molecular modeling.
  arXiv  Detail & Related papers  (2023-04-28T04:25:57Z)
• Learning Harmonic Molecular Representations on Riemannian Manifold [18.49126496517951]
  Molecular representation learning plays a crucial role in AI-assisted drug discovery research. We propose a Harmonic Molecular Representation learning framework, which represents a molecule using the Laplace-Beltrami eigenfunctions of its molecular surface.
  arXiv  Detail & Related papers  (2023-03-27T18:02:47Z)
• Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction [53.06671763877109]
  We develop molecular embeddings that encode complex molecular characteristics to improve the performance of few-shot molecular property prediction. Our approach leverages large amounts of synthetic data, namely the results of molecular docking calculations. On multiple molecular property prediction benchmarks, training from the embedding space substantially improves Multi-Task, MAML, and Prototypical Network few-shot learning performance.
  arXiv  Detail & Related papers  (2023-02-04T01:32:40Z)
• Molecular dynamics without molecules: searching the conformational space of proteins with generative neural networks [0.0]
  All-atom and coarse-grained molecular dynamics are widely used to study the conformational states of proteins. All-atom and coarse-grained simulation methods suffer from the fact that without access to supercomputing resources, the time and length scales at which these states become detectable are difficult to achieve. One alternative is based on encoding the atomistic trajectory of molecular dynamics as a shorthand version of physical particles, and then learning to propagate the encoded trajectory through the use of artificial intelligence vectors.
  arXiv  Detail & Related papers  (2022-06-09T02:06:43Z)
• GeoT: A Geometry-aware Transformer for Reliable Molecular Property Prediction and Chemically Interpretable Representation Learning [16.484048833163282]
  We introduce a novel Transformer-based framework for molecular representation learning, named the Geometry-aware Transformer (GeoT) GeoT learns molecular graph structures through attention-based mechanisms specifically designed to offer reliable interpretability, as well as molecular property prediction. Our comprehensive experiments, including an empirical simulation, reveal that GeoT effectively learns the chemical insights into molecular structures, bridging the gap between artificial intelligence and molecular sciences.
  arXiv  Detail & Related papers  (2021-06-29T15:47:18Z)
• Augmenting Molecular Deep Generative Models with Topological Data Analysis Representations [21.237758981760784]
  We present a SMILES Variational Auto-Encoder (VAE) augmented with topological data analysis (TDA) representations of molecules. Our experiments show that this TDA augmentation enables a SMILES VAE to capture the complex relation between 3D geometry and electronic properties.
  arXiv  Detail & Related papers  (2021-06-08T15:49:21Z)
• Learning Neural Generative Dynamics for Molecular Conformation Generation [89.03173504444415]
  We study how to generate molecule conformations (textiti.e., 3D structures) from a molecular graph. We propose a novel probabilistic framework to generate valid and diverse conformations given a molecular graph.
  arXiv  Detail & Related papers  (2021-02-20T03:17:58Z)
• A Perspective on Deep Learning for Molecular Modeling and Simulations [8.891007063629187]
  We focus on the limitations of traditional deep learning models from the perspective of molecular physics. We summarized several representative applications, ranging from supervised to unsupervised and reinforcement learning. We outlook promising directions which may help address the existing issues in the current framework of deep molecular modeling.
  arXiv  Detail & Related papers  (2020-04-25T22:58:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.