Benchmarking Graphormer on Large-Scale Molecular Modeling Datasets

• URL: http://arxiv.org/abs/2203.04810v1
• Date: Wed, 9 Mar 2022 15:40:10 GMT
• Title: Benchmarking Graphormer on Large-Scale Molecular Modeling Datasets
• Authors: Yu Shi, Shuxin Zheng, Guolin Ke, Yifei Shen, Jiacheng You, Jiyan He, Shengjie Luo, Chang Liu, Di He, Tie-Yan Liu
• Abstract summary: This note describes the recent updates of Graphormer. With a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs. In the meanwhile, it greatly outperforms the competitors in the recent Open Catalyst Challenge.
• Score: 87.00711479972503
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This technical note describes the recent updates of Graphormer, including architecture design modifications, and the adaption to 3D molecular dynamics simulation. With these simple modifications, Graphormer could attain better results on large-scale molecular modeling datasets than the vanilla one, and the performance gain could be consistently obtained on 2D and 3D molecular graph modeling tasks. In addition, we show that with a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs. Empirically, Graphormer could achieve much less MAE than the originally reported results on the PCQM4M quantum chemistry dataset used in KDD Cup 2021. In the meanwhile, it greatly outperforms the competitors in the recent Open Catalyst Challenge, which is a competition track on NeurIPS 2021 workshop, and aims to model the catalyst-adsorbate reaction system with advanced AI models. All codes could be found at https://github.com/Microsoft/Graphormer.

Related papers

• GraphStorm: all-in-one graph machine learning framework for industry applications [75.23076561638348]
  GraphStorm is an end-to-end solution for scalable graph construction, graph model training and inference. Every component in GraphStorm can operate on graphs with billions of nodes and can scale model training and inference to different hardware without changing any code. GraphStorm has been used and deployed for over a dozen billion-scale industry applications after its release in May 2023.
  arXiv  Detail & Related papers  (2024-06-10T04:56:16Z)
• Hi-GMAE: Hierarchical Graph Masked Autoencoders [90.30572554544385]
  Hierarchical Graph Masked AutoEncoders (Hi-GMAE) Hi-GMAE is a novel multi-scale GMAE framework designed to handle the hierarchical structures within graphs. Our experiments on 15 graph datasets consistently demonstrate that Hi-GMAE outperforms 17 state-of-the-art self-supervised competitors.
  arXiv  Detail & Related papers  (2024-05-17T09:08:37Z)
• On the Scalability of GNNs for Molecular Graphs [7.402389334892391]
  Graph Neural Networks (GNNs) are yet to show the benefits of scale due to the lower efficiency of sparse operations, large data requirements, and lack of clarity about the effectiveness of various architectures. We analyze message-passing networks, graph Transformers, and hybrid architectures on the largest public collection of 2D molecular graphs. For the first time, we observe that GNNs benefit tremendously from the increasing scale of depth, width, number of molecules, number of labels, and the diversity in the pretraining datasets.
  arXiv  Detail & Related papers  (2024-04-17T17:11:31Z)
• MolHF: A Hierarchical Normalizing Flow for Molecular Graph Generation [4.517805235253331]
  MolHF is a new hierarchical flow-based model that generates molecular graphs in a coarse-to-fine manner. MolHF is the first flow-based model that can be applied to model larger molecules (polymer) with more than 100 heavy atoms.
  arXiv  Detail & Related papers  (2023-05-15T08:59:35Z)
• MolGraph: a Python package for the implementation of molecular graphs and graph neural networks with TensorFlow and Keras [51.92255321684027]
  MolGraph is a graph neural network (GNN) package for molecular machine learning (ML) MolGraph implements a chemistry module to accommodate the generation of small molecular graphs, which can be passed to a GNN algorithm to solve a molecular ML problem. GNNs proved useful for molecular identification and improved interpretability of chromatographic retention time data.
  arXiv  Detail & Related papers  (2022-08-21T18:37:41Z)
• An Empirical Study of Graphormer on Large-Scale Molecular Modeling Datasets [87.00711479972503]
  "Graphormer-V2" could attain better results on large-scale molecular modeling datasets than the vanilla one. With a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs.
  arXiv  Detail & Related papers  (2022-02-28T16:32:42Z)
• Conditional Constrained Graph Variational Autoencoders for Molecule Design [70.59828655929194]
  We present Conditional Constrained Graph Variational Autoencoder (CCGVAE), a model that implements this key-idea in a state-of-the-art model. We show improved results on several evaluation metrics on two commonly adopted datasets for molecule generation.
  arXiv  Detail & Related papers  (2020-09-01T21:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.