A Complete Guide to Spherical Equivariant Graph Transformers

• URL: http://arxiv.org/abs/2512.13927v1
• Date: Mon, 15 Dec 2025 22:03:09 GMT
• Title: A Complete Guide to Spherical Equivariant Graph Transformers
• Authors: Sophia Tang,
• Abstract summary: Spherical equivariant graph neural networks (EGNNs) provide a principled framework for learning on three-dimensional molecular and biomolecular systems.<n>This guide serves as a self-contained introduction for researchers and learners seeking to understand or implement spherical EGNNs.
• Score: 0.7953056533753116
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Spherical equivariant graph neural networks (EGNNs) provide a principled framework for learning on three-dimensional molecular and biomolecular systems, where predictions must respect the rotational symmetries inherent in physics. These models extend traditional message-passing GNNs and Transformers by representing node and edge features as spherical tensors that transform under irreducible representations of the rotation group SO(3), ensuring that predictions change in physically meaningful ways under rotations of the input. This guide develops a complete, intuitive foundation for spherical equivariant modeling - from group representations and spherical harmonics, to tensor products, Clebsch-Gordan decomposition, and the construction of SO(3)-equivariant kernels. Building on this foundation, we construct the Tensor Field Network and SE(3)-Transformer architectures and explain how they perform equivariant message-passing and attention on geometric graphs. Through clear mathematical derivations and annotated code excerpts, this guide serves as a self-contained introduction for researchers and learners seeking to understand or implement spherical EGNNs for applications in chemistry, molecular property prediction, protein structure modeling, and generative modeling.

Related papers

• Direct Molecular Polarizability Prediction with SO(3) Equivariant Local Frame GNNs [2.9853030364785003]
  We introduce a novel equivariant graph neural network architecture designed to predict the tensorial response properties of molecules.<n>Our GNN effectively captures geometric information by integrating scalar, vector, and tensor channels within a local message-passing framework.<n>To assess the accuracy of our model, we apply it to predict the polarizabilities of molecules in the QM7-X dataset and show that tensorial message passing outperforms scalar message passing models.
  arXiv  Detail & Related papers  (2025-11-10T13:23:20Z)
• DeepChem Equivariant: SE(3)-Equivariant Support in an Open-Source Molecular Machine Learning Library [0.0]
  We extend DEEPCHEM with support for ready-to-use equivariant models, enabling scientists with minimal deep learning background to build, train, and evaluate models.<n>Our implementation includes equivariant models, complete training pipelines, and a toolkit of equivariant utilities, supported with comprehensive tests and documentation.
  arXiv  Detail & Related papers  (2025-10-19T15:45:57Z)
• SO(3)-Equivariant Neural Networks for Learning Vector Fields on Spheres [0.0]
  Models should respect both the rotational symmetries of the sphere and the inherent symmetries of the vector fields.<n>We introduce a deep learning architecture that respects both symmetry types using novel techniques based on group convolutions in the 3-dimensional rotation group.
  arXiv  Detail & Related papers  (2025-03-12T15:00:32Z)
• Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks [79.16635054977068]
  We present a new class of equivariant neural networks, dubbed Lattice-Equivariant Neural Networks (LENNs) Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators. Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.
  arXiv  Detail & Related papers  (2024-05-22T17:23:15Z)
• E(3)-equivariant models cannot learn chirality: Field-based molecular generation [51.327048911864885]
  Chirality plays a key role in determining drug safety and potency.<n>We introduce a novel field-based representation, proposing reference rotations that replace rotational symmetry constraints.<n>The proposed model captures all molecular geometries including chirality, while still achieving highly competitive performance with E(3)-based methods across standard benchmarking metrics.
  arXiv  Detail & Related papers  (2024-02-24T17:13:58Z)
• A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems [87.30652640973317]
  Recent advances in computational modelling of atomic systems represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. Geometric Graph Neural Networks have emerged as the preferred machine learning architecture powering applications ranging from protein structure prediction to molecular simulations and material generation. This paper provides a comprehensive and self-contained overview of the field of Geometric GNNs for 3D atomic systems.
  arXiv  Detail & Related papers  (2023-12-12T18:44:19Z)
• GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensembles [60.12186997181117]
  Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular geometry elements. We propose GeoMol, an end-to-end, non-autoregressive and SE(3)-invariant machine learning approach to generate 3D conformers.
  arXiv  Detail & Related papers  (2021-06-08T14:17:59Z)
• Spherical convolutions on molecular graphs for protein model quality assessment [0.0]
  In this work, we propose Spherical Graph Convolutional Network (S-GCN) that processes 3D models of proteins represented as molecular graphs. Within the framework of the protein model quality assessment problem, we demonstrate that the proposed spherical convolution method significantly improves the quality of model assessment.
  arXiv  Detail & Related papers  (2020-11-16T14:22:36Z)
• Spherical Convolutional Neural Networks: Stability to Perturbations in SO(3) [175.96910854433574]
  Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure. This paper investigates the properties that Spherical CNNs exhibit as they pertain to the rotational structure inherent in spherical signals.
  arXiv  Detail & Related papers  (2020-10-12T17:16:07Z)
• Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphs [81.12344211998635]
  A common approach to define convolutions on meshes is to interpret them as a graph and apply graph convolutional networks (GCNs) We propose Gauge Equivariant Mesh CNNs which generalize GCNs to apply anisotropic gauge equivariant kernels. Our experiments validate the significantly improved expressivity of the proposed model over conventional GCNs and other methods.
  arXiv  Detail & Related papers  (2020-03-11T17:21:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.