A Graph Foundation Model with Spectral Parsing and Prototype-Guided Spatial Propagation

• URL: http://arxiv.org/abs/2606.03315v1
• Date: Tue, 02 Jun 2026 08:27:03 GMT
• Title: A Graph Foundation Model with Spectral Parsing and Prototype-Guided Spatial Propagation
• Abstract summary: Graph foundation models aim to learn transferable knowledge from diverse graphs for generalization to unseen graphs and tasks.<n>This challenge comes from both feature discrepancies and, more critically, diverse graph structures.<n>Existing GFMs mainly improve transferability by unifying feature spaces or incorporating structural tokens and vocabularies.<n>We propose SPG, a graph foundation model with spectral parsing and prototype-guided spatial propagation.
• Score: 30.922981803680518
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Graph foundation models aim to learn transferable knowledge from diverse graphs for generalization to unseen graphs and tasks. Unlike text and images, graphs lack a shared vocabulary or regular spatial grid, making cross-graph transfer challenging. This challenge comes from both feature discrepancies and, more critically, diverse graph structures. Existing GFMs mainly improve transferability by unifying feature spaces or incorporating structural tokens and vocabularies. However, existing topology-aware designs still have limitations. Structural tokens are usually discrete, while structural vocabularies often rely on predefined substructures such as trees and cycles, whose limited coverage may miss richer relational patterns across graphs. Moreover, graph signals contain both high-frequency local patterns and smoother low-frequency patterns, which require different propagation behaviors. These components are often entangled in raw graph signals, while this spectral perspective is rarely explored in existing GFMs. To address these challenges, we propose SPG, a graph foundation model with spectral parsing and prototype-guided spatial propagation. SPG applies learnable Chebyshev filters to decompose node features into multiple spectral responses, reducing the mismatch between frequency-specific graph signals and propagation behaviors. It then constructs a Gromov-Wasserstein prototype geometry to distill transferable pairwise relations beyond predefined substructures into a shared structural space. The learned prototype geometry is further projected back as a prototype-guided propagation operator. Experiments demonstrate consistent improvements in cross-domain generalization.

Related papers

• Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networks [1.49251567571938]
  SIGIL is a framework that maps any attributed graph to a unified representation space of fixed dimension.<n>A relational message-passing network embeds each feature dimension into a shared space.<n>A single SIGIL model, pretrained on one graph, delivers strong fully-inductive link prediction.
  arXiv  Detail & Related papers  (2026-08-09T08:14:35Z)
• When Do Graph Foundation Models Transfer? A Data-Centric Theory [68.54337055801571]
  Graph foundation models (GFMs) aim to reuse a single backbone across diverse graph domains, yet their transfer is often uneven and can exhibit negative transfer.<n>We show that for both set-based and message-passing tokenizations, any Lipschitz backbone admits an explicit decomposition of cross-domain output shift.<n>A key ingredient is positional-encoding (PE) stability: we establish stability guarantees for spectral PEs and highlight contrasting behaviors of eigenvector- versus subspace-based PEs.
  arXiv  Detail & Related papers  (2026-05-28T12:07:27Z)
• Structure-Centric Graph Foundation Model via Geometric Bases [16.191907209297362]
  We propose Structure-Centric Graph Foundation Models (SCGFM) to treat graph topology as the primary source of transferable knowledge.<n>SCGFM introduces learnable geometric bases that define a shared structural coordinate system.<n>Experiments on graph- and node-level tasks demonstrate strong in-domain and cross-domain generalization, outperforming existing GFM approaches.
  arXiv  Detail & Related papers  (2026-05-09T04:56:21Z)
• Task-driven Heterophilic Graph Structure Learning [30.767828037086844]
  Graph neural networks (GNNs) often struggle to learn discriminative node representations for heterophilic graphs.<n>We propose frequency-guided graph structure learning (FgGSL), an end-to-end graph inference framework.
  arXiv  Detail & Related papers  (2025-12-29T11:59:16Z)
• A Pure Transformer Pretraining Framework on Text-attributed Graphs [50.833130854272774]
  We introduce a feature-centric pretraining perspective by treating graph structure as a prior. Our framework, Graph Sequence Pretraining with Transformer (GSPT), samples node contexts through random walks. GSPT can be easily adapted to both node classification and link prediction, demonstrating promising empirical success on various datasets.
  arXiv  Detail & Related papers  (2024-06-19T22:30:08Z)
• HoloNets: Spectral Convolutions do extend to Directed Graphs [59.851175771106625]
  Conventional wisdom dictates that spectral convolutional networks may only be deployed on undirected graphs. Here we show this traditional reliance on the graph Fourier transform to be superfluous. We provide a frequency-response interpretation of newly developed filters, investigate the influence of the basis used to express filters and discuss the interplay with characteristic operators on which networks are based.
  arXiv  Detail & Related papers  (2023-10-03T17:42:09Z)
• Improving Spectral Graph Convolution for Learning Graph-level Representation [27.76697047602983]
  We show that for learning representations of the entire graphs, the topological distance seems necessary since it characterizes the basic relations between nodes. By removing it, as well as the limitation of graph filters, the resulting new architecture significantly boosts performance on learning graph representations. It serves as an understanding that quantitatively measures the effects of the spectrum to input signals in comparison to the well-known spectral/low-pass filters.
  arXiv  Detail & Related papers  (2021-12-14T04:50:46Z)
• Spectral Graph Convolutional Networks With Lifting-based Adaptive Graph Wavelets [81.63035727821145]
  Spectral graph convolutional networks (SGCNs) have been attracting increasing attention in graph representation learning. We propose a novel class of spectral graph convolutional networks that implement graph convolutions with adaptive graph wavelets.
  arXiv  Detail & Related papers  (2021-08-03T17:57:53Z)
• Spectral-Spatial Global Graph Reasoning for Hyperspectral Image Classification [50.899576891296235]
  Convolutional neural networks have been widely applied to hyperspectral image classification. Recent methods attempt to address this issue by performing graph convolutions on spatial topologies.
  arXiv  Detail & Related papers  (2021-06-26T06:24:51Z)
• Graphon Pooling in Graph Neural Networks [169.09536309161314]
  Graph neural networks (GNNs) have been used effectively in different applications involving the processing of signals on irregular structures modeled by graphs. We propose a new strategy for pooling and sampling on GNNs using graphons which preserves the spectral properties of the graph.
  arXiv  Detail & Related papers  (2020-03-03T21:04:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.