A Survey on Spectral Graph Neural Networks

• URL: http://arxiv.org/abs/2302.05631v1
• Date: Sat, 11 Feb 2023 09:16:46 GMT
• Title: A Survey on Spectral Graph Neural Networks
• Authors: Deyu Bo, Xiao Wang, Yang Liu, Yuan Fang, Yawen Li, Chuan Shi
• Abstract summary: We summarize the recent development of spectral GNNs, including model, theory, and application. We first discuss the connection between spatial GNNs and spectral GNNs, which shows that spectral GNNs can capture global information and have better interpretability. In addition, we review major theoretical results and applications of spectral GNNs, followed by a quantitative experiment to benchmark some popular spectral GNNs.
• Score: 42.469584005389414
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Graph neural networks (GNNs) have attracted considerable attention from the research community. It is well established that GNNs are usually roughly divided into spatial and spectral methods. Despite that spectral GNNs play an important role in both graph signal processing and graph representation learning, existing studies are biased toward spatial approaches, and there is no comprehensive review on spectral GNNs so far. In this paper, we summarize the recent development of spectral GNNs, including model, theory, and application. Specifically, we first discuss the connection between spatial GNNs and spectral GNNs, which shows that spectral GNNs can capture global information and have better expressiveness and interpretability. Next, we categorize existing spectral GNNs according to the spectrum information they use, \ie, eigenvalues or eigenvectors. In addition, we review major theoretical results and applications of spectral GNNs, followed by a quantitative experiment to benchmark some popular spectral GNNs. Finally, we conclude the paper with some future directions.

Related papers

• Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective [49.613774305350084]
  Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based learning tasks. Recent studies suggest that other components such as non-linear layers may also significantly affect how GNNs process the input graph data in the spectral domain. This paper introduces a comprehensive benchmark to measure and evaluate GNNs' capability in capturing and leveraging the information encoded in different frequency components of the input graph data.
  arXiv  Detail & Related papers  (2024-12-10T04:53:53Z)
• A Manifold Perspective on the Statistical Generalization of Graph Neural Networks [84.01980526069075]
  We take a manifold perspective to establish the statistical generalization theory of GNNs on graphs sampled from a manifold in the spectral domain. We prove that the generalization bounds of GNNs decrease linearly with the size of the graphs in the logarithmic scale, and increase linearly with the spectral continuity constants of the filter functions.
  arXiv  Detail & Related papers  (2024-06-07T19:25:02Z)
• Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering [31.595664867365322]
  spectral Graph Neural Networks (GNNs) are well-founded in the spectral domain, but their practical reliance on approximation implies a profound linkage to the spatial domain. We establish a theoretical connection between spectral and spatial aggregation, unveiling an intrinsic interaction that spectral implicitly leads the original graph to an adapted new graph. We propose a novel Spatially Adaptive Filtering (SAF) framework, which leverages the adapted new graph by spectral filtering for an auxiliary non-local aggregation.
  arXiv  Detail & Related papers  (2024-01-17T09:12:31Z)
• Graph Neural Networks for Graphs with Heterophily: A Survey [98.45621222357397]
  We provide a comprehensive review of graph neural networks (GNNs) for heterophilic graphs. Specifically, we propose a systematic taxonomy that essentially governs existing heterophilic GNN models. We discuss the correlation between graph heterophily and various graph research domains, aiming to facilitate the development of more effective GNNs.
  arXiv  Detail & Related papers  (2022-02-14T23:07:47Z)
• Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks [61.17075071853949]
  Graph neural networks (GNNs) are designed to deal with graph-structural data that classical deep learning does not easily manage. The purpose of this study is to establish a unified framework that integrates GNNs based on spectral graph and approximation theory.
  arXiv  Detail & Related papers  (2021-07-21T17:34:33Z)
• Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks [52.76042362922247]
  Graph neural networks (GNNs) are designed to handle the non-Euclidean graph-structure. Existing GNNs are presented using various techniques, making direct comparison and cross-reference more complex. We organize existing GNNs into spatial and spectral domains, as well as expose the connections within each domain.
  arXiv  Detail & Related papers  (2020-02-27T01:15:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.