LaguerreNet: Advancing a Unified Solution for Heterophily and Over-smoothing with Adaptive Continuous Polynomials
- URL: http://arxiv.org/abs/2511.15328v1
- Date: Wed, 19 Nov 2025 10:47:23 GMT
- Title: LaguerreNet: Advancing a Unified Solution for Heterophily and Over-smoothing with Adaptive Continuous Polynomials
- Authors: Huseyin Goksu,
- Abstract summary: LaguerreNet is a novel GNN filter based on continuous Laguerres Neurals.<n>It is exceptionally robust to over-smoothing, with performance at K=10, an order of magnitude beyond where ChebyNet collapses.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Spectral Graph Neural Networks (GNNs) suffer from two critical limitations: poor performance on "heterophilic" graphs and performance collapse at high polynomial degrees (K), known as over-smoothing. Both issues stem from the static, low-pass nature of standard filters (e.g., ChebyNet). While adaptive polynomial filters, such as the discrete MeixnerNet, have emerged as a potential unified solution, their extension to the continuous domain and stability with unbounded coefficients remain open questions. In this work, we propose `LaguerreNet`, a novel GNN filter based on continuous Laguerre polynomials. `LaguerreNet` learns the filter's spectral shape by making its core alpha parameter trainable, thereby advancing the adaptive polynomial approach. We solve the severe O(k^2) numerical instability of these unbounded polynomials using a `LayerNorm`-based stabilization technique. We demonstrate experimentally that this approach is highly effective: 1) `LaguerreNet` achieves state-of-the-art results on challenging heterophilic benchmarks. 2) It is exceptionally robust to over-smoothing, with performance peaking at K=10, an order of magnitude beyond where ChebyNet collapses.
Related papers
- HybSpecNet: A Critical Analysis of Architectural Instability in Hybrid-Domain Spectral GNNs [0.0]
Spectral Graph Neural Networks offer a principled approach to graph filtering.<n>They face a fundamental "Stability-vs.Adaptivity" trade-off.<n>We propose a hybrid-domain GNN, HybSpecNet, which combines a stable ChebyNet branch with an adaptive KrawtchoukNet branch.
arXiv Detail & Related papers (2025-11-20T06:47:44Z) - KrawtchoukNet: A Unified GNN Solution for Heterophily and Over-smoothing with Adaptive Bounded Polynomials [0.0]
Spectral Graph Networks (GNNs) based on filters, such as ChebyNet, suffer from two critical limitations.<n>We propose KrawtchoukNet, a GNN filter based on the discrete Krawtchouks.<n>We show this adaptive nature allows KrawtchoukNet to achieve SOTA performance on challenging benchmarks.
arXiv Detail & Related papers (2025-11-19T10:47:15Z) - GegenbauerNet: Finding the Optimal Compromise in the GNN Flexibility-Stability Trade-off [0.0]
Spectral Graph Neural Networks (GNNs) operating in the canonical [-1, 1] domain face a fundamental Flexibility-Stability Trade-off.<n>We propose textbfGegenbauerNet, a novel GNN filter based on the Gegenbauers symmetry.<n>We demonstrate that GegenbauerNet achieves superior performance in the key local filtering regime.
arXiv Detail & Related papers (2025-11-04T19:39:29Z) - DualLaguerreNet: A Decoupled Spectral Filter GNN and the Uncovering of the Flexibility-Stability Trade-off [0.0]
Graph Networks (GNNs) based on spectral filters, such as the Adaptive Orthogonal Polynomial Filter (AOPF) class (e.g., LaguerreNet) have shown promise in unifying the solutions for heterophily and over-smoothing.<n>These single-filter models suffer from a "compromise" problem, as their single adaptive parameter (e.g., alpha) must learn a suboptimal, averaged response across the entire graph spectrum.<n>We propose DualLaguerreNet, a novel GNN architecture that solves this by introducing "Decoupled Spectral Flexibility"
arXiv Detail & Related papers (2025-11-04T19:33:29Z) - MeixnerNet: Adaptive and Robust Spectral Graph Neural Networks with Discrete Orthogonal Polynomials [0.0]
We introduce MeixnerNet, a novel spectral GNN architecture that employs discrete orthogonals.<n>We show that MeixnerNet is exceptionally robust to variations in degree K, collapsing in performance where ChebyNet proves to be highly fragile.
arXiv Detail & Related papers (2025-10-30T23:50:21Z) - Return of ChebNet: Understanding and Improving an Overlooked GNN on Long Range Tasks [53.974190296524455]
We revisit ChebNet to shed light on its ability to model distant node interactions.<n>We cast ChebNet as a stable and non-dissipative dynamical system, which we coin Stable-ChebNet.
arXiv Detail & Related papers (2025-06-09T10:41:34Z) - Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approach [26.79625547648669]
Spectral graph networks are proposed to harness spectral information inherent in graph neural data through the application of graph filters.<n>We show that various choices greatly impact spectral GNN performance, underscoring the importance of parameter selection.<n>We develop an advanced filter based on trigonometrics, a widely adopted option for approxing narrow signal slices.
arXiv Detail & Related papers (2024-04-15T11:35:32Z) - Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble Approach [57.92727189589498]
We propose an online convex optimization approach with two different levels of adaptivity.
We obtain $mathcalO(log V_T)$, $mathcalO(d log V_T)$ and $hatmathcalO(sqrtV_T)$ regret bounds for strongly convex, exp-concave and convex loss functions.
arXiv Detail & Related papers (2023-07-17T09:55:35Z) - Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with
Variance Reduction and its Application to Optimization [50.83356836818667]
gradient Langevin Dynamics is one of the most fundamental algorithms to solve non-eps optimization problems.
In this paper, we show two variants of this kind, namely the Variance Reduced Langevin Dynamics and the Recursive Gradient Langevin Dynamics.
arXiv Detail & Related papers (2022-03-30T11:39:00Z) - Adaptivity and Non-stationarity: Problem-dependent Dynamic Regret for Online Convex Optimization [70.4342220499858]
We introduce novel online algorithms that can exploit smoothness and replace the dependence on $T$ in dynamic regret with problem-dependent quantities.
Our results are adaptive to the intrinsic difficulty of the problem, since the bounds are tighter than existing results for easy problems and safeguard the same rate in the worst case.
arXiv Detail & Related papers (2021-12-29T02:42:59Z) - On the Stability of Low Pass Graph Filter With a Large Number of Edge
Rewires [21.794739464247687]
We show that the stability of a graph filter depends on perturbation to the community structure.
For block graphs, the graph filter distance converges to zero when the number of nodes approaches infinity.
arXiv Detail & Related papers (2021-10-14T09:00:35Z) - Graph Neural Networks with Adaptive Frequency Response Filter [55.626174910206046]
We develop a graph neural network framework AdaGNN with a well-smooth adaptive frequency response filter.
We empirically validate the effectiveness of the proposed framework on various benchmark datasets.
arXiv Detail & Related papers (2021-04-26T19:31:21Z) - Hardness of Random Optimization Problems for Boolean Circuits,
Low-Degree Polynomials, and Langevin Dynamics [78.46689176407936]
We show that families of algorithms fail to produce nearly optimal solutions with high probability.
For the case of Boolean circuits, our results improve the state-of-the-art bounds known in circuit complexity theory.
arXiv Detail & Related papers (2020-04-25T05:45:59Z) - No-Regret Prediction in Marginally Stable Systems [37.178095559618654]
We consider the problem of online prediction in a marginally stable linear dynamical system.
By applying our techniques to learning an autoregressive filter, we also achieve logarithmic regret in the partially observed setting.
arXiv Detail & Related papers (2020-02-06T01:53:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.