Edge-aware baselines for ogbn-proteins in PyTorch Geometric: species-wise normalization, post-hoc calibration, and cost-accuracy trade-offs
- URL: http://arxiv.org/abs/2511.13250v1
- Date: Mon, 17 Nov 2025 11:09:46 GMT
- Title: Edge-aware baselines for ogbn-proteins in PyTorch Geometric: species-wise normalization, post-hoc calibration, and cost-accuracy trade-offs
- Abstract summary: We present reproducible, edge-aware baselines for ogbn-proteins in PyTorch Geometric.<n>Our strongest baseline is GraphSAGE with sum-based edge-to-node features.<n>Post-hoc per-label temperature scaling plus per-label thresholds substantially improves micro-F1 and expected calibration error (ECE) with negligible AUC change.
- Score: 45.88028371034407
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present reproducible, edge-aware baselines for ogbn-proteins in PyTorch Geometric (PyG). We study two system choices that dominate practice: (i) how 8-dimensional edge evidence is aggregated into node inputs, and (ii) how edges are used inside message passing. Our strongest baseline is GraphSAGE with sum-based edge-to-node features. We compare LayerNorm (LN), BatchNorm (BN), and a species-aware Conditional LayerNorm (CLN), and report compute cost (time, VRAM, parameters) together with accuracy (ROC-AUC) and decision quality. In our primary experimental setup (hidden size 512, 3 layers, 3 seeds), sum consistently beats mean and max; BN attains the best AUC, while CLN matches the AUC frontier with better thresholded F1. Finally, post-hoc per-label temperature scaling plus per-label thresholds substantially improves micro-F1 and expected calibration error (ECE) with negligible AUC change, and light label-correlation smoothing yields small additional gains. We release standardized artifacts and scripts used for all of the runs presented in the paper.
Related papers
- No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels [1.2432856108679675]
We propose Finite-Library Input-Warped Bayesian Optimization (FLIWBO), which selects warps from a finite library of smooth input maps by any history-dependent rule.<n>It adapts the input geometry to accelerate learning while retaining high-probability convergence guarantees.<n> Controlled diagnostics show that finite-library warping repairs planted geometry mismatches and identify FLIWBO failure cases.
arXiv Detail & Related papers (2026-09-02T16:04:07Z) - LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Models [56.999481798138625]
LimiX-2M is a 2M- parameter model that outperforms larger TabPFN-v2 and TabICL baselines on widely used benchmarks.<n>We present a unified tokenize-and-route framework for strong Tabular foundation models (TFMs)<n>Results highlight value-aware tokenization and readout-aligned routing as key levers for improving the accuracy--efficiency trade-off in TFMs.
arXiv Detail & Related papers (2026-06-03T06:07:33Z) - HyperTopo-Adapters: Geometry- and Topology-Aware Segmentation of Leaf Lesions on Frozen Encoders [0.14323566945483493]
Leaf-lesion segmentation is topology-sensitive; small merges, splits, or false holes can be meaningful descriptors of biochemical pathways.<n>I explore HyperTopo-Adapters, a lightweight, parameter-efficient head trained on top of a frozen vision encoder.<n>Early results show consistent gains in boundary and topology metrics on a Kaggle leaf-lesion dataset.
arXiv Detail & Related papers (2025-12-29T04:27:26Z) - AEGIS: Authentic Edge Growth In Sparsity for Link Prediction in Edge-Sparse Bipartite Knowledge Graphs [0.8594140167290097]
AEGIS is an edge-only augmentation framework that resamples existing training edges.<n>On text-rich GDP graph, semantic KNN achieves the largest AUC improvement and Brier score reduction.
arXiv Detail & Related papers (2025-09-26T07:51:40Z) - How Learnable Grids Recover Fine Detail in Low Dimensions: A Neural Tangent Kernel Analysis of Multigrid Parametric Encodings [106.3726679697804]
We compare the two most common techniques for mitigating this spectral bias: Fourier feature encodings (FFE) and multigrid parametric encodings (MPE)<n>MPEs are seen as the standard for low dimensional mappings, but MPEs often outperform them and learn representations with higher resolution and finer detail.<n>We prove that MPEs improve a network's performance through the structure of their grid and not their learnable embedding.
arXiv Detail & Related papers (2025-04-18T02:18:08Z) - Convergence Rate Analysis of LION [54.28350823319057]
LION converges iterations of $cal(sqrtdK-)$ measured by gradient Karush-Kuhn-T (sqrtdK-)$.
We show that LION can achieve lower loss and higher performance compared to standard SGD.
arXiv Detail & Related papers (2024-11-12T11:30:53Z) - Learning to utilize image second-order derivative information for crisp edge detection [16.152236524867078]
Edge detection is a fundamental task in computer vision.<n>Recent top-performing edge detection methods tend to generate thick and noisy edge lines.<n>We propose a second-order derivative-based multi-scale contextual enhancement module (SDMCM) to help the model locate true edge pixels accurately.<n>We also construct a hybrid focal loss function (HFL) to alleviate the imbalanced distribution issue.<n>In the end, we propose a U-shape network named LUS-Net which is based on the SDMCM and BRM for edge detection.
arXiv Detail & Related papers (2024-06-09T13:25:02Z) - Transformers as Support Vector Machines [54.642793677472724]
We establish a formal equivalence between the optimization geometry of self-attention and a hard-margin SVM problem.
We characterize the implicit bias of 1-layer transformers optimized with gradient descent.
We believe these findings inspire the interpretation of transformers as a hierarchy of SVMs that separates and selects optimal tokens.
arXiv Detail & Related papers (2023-08-31T17:57:50Z) - G3Reg: Pyramid Graph-based Global Registration using Gaussian Ellipsoid Model [21.189016878269104]
This study introduces a novel framework, G3Reg, for fast and robust global registration of LiDAR point clouds.
In contrast to conventional complex keypoints and descriptors, we extract fundamental geometric primitives.
We present a distrust-and-verify scheme based on a Pyramid Graph for Global Registration.
arXiv Detail & Related papers (2023-08-22T17:23:00Z) - Finding Heterophilic Neighbors via Confidence-based Subgraph Matching
for Semi-supervised Node Classification [1.3190581566723918]
Graph Neural Networks (GNNs) have proven to be powerful in many graph-based applications.
However, they fail to generalize well under heterophilic setups.
arXiv Detail & Related papers (2023-02-20T04:23:34Z) - Correcting Momentum with Second-order Information [50.992629498861724]
We develop a new algorithm for non-critical optimization that finds an $O(epsilon)$epsilon point in the optimal product.
We validate our results on a variety of large-scale deep learning benchmarks and architectures.
arXiv Detail & Related papers (2021-03-04T19:01:20Z) - Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D
Edge Alignment [85.32080531133799]
This paper reviews the classical problem of free-form curve registration and applies it to an efficient RGBD visual odometry system called Canny-VO.
Two replacements for the distance transformation commonly used in edge registration are proposed: Approximate Nearest Neighbour Fields and Oriented Nearest Neighbour Fields.
3D2D edge alignment benefits from these alternative formulations in terms of both efficiency and accuracy.
arXiv Detail & Related papers (2020-12-15T11:42:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.