Spectral embedding and the latent geometry of multipartite networks
- URL: http://arxiv.org/abs/2202.03945v3
- Date: Fri, 24 Oct 2025 15:22:34 GMT
- Title: Spectral embedding and the latent geometry of multipartite networks
- Authors: Alexander Modell, Ian Gallagher, Joshua Cape, Patrick Rubin-Delanchy,
- Abstract summary: Many networks are multipartite, meaning that they contain nodes of fundamentally different types.<n>This paper demonstrates that the node representations obtained via spectral embedding lie near type-specific low-dimensional subspaces of a higher-dimensional ambient space.<n>We propose a follow-on step after spectral embedding, to recover node representations in their intrinsic rather than ambient dimension.
- Score: 47.18054692085814
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Spectral embedding finds vector representations of the nodes of a network, based on the eigenvectors of a properly constructed matrix, and has found applications throughout science and technology. Many networks are multipartite, meaning that they contain nodes of fundamentally different types, e.g. drugs, diseases and proteins, and edges are only observed between nodes of different types. When the network is multipartite, this paper demonstrates that the node representations obtained via spectral embedding lie near type-specific low-dimensional subspaces of a higher-dimensional ambient space. For this reason we propose a follow-on step after spectral embedding, to recover node representations in their intrinsic rather than ambient dimension, proving uniform consistency under a low-rank, inhomogeneous random graph model. We demonstrate the performance of our procedure on a large 6-partite biomedical network relevant for drug discovery.
Related papers
- Exploring the Manifold of Neural Networks Using Diffusion Geometry [7.038126249994092]
We learn manifold where datapoints are neural networks by introducing a distance between the hidden layer representations of the neural networks.<n>These distances are then fed to the non-linear dimensionality reduction algorithm PHATE to create a manifold of neural networks.<n>Our analysis reveals that high-performing networks cluster together in the manifold, displaying consistent embedding patterns.
arXiv Detail & Related papers (2024-11-19T16:34:45Z) - Generating Graphs via Spectral Diffusion [48.70458395826864]
We present GGSD, a novel graph generative model based on 1) the spectral decomposition of the graph Laplacian matrix and 2) a diffusion process.
An extensive set of experiments on both synthetic and real-world graphs demonstrates the strengths of our model against state-of-the-art alternatives.
arXiv Detail & Related papers (2024-02-29T09:26:46Z) - Geometric Graph Filters and Neural Networks: Limit Properties and
Discriminability Trade-offs [122.06927400759021]
We study the relationship between a graph neural network (GNN) and a manifold neural network (MNN) when the graph is constructed from a set of points sampled from the manifold.
We prove non-asymptotic error bounds showing that convolutional filters and neural networks on these graphs converge to convolutional filters and neural networks on the continuous manifold.
arXiv Detail & Related papers (2023-05-29T08:27:17Z) - Attributed Multi-order Graph Convolutional Network for Heterogeneous
Graphs [29.618952407794783]
We propose anAttributed Multi-Order Graph Convolutional Network (AMOGCN), which automatically studies meta-paths containing multi-hop neighbors.
AMOGCN gains superior semi-supervised classification performance compared with state-of-the-art competitors.
arXiv Detail & Related papers (2023-04-13T08:31:16Z) - Implications of sparsity and high triangle density for graph
representation learning [67.98498239263549]
Recent work has shown that sparse graphs containing many triangles cannot be reproduced using a finite-dimensional representation of the nodes.
Here, we show that such graphs can be reproduced using an infinite-dimensional inner product model, where the node representations lie on a low-dimensional manifold.
arXiv Detail & Related papers (2022-10-27T09:15:15Z) - Geometric Graph Representation Learning via Maximizing Rate Reduction [73.6044873825311]
Learning node representations benefits various downstream tasks in graph analysis such as community detection and node classification.
We propose Geometric Graph Representation Learning (G2R) to learn node representations in an unsupervised manner.
G2R maps nodes in distinct groups into different subspaces, while each subspace is compact and different subspaces are dispersed.
arXiv Detail & Related papers (2022-02-13T07:46:24Z) - A singular Riemannian geometry approach to Deep Neural Networks II.
Reconstruction of 1-D equivalence classes [78.120734120667]
We build the preimage of a point in the output manifold in the input space.
We focus for simplicity on the case of neural networks maps from n-dimensional real spaces to (n - 1)-dimensional real spaces.
arXiv Detail & Related papers (2021-12-17T11:47:45Z) - Reflected entropy in random tensor networks [0.0]
In holographic theories, the reflected entropy has been shown to be dual to the area of the entanglement wedge cross section.
We analyze the important non-perturbative effects that smooth out the discontinuity in the reflected entropy across the Page phase transition.
By summing over all such effects, we obtain the reflected entanglement spectrum analytically, which agrees well with numerical studies.
arXiv Detail & Related papers (2021-12-16T18:59:00Z) - Community detection for weighted bipartite networks [1.0965065178451106]
citerohe2016co proposed co-Blockmodel (ScBM) as a tool for detecting community structure of binary bipartite graph data in network studies.
Here, to model a weighted bipartite network, we introduce a Bipartite Distribution-Free model by releasing ScBM's distribution restriction.
Our models do not require a specific distribution on generating elements of the adjacency matrix but only a block structure on the expected adjacency matrix.
arXiv Detail & Related papers (2021-09-21T17:01:36Z) - Spectral-Spatial Global Graph Reasoning for Hyperspectral Image
Classification [50.899576891296235]
Convolutional neural networks have been widely applied to hyperspectral image classification.
Recent methods attempt to address this issue by performing graph convolutions on spatial topologies.
arXiv Detail & Related papers (2021-06-26T06:24:51Z) - Pseudo-Euclidean Attract-Repel Embeddings for Undirected Graphs [73.0261182389643]
Dot product embeddings take a graph and construct vectors for nodes such that dot products between two vectors give the strength of the edge.
We remove the transitivity assumption by embedding nodes into a pseudo-Euclidean space.
Pseudo-Euclidean embeddings can compress networks efficiently, allow for multiple notions of nearest neighbors each with their own interpretation, and can be slotted' into existing models.
arXiv Detail & Related papers (2021-06-17T17:23:56Z) - Multiplex Bipartite Network Embedding using Dual Hypergraph
Convolutional Networks [16.62391694987056]
We develop an unsupervised Dual HyperGraph Convolutional Network (DualHGCN) model scalably transforms the multiplex bipartite network into two sets of homogeneous hypergraphs.
We benchmark DualHGCN using four real-world datasets on link prediction and node classification tasks.
arXiv Detail & Related papers (2021-02-12T07:20:36Z) - Emergent complex quantum networks in continuous-variables non-Gaussian
states [0.0]
We study a class of continuous-variable quantum states that present both multipartite entanglement and non-Gaussian statistics.
In particular, the states are built from an initial imprinted cluster state created via Gaussian entangling operations.
arXiv Detail & Related papers (2020-12-31T13:58:37Z) - Spectral clustering on spherical coordinates under the degree-corrected
stochastic blockmodel [5.156484100374058]
A novel spectral clustering algorithm is proposed for community detection under the degree-corrected blockmodel.
Results show improved performance over competing methods in representing computer networks.
arXiv Detail & Related papers (2020-11-09T16:55:38Z) - Spectral Embedding of Graph Networks [76.27138343125985]
We introduce an unsupervised graph embedding that trades off local node similarity and connectivity, and global structure.
The embedding is based on a generalized graph Laplacian, whose eigenvectors compactly capture both network structure and neighborhood proximity in a single representation.
arXiv Detail & Related papers (2020-09-30T04:59:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.