Signal processing on simplicial complexes
- URL: http://arxiv.org/abs/2106.07471v1
- Date: Mon, 14 Jun 2021 14:56:51 GMT
- Title: Signal processing on simplicial complexes
- Authors: Michael T. Schaub, Jean-Baptiste Seby, Florian Frantzen, T. Mitchell
Roddenberry, Yu Zhu, Santiago Segarra
- Abstract summary: We focus on a closely related, but distinct third perspective: how can we use higher-order relationships to process signals and data supported on higher-order network structures.
In particular, we survey how ideas from signal processing of data supported on regular domains, such as time series or images, can be extended to graphs and simplicial complexes.
- Score: 19.035399031968502
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Higher-order networks have so far been considered primarily in the context of
studying the structure of complex systems, i.e., the higher-order or multi-way
relations connecting the constituent entities. More recently, a number of
studies have considered dynamical processes that explicitly ac- count for such
higher-order dependencies, e.g., in the context of epidemic spreading processes
or opinion formation. In this chapter, we focus on a closely related, but
distinct third perspective: how can we use higher-order relationships to
process signals and data supported on higher-order network structures. In
particular, we survey how ideas from signal processing of data supported on
regular domains, such as time series or images, can be extended to graphs and
simplicial complexes. We discuss Fourier analysis, signal denois- ing, signal
interpolation, and nonlinear processing through neural networks based on
simplicial complexes. Key to our developments is the Hodge Laplacian matrix, a
multi-relational operator that leverages the special structure of simplicial
complexes and generalizes desirable properties of the Laplacian matrix in graph
signal processing.
Related papers
- Spectral Convergence of Complexon Shift Operators [38.89310649097387]
We study the transferability of Topological Signal Processing via a generalized higher-order version of graphon, known as complexon.
Inspired by the graphon shift operator and message-passing neural network, we construct a marginal complexon and complexon shift operator.
We prove that when a simplicial complex signal sequence converges to a complexon signal, the eigenvalues, eigenspaces, and Fourier transform of the corresponding CSOs converge to that of the limit complexon signal.
arXiv Detail & Related papers (2023-09-12T08:40:20Z) - Generalized Simplicial Attention Neural Networks [22.171364354867723]
We introduce Generalized Simplicial Attention Neural Networks (GSANs)
GSANs process data living on simplicial complexes using masked self-attentional layers.
These schemes learn how to combine data associated with neighbor simplices of consecutive order in a task-oriented fashion.
arXiv Detail & Related papers (2023-09-05T11:29:25Z) - Convolutional Learning on Multigraphs [153.20329791008095]
We develop convolutional information processing on multigraphs and introduce convolutional multigraph neural networks (MGNNs)
To capture the complex dynamics of information diffusion within and across each of the multigraph's classes of edges, we formalize a convolutional signal processing model.
We develop a multigraph learning architecture, including a sampling procedure to reduce computational complexity.
The introduced architecture is applied towards optimal wireless resource allocation and a hate speech localization task, offering improved performance over traditional graph neural networks.
arXiv Detail & Related papers (2022-09-23T00:33:04Z) - Complex-Value Spatio-temporal Graph Convolutional Neural Networks and
its Applications to Electric Power Systems AI [24.914412344973996]
We generalize graph convolutional neural networks (GCN) to the complex domain.
We prove that complex-valued GCNs are stable with respect to perturbations of the underlying graph support.
We apply complex GCN to power grid state forecasting, power grid-attack detection and localization.
arXiv Detail & Related papers (2022-08-17T18:56:48Z) - Deep Architecture Connectivity Matters for Its Convergence: A
Fine-Grained Analysis [94.64007376939735]
We theoretically characterize the impact of connectivity patterns on the convergence of deep neural networks (DNNs) under gradient descent training.
We show that by a simple filtration on "unpromising" connectivity patterns, we can trim down the number of models to evaluate.
arXiv Detail & Related papers (2022-05-11T17:43:54Z) - Deep Equilibrium Assisted Block Sparse Coding of Inter-dependent
Signals: Application to Hyperspectral Imaging [71.57324258813675]
A dataset of inter-dependent signals is defined as a matrix whose columns demonstrate strong dependencies.
A neural network is employed to act as structure prior and reveal the underlying signal interdependencies.
Deep unrolling and Deep equilibrium based algorithms are developed, forming highly interpretable and concise deep-learning-based architectures.
arXiv Detail & Related papers (2022-03-29T21:00:39Z) - Dist2Cycle: A Simplicial Neural Network for Homology Localization [66.15805004725809]
Simplicial complexes can be viewed as high dimensional generalizations of graphs that explicitly encode multi-way ordered relations.
We propose a graph convolutional model for learning functions parametrized by the $k$-homological features of simplicial complexes.
arXiv Detail & Related papers (2021-10-28T14:59:41Z) - Signal Processing on Cell Complexes [7.0471949371778795]
We give an introduction to signal processing on (abstract) regular cell complexes.
We discuss how appropriate Hodge Laplacians for these cell complexes can be derived.
arXiv Detail & Related papers (2021-10-11T21:11:59Z) - Signal Processing on Higher-Order Networks: Livin' on the Edge ... and
Beyond [20.422050836383725]
This tutorial paper presents a didactic treatment of the emerging topic of signal processing on higher-order networks.
We introduce the building blocks for processing data on simplicial complexes and hypergraphs.
arXiv Detail & Related papers (2021-01-14T09:08:26Z) - Quiver Signal Processing (QSP) [145.6921439353007]
We state the basics for a signal processing framework on quiver representations.
We propose a signal processing framework that allows us to handle heterogeneous multidimensional information in networks.
arXiv Detail & Related papers (2020-10-22T08:40:15Z) - Graph signal processing for machine learning: A review and new
perspectives [57.285378618394624]
We review a few important contributions made by GSP concepts and tools, such as graph filters and transforms, to the development of novel machine learning algorithms.
We discuss exploiting data structure and relational priors, improving data and computational efficiency, and enhancing model interpretability.
We provide new perspectives on future development of GSP techniques that may serve as a bridge between applied mathematics and signal processing on one side, and machine learning and network science on the other.
arXiv Detail & Related papers (2020-07-31T13:21:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.