Graph Signal Processing for Geometric Data and Beyond: Theory and
Applications
- URL: http://arxiv.org/abs/2008.01918v3
- Date: Sat, 4 Sep 2021 17:35:02 GMT
- Title: Graph Signal Processing for Geometric Data and Beyond: Theory and
Applications
- Authors: Wei Hu, Jiahao Pang, Xianming Liu, Dong Tian, Chia-Wen Lin, Anthony
Vetro
- Abstract summary: Graph Signal Processing (GSP) enables processing signals that reside on irregular domains.
GSP methodologies for geometric data in a unified manner by bridging the connections between geometric data and graphs.
Recently developed Graph Neural Networks (GNNs) interpret the operation of these networks from the perspective of GSP.
- Score: 55.81966207837108
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Geometric data acquired from real-world scenes, e.g., 2D depth images, 3D
point clouds, and 4D dynamic point clouds, have found a wide range of
applications including immersive telepresence, autonomous driving,
surveillance, etc. Due to irregular sampling patterns of most geometric data,
traditional image/video processing methodologies are limited, while Graph
Signal Processing (GSP) -- a fast-developing field in the signal processing
community -- enables processing signals that reside on irregular domains and
plays a critical role in numerous applications of geometric data from low-level
processing to high-level analysis. To further advance the research in this
field, we provide the first timely and comprehensive overview of GSP
methodologies for geometric data in a unified manner by bridging the
connections between geometric data and graphs, among the various geometric data
modalities, and with spectral/nodal graph filtering techniques. We also discuss
the recently developed Graph Neural Networks (GNNs) and interpret the operation
of these networks from the perspective of GSP. We conclude with a brief
discussion of open problems and challenges.
Related papers
- A Survey of Geometric Graph Neural Networks: Data Structures, Models and
Applications [67.33002207179923]
This paper presents a survey of data structures, models, and applications related to geometric GNNs.
We provide a unified view of existing models from the geometric message passing perspective.
We also summarize the applications as well as the related datasets to facilitate later research for methodology development and experimental evaluation.
arXiv Detail & Related papers (2024-03-01T12:13:04Z) - GraphCSPN: Geometry-Aware Depth Completion via Dynamic GCNs [49.55919802779889]
We propose a Graph Convolution based Spatial Propagation Network (GraphCSPN) as a general approach for depth completion.
In this work, we leverage convolution neural networks as well as graph neural networks in a complementary way for geometric representation learning.
Our method achieves the state-of-the-art performance, especially when compared in the case of using only a few propagation steps.
arXiv Detail & Related papers (2022-10-19T17:56:03Z) - Convolutional Neural Networks on Manifolds: From Graphs and Back [122.06927400759021]
We propose a manifold neural network (MNN) composed of a bank of manifold convolutional filters and point-wise nonlinearities.
To sum up, we focus on the manifold model as the limit of large graphs and construct MNNs, while we can still bring back graph neural networks by the discretization of MNNs.
arXiv Detail & Related papers (2022-10-01T21:17:39Z) - Self-supervised Geometric Perception [96.89966337518854]
Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels.
We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
arXiv Detail & Related papers (2021-03-04T15:34:43Z) - A Hierarchical Graph Signal Processing Approach to Inference from
Spatiotemporal Signals [14.416786768268233]
Motivated by the emerging area of graph signal processing (GSP), we introduce a novel method to draw inference from signals.
In this paper we leverage techniques to develop a hierarchical feature extraction approach.
We test our approach on the intracranial EEG (iEEG) data set of the K aggle seizure detection contest.
arXiv Detail & Related papers (2020-10-25T17:08:13Z) - Graph signal processing for machine learning: A review and new
perspectives [57.285378618394624]
We review a few important contributions made by GSP concepts and tools, such as graph filters and transforms, to the development of novel machine learning algorithms.
We discuss exploiting data structure and relational priors, improving data and computational efficiency, and enhancing model interpretability.
We provide new perspectives on future development of GSP techniques that may serve as a bridge between applied mathematics and signal processing on one side, and machine learning and network science on the other.
arXiv Detail & Related papers (2020-07-31T13:21:33Z) - Multi-way Graph Signal Processing on Tensors: Integrative analysis of
irregular geometries [8.49932255734124]
Graph signal processing (GSP) is an important methodology for studying data residing on irregular structures.
In this paper, we review modern signal processing frameworks generalizing GSP to multi-way data.
arXiv Detail & Related papers (2020-06-30T18:15:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.