PointWavelet: Learning in Spectral Domain for 3D Point Cloud Analysis
- URL: http://arxiv.org/abs/2302.05201v1
- Date: Fri, 10 Feb 2023 12:07:26 GMT
- Title: PointWavelet: Learning in Spectral Domain for 3D Point Cloud Analysis
- Authors: Cheng Wen, Jianzhi Long, Baosheng Yu, Dacheng Tao
- Abstract summary: We introduce a new method, PointWavelet, to explore local graphs in the spectral domain via a learnable graph wavelet transform.
Specifically, we first introduce the graph wavelet transform to form multi-scale spectral graph convolution to learn effective local structural representations.
To avoid the time-consuming spectral decomposition, we then devise a learnable graph wavelet transform, which significantly accelerates the overall training process.
- Score: 82.91576069955619
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With recent success of deep learning in 2D visual recognition, deep
learning-based 3D point cloud analysis has received increasing attention from
the community, especially due to the rapid development of autonomous driving
technologies. However, most existing methods directly learn point features in
the spatial domain, leaving the local structures in the spectral domain poorly
investigated. In this paper, we introduce a new method, PointWavelet, to
explore local graphs in the spectral domain via a learnable graph wavelet
transform. Specifically, we first introduce the graph wavelet transform to form
multi-scale spectral graph convolution to learn effective local structural
representations. To avoid the time-consuming spectral decomposition, we then
devise a learnable graph wavelet transform, which significantly accelerates the
overall training process. Extensive experiments on four popular point cloud
datasets, ModelNet40, ScanObjectNN, ShapeNet-Part, and S3DIS, demonstrate the
effectiveness of the proposed method on point cloud classification and
segmentation.
Related papers
- Dynamic 3D Point Cloud Sequences as 2D Videos [81.46246338686478]
3D point cloud sequences serve as one of the most common and practical representation modalities of real-world environments.
We propose a novel generic representation called textitStructured Point Cloud Videos (SPCVs)
SPCVs re-organizes a point cloud sequence as a 2D video with spatial smoothness and temporal consistency, where the pixel values correspond to the 3D coordinates of points.
arXiv Detail & Related papers (2024-03-02T08:18:57Z) - Clustering based Point Cloud Representation Learning for 3D Analysis [80.88995099442374]
We propose a clustering based supervised learning scheme for point cloud analysis.
Unlike current de-facto, scene-wise training paradigm, our algorithm conducts within-class clustering on the point embedding space.
Our algorithm shows notable improvements on famous point cloud segmentation datasets.
arXiv Detail & Related papers (2023-07-27T03:42:12Z) - GraphCSPN: Geometry-Aware Depth Completion via Dynamic GCNs [49.55919802779889]
We propose a Graph Convolution based Spatial Propagation Network (GraphCSPN) as a general approach for depth completion.
In this work, we leverage convolution neural networks as well as graph neural networks in a complementary way for geometric representation learning.
Our method achieves the state-of-the-art performance, especially when compared in the case of using only a few propagation steps.
arXiv Detail & Related papers (2022-10-19T17:56:03Z) - Point Cloud Attacks in Graph Spectral Domain: When 3D Geometry Meets
Graph Signal Processing [30.86044518259855]
Point cloud learning models have been shown to be vulnerable to adversarial attacks.
We propose the graph spectral domain attack, aiming to perturb graph transform coefficients in the spectral domain that corresponds to varying geometric structure.
Experimental results demonstrate the effectiveness of the proposed attack in terms of both the imperceptibility and attack success rates.
arXiv Detail & Related papers (2022-07-27T07:02:36Z) - CVFNet: Real-time 3D Object Detection by Learning Cross View Features [11.402076835949824]
We present a real-time view-based single stage 3D object detector, namely CVFNet.
We first propose a novel Point-Range feature fusion module that deeply integrates point and range view features in multiple stages.
Then, a special Slice Pillar is designed to well maintain the 3D geometry when transforming the obtained deep point-view features into bird's eye view.
arXiv Detail & Related papers (2022-03-13T06:23:18Z) - MG-SAGC: A multiscale graph and its self-adaptive graph convolution
network for 3D point clouds [6.504546503077047]
We propose a multiscale graph generation method for point clouds.
This approach transforms point clouds into a structured multiscale graph form that supports multiscale analysis of point clouds in the scale space.
Because traditional convolutional neural networks are not applicable to graph data with irregular neighborhoods, this paper presents an sef-adaptive convolution kernel that uses the Chebyshev graph to fit an irregular convolution filter.
arXiv Detail & Related papers (2020-12-23T01:58:41Z) - Graphite: GRAPH-Induced feaTure Extraction for Point Cloud Registration [80.69255347486693]
We introduce a GRAPH-Induced feaTure Extraction pipeline, a simple yet powerful feature and keypoint detector.
We construct a generic graph-based learning scheme to describe point cloud regions and extract salient points.
We Reformulate the 3D keypoint pipeline with graph neural networks which allow efficient processing of the point set.
arXiv Detail & Related papers (2020-10-18T19:41:09Z) - Airborne LiDAR Point Cloud Classification with Graph Attention
Convolution Neural Network [5.69168146446103]
We present a graph attention convolution neural network (GACNN) that can be directly applied to the classification of unstructured 3D point clouds obtained by airborne LiDAR.
Based on the proposed graph attention convolution module, we further design an end-to-end encoder-decoder network, named GACNN, to capture multiscale features of the point clouds.
Experiments on the ISPRS 3D labeling dataset show that the proposed model achieves a new state-of-the-art performance in terms of average F1 score (71.5%) and a satisfying overall accuracy (83.2%)
arXiv Detail & Related papers (2020-04-20T05:12:31Z) - Hypergraph Spectral Analysis and Processing in 3D Point Cloud [80.25162983501308]
3D point clouds have become a fundamental data structure to characterize 3D objects and surroundings.
To process 3D point clouds efficiently, a suitable model for the underlying structure and outlier noises is always critical.
We propose a hypergraph-based new point cloud model that is amenable to efficient analysis and processing.
arXiv Detail & Related papers (2020-01-08T05:30:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.