Adaptive Edge-to-Edge Interaction Learning for Point Cloud Analysis

• URL: http://arxiv.org/abs/2211.10888v1
• Date: Sun, 20 Nov 2022 07:10:14 GMT
• Title: Adaptive Edge-to-Edge Interaction Learning for Point Cloud Analysis
• Authors: Shanshan Zhao, Mingming Gong, Xi Li, Dacheng Tao
• Abstract summary: Key issue for point cloud data processing is extracting useful information from local regions. Previous works ignore the relation between edges in local regions, which encodes the local shape information. This paper proposes a novel Adaptive Edge-to-Edge Interaction Learning module.
• Score: 118.30840667784206
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent years have witnessed the great success of deep learning on various point cloud analysis tasks, e.g., classification and semantic segmentation. Since point cloud data is sparse and irregularly distributed, one key issue for point cloud data processing is extracting useful information from local regions. To achieve this, previous works mainly extract the points' features from local regions by learning the relation between each pair of adjacent points. However, these works ignore the relation between edges in local regions, which encodes the local shape information. Associating the neighbouring edges could potentially make the point-to-point relation more aware of the local structure and more robust. To explore the role of the relation between edges, this paper proposes a novel Adaptive Edge-to-Edge Interaction Learning module, which aims to enhance the point-to-point relation through modelling the edge-to-edge interaction in the local region adaptively. We further extend the module to a symmetric version to capture the local structure more thoroughly. Taking advantage of the proposed modules, we develop two networks for segmentation and shape classification tasks, respectively. Various experiments on several public point cloud datasets demonstrate the effectiveness of our method for point cloud analysis.

Related papers

• Unsupervised Non-Rigid Point Cloud Matching through Large Vision Models [1.3030624795284795]
  We propose a learning-based framework for non-rigid point cloud matching. Key insight is to incorporate semantic features derived from large vision models (LVMs) Our framework effectively leverages the structural information contained in the semantic features to address ambiguities arise from self-similarities among local geometries.
  arXiv  Detail & Related papers  (2024-08-16T07:02:19Z)
• Global Attention-Guided Dual-Domain Point Cloud Feature Learning for Classification and Segmentation [21.421806351869552]
  We propose a Global Attention-guided Dual-domain Feature Learning network (GAD) to address the above-mentioned issues. We first devise the Contextual Position-enhanced Transformer (CPT) module, which is armed with an improved global attention mechanism. Then, the Dual-domain K-nearest neighbor Feature Fusion (DKFF) is cascaded to conduct effective feature aggregation.
  arXiv  Detail & Related papers  (2024-07-12T05:19:19Z)
• PotholeGuard: A Pothole Detection Approach by Point Cloud Semantic Segmentation [0.0]
  3D Semantic Pothole research often overlooks point cloud sparsity, leading to suboptimal local feature capture and segmentation accuracy. Our model efficiently identifies hidden features and uses a feedback mechanism to enhance local characteristics. Our approach offers a promising solution for robust and accurate 3D pothole segmentation, with applications in road maintenance and safety.
  arXiv  Detail & Related papers  (2023-11-05T12:57:05Z)
• Collect-and-Distribute Transformer for 3D Point Cloud Analysis [82.03517861433849]
  We propose a new transformer network equipped with a collect-and-distribute mechanism to communicate short- and long-range contexts of point clouds. Results show the effectiveness of the proposed CDFormer, delivering several new state-of-the-art performances on point cloud classification and segmentation tasks.
  arXiv  Detail & Related papers  (2023-06-02T03:48:45Z)
• GFNet: Geometric Flow Network for 3D Point Cloud Semantic Segmentation [91.15865862160088]
  We introduce a geometric flow network (GFNet) to explore the geometric correspondence between different views in an align-before-fuse manner. Specifically, we devise a novel geometric flow module (GFM) to bidirectionally align and propagate the complementary information across different views.
  arXiv  Detail & Related papers  (2022-07-06T11:48:08Z)
• Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation [2.964101313270572]
  We present a comprehensive point cloud semantic segmentation network that aggregates both local and global multi-scale information. We introduce an Angle Correlation Point Convolution module to effectively learn the local shapes of points. Third, inspired by HRNet which has excellent performance on 2D image vision tasks, we build an HRNet customized for point cloud to learn global multi-scale context.
  arXiv  Detail & Related papers  (2022-06-27T21:03:33Z)
• SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation [94.11915008006483]
  We propose SemAffiNet for point cloud semantic segmentation. We conduct extensive experiments on the ScanNetV2 and NYUv2 datasets.
  arXiv  Detail & Related papers  (2022-05-26T17:00:23Z)
• PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysis [56.91758845045371]
  We propose a novel framework named Point Relation-Aware Network (PRA-Net) It is composed of an Intra-region Structure Learning (ISL) module and an Inter-region Relation Learning (IRL) module. Experiments on several 3D benchmarks covering shape classification, keypoint estimation, and part segmentation have verified the effectiveness and the ability of PRA-Net.
  arXiv  Detail & Related papers  (2021-12-09T13:24:43Z)
• Self-Sampling for Neural Point Cloud Consolidation [83.31236364265403]
  We introduce a novel technique for neural point cloud consolidation which learns from only the input point cloud. We repeatedly self-sample the input point cloud with global subsets that are used to train a deep neural network. We demonstrate the ability to consolidate point sets from a variety of shapes, while eliminating outliers and noise.
  arXiv  Detail & Related papers  (2020-08-14T17:16:02Z)
• SK-Net: Deep Learning on Point Cloud via End-to-end Discovery of Spatial Keypoints [7.223394571022494]
  This paper presents an end-to-end framework, SK-Net, to jointly optimize the inference of spatial keypoint with the learning of feature representation of a point cloud. Our proposed method performs better than or comparable with the state-of-the-art approaches in point cloud tasks.
  arXiv  Detail & Related papers  (2020-03-31T08:15:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.