Point Deformable Network with Enhanced Normal Embedding for Point Cloud Analysis

• URL: http://arxiv.org/abs/2312.13071v1
• Date: Wed, 20 Dec 2023 14:52:07 GMT
• Title: Point Deformable Network with Enhanced Normal Embedding for Point Cloud Analysis
• Authors: Xingyilang Yin, Xi Yang, Liangchen Liu, Nannan Wang, Xinbo Gao
• Abstract summary: Recently-based methods have shown strong performance in point cloud analysis. Simple architectures are able to learn geometric features in local point groups yet fail to model long-range dependencies directly. We propose Point Deformable Network (PDNet) to capture long-range relations with strong representation ability.
• Score: 59.12922158979068
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently MLP-based methods have shown strong performance in point cloud analysis. Simple MLP architectures are able to learn geometric features in local point groups yet fail to model long-range dependencies directly. In this paper, we propose Point Deformable Network (PDNet), a concise MLP-based network that can capture long-range relations with strong representation ability. Specifically, we put forward Point Deformable Aggregation Module (PDAM) to improve representation capability in both long-range dependency and adaptive aggregation among points. For each query point, PDAM aggregates information from deformable reference points rather than points in limited local areas. The deformable reference points are generated data-dependent, and we initialize them according to the input point positions. Additional offsets and modulation scalars are learned on the whole point features, which shift the deformable reference points to the regions of interest. We also suggest estimating the normal vector for point clouds and applying Enhanced Normal Embedding (ENE) to the geometric extractors to improve the representation ability of single-point. Extensive experiments and ablation studies on various benchmarks demonstrate the effectiveness and superiority of our PDNet.

Related papers

• Unsupervised Non-Rigid Point Cloud Matching through Large Vision Models [1.3030624795284795]
  We propose a learning-based framework for non-rigid point cloud matching. Key insight is to incorporate semantic features derived from large vision models (LVMs) Our framework effectively leverages the structural information contained in the semantic features to address ambiguities arise from self-similarities among local geometries.
  arXiv  Detail & Related papers  (2024-08-16T07:02:19Z)
• On-the-fly Point Feature Representation for Point Clouds Analysis [7.074010861305738]
  We propose On-the-fly Point Feature Representation (OPFR), which captures abundant geometric information explicitly through Curve Feature Generator module. We also introduce the Local Reference Constructor module, which approximates the local coordinate systems based on triangle sets. OPFR only requires extra 1.56ms for inference (65x faster than vanilla PFH) and 0.012M more parameters, and it can serve as a versatile plug-and-play module for various backbones.
  arXiv  Detail & Related papers  (2024-07-31T04:57:06Z)
• GAM : Gradient Attention Module of Optimization for Point Clouds Analysis [8.986123309626551]
  In point cloud analysis tasks, the existing local feature aggregation descriptors (LFAD) are unable to fully utilize information in the neighborhood of central points. We propose a gradient-based local attention module, termed as Gradient Attention Module (GAM) to address the aforementioned problem. GAM achieves the best performance among current point-based models with mIoU/OA/mAcc of 74.4%/90.6%/83.2%, respectively.
  arXiv  Detail & Related papers  (2023-03-19T02:51:14Z)
• Adaptive Edge-to-Edge Interaction Learning for Point Cloud Analysis [118.30840667784206]
  Key issue for point cloud data processing is extracting useful information from local regions. Previous works ignore the relation between edges in local regions, which encodes the local shape information. This paper proposes a novel Adaptive Edge-to-Edge Interaction Learning module.
  arXiv  Detail & Related papers  (2022-11-20T07:10:14Z)
• Object Localization under Single Coarse Point Supervision [107.46800858130658]
  We propose a POL method using coarse point annotations, relaxing the supervision signals from accurate key points to freely spotted points. CPR constructs point bags, selects semantic-correlated points, and produces semantic center points through multiple instance learning (MIL) In this way, CPR defines a weakly supervised evolution procedure, which ensures training high-performance object localizer under coarse point supervision.
  arXiv  Detail & Related papers  (2022-03-17T14:14:11Z)
• Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework [55.40001810884942]
  We introduce a pure residual network, called PointMLP, which integrates no sophisticated local geometrical extractors but still performs very competitively. On the real-world ScanObjectNN dataset, our method even surpasses the prior best method by 3.3% accuracy. Compared to most recent CurveNet, PointMLP trains 2x faster, tests 7x faster, and is more accurate on ModelNet40 benchmark.
  arXiv  Detail & Related papers  (2022-02-15T01:39:07Z)
• Robust Partial-to-Partial Point Cloud Registration in a Full Range [12.86951061306046]
  We propose Graph Matching Consensus Network (GMCNet), which estimates pose-invariant correspondences for fullrange 1 Partial-to-Partial point cloud Registration (PPR) GMCNet encodes point descriptors for each point cloud individually without using crosscontextual information, or ground truth correspondences for training.
  arXiv  Detail & Related papers  (2021-11-30T17:56:24Z)
• PAPooling: Graph-based Position Adaptive Aggregation of Local Geometry in Point Clouds [15.878533142927102]
  PaPooling explicitly models spatial relations among local points using a novel graph representation. It aggregates features in a position adaptive manner, enabling position-sensitive representation of aggregated features. It can significantly improve predictive accuracy, while with minimal extra computational overhead.
  arXiv  Detail & Related papers  (2021-11-28T07:26:55Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization [52.20602782690776]
  It is expensive and tedious to obtain large scale paired sparse-canned point sets for training from real scanned sparse data. We propose a self-supervised point cloud upsampling network, named SPU-Net, to capture the inherent upsampling patterns of points lying on the underlying object surface. We conduct various experiments on both synthetic and real-scanned datasets, and the results demonstrate that we achieve comparable performance to the state-of-the-art supervised methods.
  arXiv  Detail & Related papers  (2020-12-08T14:14:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.