Rotation Perturbation Robustness in Point Cloud Analysis: A Perspective of Manifold Distillation

• URL: http://arxiv.org/abs/2411.01748v1
• Date: Mon, 04 Nov 2024 02:13:41 GMT
• Title: Rotation Perturbation Robustness in Point Cloud Analysis: A Perspective of Manifold Distillation
• Authors: Xinyu Xu, Huazhen Liu, Feiming Wei, Huilin Xiong, Wenxian Yu, Tao Zhang,
• Abstract summary: This paper remodels the point cloud from the perspective of manifold and designs a manifold distillation method to achieve the robustness of rotation perturbation. Experiments carried out on four different datasets verify the effectiveness of our method.
• Score: 10.14368825342757
• License:
• Abstract: Point cloud is often regarded as a discrete sampling of Riemannian manifold and plays a pivotal role in the 3D image interpretation. Particularly, rotation perturbation, an unexpected small change in rotation caused by various factors (like equipment offset, system instability, measurement errors and so on), can easily lead to the inferior results in point cloud learning tasks. However, classical point cloud learning methods are sensitive to rotation perturbation, and the existing networks with rotation robustness also have much room for improvements in terms of performance and noise tolerance. Given these, this paper remodels the point cloud from the perspective of manifold as well as designs a manifold distillation method to achieve the robustness of rotation perturbation without any coordinate transformation. In brief, during the training phase, we introduce a teacher network to learn the rotation robustness information and transfer this information to the student network through online distillation. In the inference phase, the student network directly utilizes the original 3D coordinate information to achieve the robustness of rotation perturbation. Experiments carried out on four different datasets verify the effectiveness of our method. Averagely, on the Modelnet40 and ScanobjectNN classification datasets with random rotation perturbations, our classification accuracy has respectively improved by 4.92% and 4.41%, compared to popular rotation-robust networks; on the ShapeNet and S3DIS segmentation datasets, compared to the rotation-robust networks, the improvements of mIoU are 7.36% and 4.82%, respectively. Besides, from the experimental results, the proposed algorithm also shows excellent performance in resisting noise and outliers.

Related papers

• On Representation of 3D Rotation in the Context of Deep Learning [3.698726665797999]
  We evaluate the performance of ResNet18 networks for 3D rotation estimation using several rotation representations and loss functions. In line with previous research, we found that networks using the continuous 5D and 6D representations performed better than the discontinuous ones.
  arXiv  Detail & Related papers  (2024-10-14T10:09:44Z)
• WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration [68.25711405944239]
  Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. We introduce a model-driven WiNet that incrementally estimates scale-wise wavelet coefficients for the displacement/velocity field across various scales.
  arXiv  Detail & Related papers  (2024-07-18T11:51:01Z)
• PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registration [8.668461141536383]
  Learning rotation-invariant distinctive features is a fundamental requirement for point cloud registration. Existing methods often use rotation-sensitive networks to extract features, while employing rotation augmentation to learn an approximate invariant mapping rudely. We propose a novel position-aware rotation-equivariant network, for efficient, light-weighted, and robust registration.
  arXiv  Detail & Related papers  (2024-07-14T10:26:38Z)
• VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representations [55.25238503204253]
  We propose a novel rotation estimation network, termed as VI-Net, to make the task easier. To process the spherical signals, a Spherical Feature Pyramid Network is constructed based on a novel design of SPAtial Spherical Convolution. Experiments on the benchmarking datasets confirm the efficacy of our method, which outperforms the existing ones with a large margin in the regime of high precision.
  arXiv  Detail & Related papers  (2023-08-19T05:47:53Z)
• SPE-Net: Boosting Point Cloud Analysis via Rotation Robustness Enhancement [118.20816888815658]
  We propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded Selective Position variant' procedure relies on an attention mechanism that can effectively attend to the underlying rotation condition of the input. We demonstrate the merits of the SPE-Net and the associated hypothesis on four benchmarks, showing evident improvements on both rotated and unrotated test data over SOTA methods.
  arXiv  Detail & Related papers  (2022-11-15T15:59:09Z)
• ART-Point: Improving Rotation Robustness of Point Cloud Classifiers via Adversarial Rotation [89.47574181669903]
  In this study, we show that the rotation robustness of point cloud classifiers can also be acquired via adversarial training. Specifically, our proposed framework named ART-Point regards the rotation of the point cloud as an attack. We propose a fast one-step optimization to efficiently reach the final robust model.
  arXiv  Detail & Related papers  (2022-03-08T07:20:16Z)
• Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapes [86.2129580231191]
  Adjoint Rigid Transform (ART) Network is a neural module which can be integrated with a variety of 3D networks. ART learns to rotate input shapes to a learned canonical orientation, which is crucial for a lot of tasks. We will release our code and pre-trained models for further research.
  arXiv  Detail & Related papers  (2021-02-01T20:58:45Z)
• Spherical Convolutional Neural Networks: Stability to Perturbations in SO(3) [175.96910854433574]
  Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure. This paper investigates the properties that Spherical CNNs exhibit as they pertain to the rotational structure inherent in spherical signals.
  arXiv  Detail & Related papers  (2020-10-12T17:16:07Z)
• A Smooth Representation of Belief over SO(3) for Deep Rotation Learning with Uncertainty [33.627068152037815]
  We present a novel symmetric matrix representation of the 3D rotation group, SO(3), with two important properties that make it particularly suitable for learned models. We empirically validate the benefits of our formulation by training deep neural rotation regressors on two data modalities. This capability is key for safety-critical applications where detecting novel inputs can prevent catastrophic failure of learned models.
  arXiv  Detail & Related papers  (2020-06-01T15:57:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.