IF-Defense: 3D Adversarial Point Cloud Defense via Implicit Function based Restoration

• URL: http://arxiv.org/abs/2010.05272v3
• Date: Thu, 18 Mar 2021 14:43:20 GMT
• Title: IF-Defense: 3D Adversarial Point Cloud Defense via Implicit Function based Restoration
• Authors: Ziyi Wu, Yueqi Duan, He Wang, Qingnan Fan, Leonidas J. Guibas
• Abstract summary: Deep neural networks are vulnerable to various 3D adversarial attacks. We propose an IF-Defense framework to directly optimize the coordinates of input points with geometry-aware and distribution-aware constraints. Our results show that IF-Defense achieves the state-of-the-art defense performance against existing 3D adversarial attacks on PointNet, PointNet++, DGCNN, PointConv and RS-CNN.
• Score: 68.88711148515682
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Point cloud is an important 3D data representation widely used in many essential applications. Leveraging deep neural networks, recent works have shown great success in processing 3D point clouds. However, those deep neural networks are vulnerable to various 3D adversarial attacks, which can be summarized as two primary types: point perturbation that affects local point distribution, and surface distortion that causes dramatic changes in geometry. In this paper, we simultaneously address both the aforementioned attacks by learning to restore the clean point clouds from the attacked ones. More specifically, we propose an IF-Defense framework to directly optimize the coordinates of input points with geometry-aware and distribution-aware constraints. The former aims to recover the surface of point cloud through implicit function, while the latter encourages evenly-distributed points. Our experimental results show that IF-Defense achieves the state-of-the-art defense performance against existing 3D adversarial attacks on PointNet, PointNet++, DGCNN, PointConv and RS-CNN. For example, compared with previous methods, IF-Defense presents 20.02% improvement in classification accuracy against salient point dropping attack and 16.29% against LG-GAN attack on PointNet. Our code is available at https://github.com/Wuziyi616/IF-Defense.

Related papers

• PointCA: Evaluating the Robustness of 3D Point Cloud Completion Models Against Adversarial Examples [63.84378007819262]
  We propose PointCA, the first adversarial attack against 3D point cloud completion models. PointCA can generate adversarial point clouds that maintain high similarity with the original ones. We show that PointCA can cause a performance degradation from 77.9% to 16.7%, with the structure chamfer distance kept below 0.01.
  arXiv  Detail & Related papers  (2022-11-22T14:15:41Z)
• PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition [29.840946461846]
  3D Point cloud is a critical data representation in many real-world applications like autonomous driving, robotics, and medical imaging. Deep learning is notorious for its vulnerability to adversarial attacks. We propose PointDP, a purification strategy that leverages diffusion models to defend against 3D adversarial attacks.
  arXiv  Detail & Related papers  (2022-08-21T04:49:17Z)
• Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradients [27.738181762952006]
  Current defenders often learn to denoise the adversarial point clouds by reconstruction, and then feed them to the adversarials as input. We propose a family of robust structured declaratives for point cloud classification, where the internal constrained optimization mechanism can effectively defend adversarial attacks. We demonstrate state-of-the-art point cloud classification performance on ModelNet40 and ScanNet under seven different attackers.
  arXiv  Detail & Related papers  (2022-03-29T05:35:51Z)
• PointAttN: You Only Need Attention for Point Cloud Completion [89.88766317412052]
  Point cloud completion refers to completing 3D shapes from partial 3D point clouds. We propose a novel neural network for processing point cloud in a per-point manner to eliminate kNNs. The proposed framework, namely PointAttN, is simple, neat and effective, which can precisely capture the structural information of 3D shapes.
  arXiv  Detail & Related papers  (2022-03-16T09:20:01Z)
• Shape-invariant 3D Adversarial Point Clouds [111.72163188681807]
  Adversary and invisibility are two fundamental but conflict characters of adversarial perturbations. Previous adversarial attacks on 3D point cloud recognition have often been criticized for their noticeable point outliers. We propose a novel Point-Cloud Sensitivity Map to boost both the efficiency and imperceptibility of point perturbations.
  arXiv  Detail & Related papers  (2022-03-08T12:21:35Z)
• Local Aggressive Adversarial Attacks on 3D Point Cloud [12.121901103987712]
  Deep neural networks are prone to adversarial examples which could deliberately fool the model to make mistakes. In this paper, we propose a local aggressive adversarial attacks (L3A) to solve above issues. Experiments on PointNet, PointNet++ and DGCNN demonstrate the state-of-the-art performance of our method.
  arXiv  Detail & Related papers  (2021-05-19T12:22:56Z)
• PointGuard: Provably Robust 3D Point Cloud Classification [30.954481481297563]
  3D point cloud classification has many safety-critical applications such as autonomous driving and robotic grasping. In particular, an attacker can make a classifier predict an incorrect label for a 3D point cloud via carefully modifying, adding, and/or deleting a small number of its points. We propose PointGuard, the first defense that has provable robustness guarantees against adversarially modified, added, and/or deleted points.
  arXiv  Detail & Related papers  (2021-03-04T14:09:37Z)
• LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud-based Deep Networks [123.5839352227726]
  This paper proposes a novel label guided adversarial network (LG-GAN) for real-time flexible targeted point cloud attack. To the best of our knowledge, this is the first generation based 3D point cloud attack method.
  arXiv  Detail & Related papers  (2020-11-01T17:17:10Z)
• GRNet: Gridding Residual Network for Dense Point Cloud Completion [54.43648460932248]
  Estimating the complete 3D point cloud from an incomplete one is a key problem in many vision and robotics applications. We propose a novel Gridding Residual Network (GRNet) for point cloud completion. Experimental results indicate that the proposed GRNet performs favorably against state-of-the-art methods on the ShapeNet, Completion3D, and KITTI benchmarks.
  arXiv  Detail & Related papers  (2020-06-06T02:46:39Z)
• Defense-PointNet: Protecting PointNet Against Adversarial Attacks [19.814951750594574]
  We propose Defense-PointNet to minimize the vulnerability of PointNet to adversarial attacks. We show that Defense-PointNet significantly improves the robustness of the network against adversarial samples.
  arXiv  Detail & Related papers  (2020-02-27T02:35:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.