Teacher-Student Network for 3D Point Cloud Anomaly Detection with Few Normal Samples

• URL: http://arxiv.org/abs/2210.17258v2
• Date: Tue, 9 May 2023 13:49:20 GMT
• Title: Teacher-Student Network for 3D Point Cloud Anomaly Detection with Few Normal Samples
• Authors: Jianjian Qin, Chunzhi Gu, Jun Yu, Chao Zhang
• Abstract summary: We design a teacher-student structured model for 3D anomaly detection. Specifically, we use feature space alignment, dimension zoom, and max pooling to extract the features of the point cloud. Our method only requires very few normal samples to train the student network.
• Score: 21.358496646676087
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Anomaly detection, which is a critical and popular topic in computer vision, aims to detect anomalous samples that are different from the normal (i.e., non-anomalous) ones. The current mainstream methods focus on anomaly detection for images, whereas little attention has been paid to 3D point cloud. In this paper, drawing inspiration from the knowledge transfer ability of teacher-student architecture and the impressive feature extraction capability of recent neural networks, we design a teacher-student structured model for 3D anomaly detection. Specifically, we use feature space alignment, dimension zoom, and max pooling to extract the features of the point cloud and then minimize a multi-scale loss between the feature vectors produced by the teacher and the student networks. Moreover, our method only requires very few normal samples to train the student network due to the teacher-student distillation mechanism. Once trained, the teacher-student network pair can be leveraged jointly to fulfill 3D point cloud anomaly detection based on the calculated anomaly score. For evaluation, we compare our method against the reconstruction-based method on the ShapeNet-Part dataset. The experimental results and ablation studies quantitatively and qualitatively confirm that our model can achieve higher performance compared with the state of the arts in 3D anomaly detection with very few training samples.

Related papers

• Clustering based Point Cloud Representation Learning for 3D Analysis [80.88995099442374]
  We propose a clustering based supervised learning scheme for point cloud analysis. Unlike current de-facto, scene-wise training paradigm, our algorithm conducts within-class clustering on the point embedding space. Our algorithm shows notable improvements on famous point cloud segmentation datasets.
  arXiv  Detail & Related papers  (2023-07-27T03:42:12Z)
• StarNet: Style-Aware 3D Point Cloud Generation [82.30389817015877]
  StarNet is able to reconstruct and generate high-fidelity and even 3D point clouds using a mapping network. Our framework achieves comparable state-of-the-art performance on various metrics in the point cloud reconstruction and generation tasks.
  arXiv  Detail & Related papers  (2023-03-28T08:21:44Z)
• EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies [1.1602089225841632]
  We propose a lightweight feature extractor that processes an image in less than a millisecond on a modern GPU. We then use a student-teacher approach to detect anomalous features. We evaluate our method, called EfficientAD, on 32 datasets from three industrial anomaly detection dataset collections.
  arXiv  Detail & Related papers  (2023-03-25T18:48:33Z)
• Advancing 3D finger knuckle recognition via deep feature learning [51.871256510747465]
  Contactless 3D finger knuckle patterns have emerged as an effective biometric identifier due to its discriminativeness, visibility from a distance, and convenience. Recent research has developed a deep feature collaboration network which simultaneously incorporates intermediate features from deep neural networks with multiple scales. This paper advances this approach by investigating the possibility of learning a discriminative feature vector with the least possible dimension for representing 3D finger knuckle images.
  arXiv  Detail & Related papers  (2023-01-07T20:55:16Z)
• Asymmetric Student-Teacher Networks for Industrial Anomaly Detection [22.641661538154054]
  This work discovers previously unknown problems of student-teacher approaches for anomaly detection. Two neural networks are trained to produce the same output for the defect-free training examples. Our method produces state-of-the-art results on the two currently most relevant defect detection datasets MVTec AD and MVTec 3D-AD.
  arXiv  Detail & Related papers  (2022-10-14T13:56:50Z)
• Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptors [7.462336024223669]
  We present a new method for the unsupervised detection of geometric anomalies in high-resolution 3D point clouds. A student network is trained to match the output of a pretrained teacher network on anomaly-free point clouds. Our approach meets the requirements of practical applications regarding performance, runtime, and memory consumption.
  arXiv  Detail & Related papers  (2022-02-23T18:07:51Z)
• 3D Point Cloud Completion with Geometric-Aware Adversarial Augmentation [11.198650616143219]
  We show that training with adversarial samples can improve the performance of neural networks on 3D point cloud completion tasks. We propose a novel approach to generate adversarial samples that benefit both the performance of clean and adversarial samples. Experimental results show that training with the adversarial samples crafted by our method effectively enhances the performance of PCN on the ShapeNet dataset.
  arXiv  Detail & Related papers  (2021-09-21T13:16:46Z)
• Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning [50.24174211654775]
  We present a novel contrastive self-supervised learning framework for anomaly detection on attributed networks. Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair. A graph neural network-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure.
  arXiv  Detail & Related papers  (2021-02-27T03:17:20Z)
• Anomaly Detection in Video via Self-Supervised and Multi-Task Learning [113.81927544121625]
  Anomaly detection in video is a challenging computer vision problem. In this paper, we approach anomalous event detection in video through self-supervised and multi-task learning at the object level.
  arXiv  Detail & Related papers  (2020-11-15T10:21:28Z)
• Distance-Based Anomaly Detection for Industrial Surfaces Using Triplet Networks [2.7173993697663086]
  Surface anomaly detection plays an important quality control role in many manufacturing industries to reduce scrap production. Deep learning Convolutional Neural Networks (CNNs) have been at the forefront of these image processing-based solutions. In this paper, we address that challenge by training the CNN on surface texture patches with a distance-based anomaly detection objective.
  arXiv  Detail & Related papers  (2020-11-09T00:35:21Z)
• D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features [51.04841465193678]
  We leverage a 3D fully convolutional network for 3D point clouds. We propose a novel and practical learning mechanism that densely predicts both a detection score and a description feature for each 3D point. Our method achieves state-of-the-art results in both indoor and outdoor scenarios.
  arXiv  Detail & Related papers  (2020-03-06T12:51:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.