Unsupervised Anomaly Instance Segmentation for Baggage Threat Recognition

• URL: http://arxiv.org/abs/2107.07333v2
• Date: Fri, 16 Jul 2021 18:24:14 GMT
• Title: Unsupervised Anomaly Instance Segmentation for Baggage Threat Recognition
• Authors: Taimur Hassan and Samet Akcay and Mohammed Bennamoun and Salman Khan and Naoufel Werghi
• Abstract summary: This paper presents a novel unsupervised anomaly instance segmentation framework that recognizes baggage threats, in X-ray scans, as anomalies without requiring any ground truth labels. Thanks to its stylization capacity, the framework is trained only once, and at the inference stage, it detects and extracts contraband items regardless of their scanner specifications. A thorough evaluation of the proposed system on four public baggage X-ray datasets, without any re-training, demonstrates that it achieves competitive performance.
• Score: 39.40595024569702
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Identifying potential threats concealed within the baggage is of prime concern for the security staff. Many researchers have developed frameworks that can detect baggage threats from X-ray scans. However, to the best of our knowledge, all of these frameworks require extensive training on large-scale and well-annotated datasets, which are hard to procure in the real world. This paper presents a novel unsupervised anomaly instance segmentation framework that recognizes baggage threats, in X-ray scans, as anomalies without requiring any ground truth labels. Furthermore, thanks to its stylization capacity, the framework is trained only once, and at the inference stage, it detects and extracts contraband items regardless of their scanner specifications. Our one-staged approach initially learns to reconstruct normal baggage content via an encoder-decoder network utilizing a proposed stylization loss function. The model subsequently identifies the abnormal regions by analyzing the disparities within the original and the reconstructed scans. The anomalous regions are then clustered and post-processed to fit a bounding box for their localization. In addition, an optional classifier can also be appended with the proposed framework to recognize the categories of these extracted anomalies. A thorough evaluation of the proposed system on four public baggage X-ray datasets, without any re-training, demonstrates that it achieves competitive performance as compared to the conventional fully supervised methods (i.e., the mean average precision score of 0.7941 on SIXray, 0.8591 on GDXray, 0.7483 on OPIXray, and 0.5439 on COMPASS-XP dataset) while outperforming state-of-the-art semi-supervised and unsupervised baggage threat detection frameworks by 67.37%, 32.32%, 47.19%, and 45.81% in terms of F1 score across SIXray, GDXray, OPIXray, and COMPASS-XP datasets, respectively.

Related papers

• X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detection [113.10386151761682]
  Adversarial attacks targeting texture-free X-ray images are underexplored. In this paper, we take the first step toward the study of adversarial attacks targeted at X-ray prohibited item detection. We propose X-Adv to generate physically printable metals that act as an adversarial agent capable of deceiving X-ray detectors.
  arXiv  Detail & Related papers  (2023-02-19T06:31:17Z)
• Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting Concealed Baggage Threats [12.895636885728852]
  No framework exists that utilizes temporal baggage X-ray imagery to effectively screen highly concealed objects. We present a novel temporal fusion driven multi-scale residual fashioned encoder-decoder that takes series of consecutive scans as input. The proposed framework outperforms its competitors on the GDXray dataset on various metrics.
  arXiv  Detail & Related papers  (2021-11-04T06:19:52Z)
• Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition [39.40595024569702]
  We propose a novel multi-scale contour instance segmentation framework to identify cluttered contraband data in baggage X-ray scans. The proposed framework is rigorously validated on three public datasets, dubbed GDXray, SIXray, and OPIXray. To the best of our knowledge, this is the first contour instance segmentation framework that leverages multi-scale information to recognize cluttered and concealed contraband data.
  arXiv  Detail & Related papers  (2021-08-22T00:04:58Z)
• Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark [53.9819155669618]
  This paper presents a large-scale dataset, named as PIDray, which covers various cases in real-world scenarios for prohibited item detection. With an intensive amount of effort, our dataset contains $12$ categories of prohibited items in $47,677$ X-ray images with high-quality annotated segmentation masks and bounding boxes. The proposed method performs favorably against the state-of-the-art methods, especially for detecting the deliberately hidden items.
  arXiv  Detail & Related papers  (2021-08-16T11:14:16Z)
• Over-sampling De-occlusion Attention Network for Prohibited Items Detection in Noisy X-ray Images [35.35752470993847]
  Security inspection is X-ray scanning for personal belongings in suitcases. Traditional CNN-based models trained through common image recognition datasets fail to achieve satisfactory performance in this scenario. We propose an over-sampling de-occlusion attention network (DOAM-O), which consists of a novel de-occlusion attention module and a new over-sampling training strategy.
  arXiv  Detail & Related papers  (2021-03-01T07:17:37Z)
• Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion [45.39173572825739]
  This paper presents a novel instance segmentation framework that utilizes trainable structure tensors to highlight the contours of the occluded and cluttered contraband items. It is the only framework that has been validated on combined grayscale and colored scans obtained from four different types of X-ray scanners.
  arXiv  Detail & Related papers  (2020-09-28T09:12:10Z)
• Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module [50.75589128518707]
  We contribute the first high-quality object detection dataset for security inspection, named OPIXray. OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport. We propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors.
  arXiv  Detail & Related papers  (2020-04-18T16:10:55Z)
• Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from X-ray Scans [45.39173572825739]
  This paper presents a cascaded structure tensor framework that can automatically extract and recognize suspicious items in heavily occluded and cluttered baggage. The proposed framework has been rigorously evaluated using a total of 1,067,381 X-ray scans from publicly available GDXray and SIXray datasets.
  arXiv  Detail & Related papers  (2020-04-14T20:00:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.