Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module

• URL: http://arxiv.org/abs/2004.08656v4
• Date: Thu, 13 Aug 2020 13:41:24 GMT
• Title: Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module
• Authors: Yanlu Wei, Renshuai Tao, Zhangjie Wu, Yuqing Ma, Libo Zhang, Xianglong Liu
• Abstract summary: We contribute the first high-quality object detection dataset for security inspection, named OPIXray. OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport. We propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors.
• Score: 50.75589128518707
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Security inspection often deals with a piece of baggage or suitcase where objects are heavily overlapped with each other, resulting in an unsatisfactory performance for prohibited items detection in X-ray images. In the literature, there have been rare studies and datasets touching this important topic. In this work, we contribute the first high-quality object detection dataset for security inspection, named Occluded Prohibited Items X-ray (OPIXray) image benchmark. OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport. The test set is further divided into three occlusion levels to better understand the performance of detectors. Furthermore, to deal with the occlusion in X-ray images detection, we propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors. Despite the heavy occlusion in X-ray imaging, shape appearance of objects can be preserved well, and meanwhile different materials visually appear with different colors and textures. Motivated by these observations, our DOAM simultaneously leverages the different appearance information of the prohibited item to generate the attention map, which helps refine feature maps for the general detectors. We comprehensively evaluate our module on the OPIXray dataset, and demonstrate that our module can consistently improve the performance of the state-of-the-art detection methods such as SSD, FCOS, etc, and significantly outperforms several widely-used attention mechanisms. In particular, the advantages of DOAM are more significant in the scenarios with higher levels of occlusion, which demonstrates its potential application in real-world inspections. The OPIXray benchmark and our model are released at https://github.com/OPIXray-author/OPIXray.

Related papers

• AO-DETR: Anti-Overlapping DETR for X-Ray Prohibited Items Detection [6.603436370737025]
  We propose an Anti-Overlapping DETR (AO-DETR) based on one of the state-of-the-art general object detectors, DINO. To address the feature coupling issue caused by overlapping phenomena, we introduce the Category-Specific One-to-One Assignment (CSA) strategy. To address the edge blurring problem caused by overlapping phenomena, we propose the Look Forwardly scheme.
  arXiv  Detail & Related papers  (2024-03-07T08:30:17Z)
• X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detection [113.10386151761682]
  Adversarial attacks targeting texture-free X-ray images are underexplored. In this paper, we take the first step toward the study of adversarial attacks targeted at X-ray prohibited item detection. We propose X-Adv to generate physically printable metals that act as an adversarial agent capable of deceiving X-ray detectors.
  arXiv  Detail & Related papers  (2023-02-19T06:31:17Z)
• PIDray: A Large-scale X-ray Benchmark for Real-World Prohibited Item Detection [21.055813365091662]
  We present a large-scale dataset, named PIDray, which covers various cases in real-world scenarios for prohibited item detection. In specific, PIDray collects 124,486 X-ray images for $12$ categories of prohibited items. We propose a general divide-and-conquer pipeline to develop baseline algorithms on PIDray.
  arXiv  Detail & Related papers  (2022-11-19T18:31:34Z)
• A Tri-Layer Plugin to Improve Occluded Detection [100.99802831241583]
  We propose a simple '' module for the detection head of two-stage object detectors to improve the recall of partially occluded objects. The module predicts a tri-layer of segmentation masks for the target object, the occluder and the occludee, and by doing so is able to better predict the mask of the target object. We also establish a COCO evaluation dataset to measure the recall performance of partially occluded and separated objects.
  arXiv  Detail & Related papers  (2022-10-18T17:59:51Z)
• Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detection [37.66855218659698]
  We first present a High-quality X-ray (HiXray) security inspection image dataset, which contains 102,928 common prohibited items of 8 categories. For accurate prohibited item detection, we propose the Lateral Inhibition Module (LIM) inspired by the fact that humans recognize these items by ignoring irrelevant information.
  arXiv  Detail & Related papers  (2021-08-23T03:59:23Z)
• Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark [53.9819155669618]
  This paper presents a large-scale dataset, named as PIDray, which covers various cases in real-world scenarios for prohibited item detection. With an intensive amount of effort, our dataset contains $12$ categories of prohibited items in $47,677$ X-ray images with high-quality annotated segmentation masks and bounding boxes. The proposed method performs favorably against the state-of-the-art methods, especially for detecting the deliberately hidden items.
  arXiv  Detail & Related papers  (2021-08-16T11:14:16Z)
• Over-sampling De-occlusion Attention Network for Prohibited Items Detection in Noisy X-ray Images [35.35752470993847]
  Security inspection is X-ray scanning for personal belongings in suitcases. Traditional CNN-based models trained through common image recognition datasets fail to achieve satisfactory performance in this scenario. We propose an over-sampling de-occlusion attention network (DOAM-O), which consists of a novel de-occlusion attention module and a new over-sampling training strategy.
  arXiv  Detail & Related papers  (2021-03-01T07:17:37Z)
• Black-box Explanation of Object Detectors via Saliency Maps [66.745167677293]
  We propose D-RISE, a method for generating visual explanations for the predictions of object detectors. We show that D-RISE can be easily applied to different object detectors including one-stage detectors such as YOLOv3 and two-stage detectors such as Faster-RCNN.
  arXiv  Detail & Related papers  (2020-06-05T02:13:35Z)
• EHSOD: CAM-Guided End-to-end Hybrid-Supervised Object Detection with Cascade Refinement [53.69674636044927]
  We present EHSOD, an end-to-end hybrid-supervised object detection system. It can be trained in one shot on both fully and weakly-annotated data. It achieves comparable results on multiple object detection benchmarks with only 30% fully-annotated data.
  arXiv  Detail & Related papers  (2020-02-18T08:04:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.