Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition

• URL: http://arxiv.org/abs/2108.09603v1
• Date: Sun, 22 Aug 2021 00:04:58 GMT
• Title: Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat Recognition
• Authors: Taimur Hassan and Samet Akcay and Mohammed Bennamoun and Salman Khan and Naoufel Werghi
• Abstract summary: We propose a novel multi-scale contour instance segmentation framework to identify cluttered contraband data in baggage X-ray scans. The proposed framework is rigorously validated on three public datasets, dubbed GDXray, SIXray, and OPIXray. To the best of our knowledge, this is the first contour instance segmentation framework that leverages multi-scale information to recognize cluttered and concealed contraband data.
• Score: 39.40595024569702
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automated systems designed for screening contraband items from the X-ray imagery are still facing difficulties with high clutter, concealment, and extreme occlusion. In this paper, we addressed this challenge using a novel multi-scale contour instance segmentation framework that effectively identifies the cluttered contraband data within the baggage X-ray scans. Unlike standard models that employ region-based or keypoint-based techniques to generate multiple boxes around objects, we propose to derive proposals according to the hierarchy of the regions defined by the contours. The proposed framework is rigorously validated on three public datasets, dubbed GDXray, SIXray, and OPIXray, where it outperforms the state-of-the-art methods by achieving the mean average precision score of 0.9779, 0.9614, and 0.8396, respectively. Furthermore, to the best of our knowledge, this is the first contour instance segmentation framework that leverages multi-scale information to recognize cluttered and concealed contraband data from the colored and grayscale security X-ray imagery.

Related papers

• Temporal Action Localization with Enhanced Instant Discriminability [66.76095239972094]
  Temporal action detection (TAD) aims to detect all action boundaries and their corresponding categories in an untrimmed video. We propose a one-stage framework named TriDet to resolve imprecise predictions of action boundaries by existing methods. Experimental results demonstrate the robustness of TriDet and its state-of-the-art performance on multiple TAD datasets.
  arXiv  Detail & Related papers  (2023-09-11T16:17:50Z)
• Diffusion-Based Hierarchical Multi-Label Object Detection to Analyze Panoramic Dental X-rays [1.2239764810898268]
  We develop an end-to-end model that can identify problematic teeth with dental enumeration and associated diagnoses at the same time. To learn from all three hierarchies jointly, we introduce a novel diffusion-based hierarchical multi-label object detection framework. Experimental results show that our method significantly outperforms state-of-the-art object detection methods.
  arXiv  Detail & Related papers  (2023-03-11T21:31:54Z)
• Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark [53.9819155669618]
  This paper presents a large-scale dataset, named as PIDray, which covers various cases in real-world scenarios for prohibited item detection. With an intensive amount of effort, our dataset contains $12$ categories of prohibited items in $47,677$ X-ray images with high-quality annotated segmentation masks and bounding boxes. The proposed method performs favorably against the state-of-the-art methods, especially for detecting the deliberately hidden items.
  arXiv  Detail & Related papers  (2021-08-16T11:14:16Z)
• Unsupervised Anomaly Instance Segmentation for Baggage Threat Recognition [39.40595024569702]
  This paper presents a novel unsupervised anomaly instance segmentation framework that recognizes baggage threats, in X-ray scans, as anomalies without requiring any ground truth labels. Thanks to its stylization capacity, the framework is trained only once, and at the inference stage, it detects and extracts contraband items regardless of their scanner specifications. A thorough evaluation of the proposed system on four public baggage X-ray datasets, without any re-training, demonstrates that it achieves competitive performance.
  arXiv  Detail & Related papers  (2021-07-15T13:56:55Z)
• Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
  We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images. We first apply an image encoder to classify the chest X-rays and to generate the image features. The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
  arXiv  Detail & Related papers  (2021-04-11T09:16:29Z)
• Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion [45.39173572825739]
  This paper presents a novel instance segmentation framework that utilizes trainable structure tensors to highlight the contours of the occluded and cluttered contraband items. It is the only framework that has been validated on combined grayscale and colored scans obtained from four different types of X-ray scanners.
  arXiv  Detail & Related papers  (2020-09-28T09:12:10Z)
• Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray Images [0.0]
  We propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision. We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air between the lung and the chest wall.
  arXiv  Detail & Related papers  (2020-07-01T20:48:35Z)
• Occluded Prohibited Items Detection: an X-ray Security Inspection Benchmark and De-occlusion Attention Module [50.75589128518707]
  We contribute the first high-quality object detection dataset for security inspection, named OPIXray. OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport. We propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors.
  arXiv  Detail & Related papers  (2020-04-18T16:10:55Z)
• Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from X-ray Scans [45.39173572825739]
  This paper presents a cascaded structure tensor framework that can automatically extract and recognize suspicious items in heavily occluded and cluttered baggage. The proposed framework has been rigorously evaluated using a total of 1,067,381 X-ray scans from publicly available GDXray and SIXray datasets.
  arXiv  Detail & Related papers  (2020-04-14T20:00:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.