Cascaded Structure Tensor Framework for Robust Identification of Heavily
Occluded Baggage Items from X-ray Scans
- URL: http://arxiv.org/abs/2004.06780v1
- Date: Tue, 14 Apr 2020 20:00:55 GMT
- Title: Cascaded Structure Tensor Framework for Robust Identification of Heavily
Occluded Baggage Items from X-ray Scans
- Authors: Taimur Hassan, Samet Akcay, Mohammed Bennamoun, Salman Khan, Naoufel
Werghi
- Abstract summary: This paper presents a cascaded structure tensor framework that can automatically extract and recognize suspicious items in heavily occluded and cluttered baggage.
The proposed framework has been rigorously evaluated using a total of 1,067,381 X-ray scans from publicly available GDXray and SIXray datasets.
- Score: 45.39173572825739
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the last two decades, baggage scanning has globally become one of the
prime aviation security concerns. Manual screening of the baggage items is
tedious, error-prone, and compromise privacy. Hence, many researchers have
developed X-ray imagery-based autonomous systems to address these shortcomings.
This paper presents a cascaded structure tensor framework that can
automatically extract and recognize suspicious items in heavily occluded and
cluttered baggage. The proposed framework is unique, as it intelligently
extracts each object by iteratively picking contour-based transitional
information from different orientations and uses only a single feed-forward
convolutional neural network for the recognition. The proposed framework has
been rigorously evaluated using a total of 1,067,381 X-ray scans from publicly
available GDXray and SIXray datasets where it outperformed the state-of-the-art
solutions by achieving the mean average precision score of 0.9343 on GDXray and
0.9595 on SIXray for recognizing the highly cluttered and overlapping
suspicious items. Furthermore, the proposed framework computationally achieves
4.76\% superior run-time performance as compared to the existing solutions
based on publicly available object detectors
Related papers
- SARDet-100K: Towards Open-Source Benchmark and ToolKit for Large-Scale SAR Object Detection [79.23689506129733]
We establish a new benchmark dataset and an open-source method for large-scale SAR object detection.
Our dataset, SARDet-100K, is a result of intense surveying, collecting, and standardizing 10 existing SAR detection datasets.
To the best of our knowledge, SARDet-100K is the first COCO-level large-scale multi-class SAR object detection dataset ever created.
arXiv Detail & Related papers (2024-03-11T09:20:40Z) - Temporal Fusion Based Mutli-scale Semantic Segmentation for Detecting
Concealed Baggage Threats [12.895636885728852]
No framework exists that utilizes temporal baggage X-ray imagery to effectively screen highly concealed objects.
We present a novel temporal fusion driven multi-scale residual fashioned encoder-decoder that takes series of consecutive scans as input.
The proposed framework outperforms its competitors on the GDXray dataset on various metrics.
arXiv Detail & Related papers (2021-11-04T06:19:52Z) - Tensor Pooling Driven Instance Segmentation Framework for Baggage Threat
Recognition [39.40595024569702]
We propose a novel multi-scale contour instance segmentation framework to identify cluttered contraband data in baggage X-ray scans.
The proposed framework is rigorously validated on three public datasets, dubbed GDXray, SIXray, and OPIXray.
To the best of our knowledge, this is the first contour instance segmentation framework that leverages multi-scale information to recognize cluttered and concealed contraband data.
arXiv Detail & Related papers (2021-08-22T00:04:58Z) - Towards Real-World Prohibited Item Detection: A Large-Scale X-ray
Benchmark [53.9819155669618]
This paper presents a large-scale dataset, named as PIDray, which covers various cases in real-world scenarios for prohibited item detection.
With an intensive amount of effort, our dataset contains $12$ categories of prohibited items in $47,677$ X-ray images with high-quality annotated segmentation masks and bounding boxes.
The proposed method performs favorably against the state-of-the-art methods, especially for detecting the deliberately hidden items.
arXiv Detail & Related papers (2021-08-16T11:14:16Z) - Unsupervised Anomaly Instance Segmentation for Baggage Threat
Recognition [39.40595024569702]
This paper presents a novel unsupervised anomaly instance segmentation framework that recognizes baggage threats, in X-ray scans, as anomalies without requiring any ground truth labels.
Thanks to its stylization capacity, the framework is trained only once, and at the inference stage, it detects and extracts contraband items regardless of their scanner specifications.
A thorough evaluation of the proposed system on four public baggage X-ray datasets, without any re-training, demonstrates that it achieves competitive performance.
arXiv Detail & Related papers (2021-07-15T13:56:55Z) - Over-sampling De-occlusion Attention Network for Prohibited Items
Detection in Noisy X-ray Images [35.35752470993847]
Security inspection is X-ray scanning for personal belongings in suitcases.
Traditional CNN-based models trained through common image recognition datasets fail to achieve satisfactory performance in this scenario.
We propose an over-sampling de-occlusion attention network (DOAM-O), which consists of a novel de-occlusion attention module and a new over-sampling training strategy.
arXiv Detail & Related papers (2021-03-01T07:17:37Z) - Trainable Structure Tensors for Autonomous Baggage Threat Detection
Under Extreme Occlusion [45.39173572825739]
This paper presents a novel instance segmentation framework that utilizes trainable structure tensors to highlight the contours of the occluded and cluttered contraband items.
It is the only framework that has been validated on combined grayscale and colored scans obtained from four different types of X-ray scanners.
arXiv Detail & Related papers (2020-09-28T09:12:10Z) - Occluded Prohibited Items Detection: an X-ray Security Inspection
Benchmark and De-occlusion Attention Module [50.75589128518707]
We contribute the first high-quality object detection dataset for security inspection, named OPIXray.
OPIXray focused on the widely-occurred prohibited item "cutter", annotated manually by professional inspectors from the international airport.
We propose the De-occlusion Attention Module (DOAM), a plug-and-play module that can be easily inserted into and thus promote most popular detectors.
arXiv Detail & Related papers (2020-04-18T16:10:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.