A Lightweight NMS-free Framework for Real-time Visual Fault Detection
System of Freight Trains
- URL: http://arxiv.org/abs/2205.12458v1
- Date: Wed, 25 May 2022 03:07:48 GMT
- Title: A Lightweight NMS-free Framework for Real-time Visual Fault Detection
System of Freight Trains
- Authors: Guodong Sun, Yang Zhou, Huilin Pan, Bo Wu, Ye Hu, Yang Zhang
- Abstract summary: Real-time vision-based system of fault detection (RVBS-FD) for freight trains is an essential part of ensuring railway transportation safety.
Most existing vision-based methods still have high computational costs based on convolutional neural networks.
We propose a lightweight NMS-free framework to achieve real-time detection and high accuracy simultaneously.
- Score: 11.195801283133994
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Real-time vision-based system of fault detection (RVBS-FD) for freight trains
is an essential part of ensuring railway transportation safety. Most existing
vision-based methods still have high computational costs based on convolutional
neural networks. The computational cost is mainly reflected in the backbone,
neck, and post-processing, i.e., non-maximum suppression (NMS). In this paper,
we propose a lightweight NMS-free framework to achieve real-time detection and
high accuracy simultaneously. First, we use a lightweight backbone for feature
extraction and design a fault detection pyramid to process features. This fault
detection pyramid includes three novel individual modules using attention
mechanism, bottleneck, and dilated convolution for feature enhancement and
computation reduction. Instead of using NMS, we calculate different loss
functions, including classification and location costs in the detection head,
to further reduce computation. Experimental results show that our framework
achieves over 83 frames per second speed with a smaller model size and higher
accuracy than the state-of-the-art detectors. Meanwhile, the hardware resource
requirements of our method are low during the training and testing process.
Related papers
- DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection [42.07920565812081]
We propose a novel post-training weight pruning scheme for 3D object detection.
It determines redundant parameters in the pretrained model that lead to minimal distortion in both locality and confidence.
This framework aims to minimize detection distortion of network output to maximally maintain detection precision.
arXiv Detail & Related papers (2024-07-02T09:33:32Z) - Match and Locate: low-frequency monocular odometry based on deep feature
matching [0.65268245109828]
We introduce a novel approach for the robotic odometry which only requires a single camera.
The approach is based on matching image features between the consecutive frames of the video stream using deep feature matching models.
We evaluate the performance of the approach in the AISG-SLA Visual Localisation Challenge and find that while being computationally efficient and easy to implement our method shows competitive results.
arXiv Detail & Related papers (2023-11-16T17:32:58Z) - Visual Fault Detection of Multi-scale Key Components in Freight Trains [9.447245934910063]
This paper proposes a lightweight anchor-free framework for train fault detectors.
We introduce a lightweight backbone and adopt an anchor-free method for localization and regression.
Our framework achieves 98.44% accuracy while the model size is only 22.5 MB, outperforming state-of-the-art detectors.
arXiv Detail & Related papers (2022-11-26T09:20:49Z) - Efficient Decoder-free Object Detection with Transformers [75.00499377197475]
Vision transformers (ViTs) are changing the landscape of object detection approaches.
We propose a decoder-free fully transformer-based (DFFT) object detector.
DFFT_SMALL achieves high efficiency in both training and inference stages.
arXiv Detail & Related papers (2022-06-14T13:22:19Z) - Truncated tensor Schatten p-norm based approach for spatiotemporal
traffic data imputation with complicated missing patterns [77.34726150561087]
We introduce four complicated missing patterns, including missing and three fiber-like missing cases according to the mode-drivenn fibers.
Despite nonity of the objective function in our model, we derive the optimal solutions by integrating alternating data-mputation method of multipliers.
arXiv Detail & Related papers (2022-05-19T08:37:56Z) - SALISA: Saliency-based Input Sampling for Efficient Video Object
Detection [58.22508131162269]
We propose SALISA, a novel non-uniform SALiency-based Input SAmpling technique for video object detection.
We show that SALISA significantly improves the detection of small objects.
arXiv Detail & Related papers (2022-04-05T17:59:51Z) - Efficient and Robust LiDAR-Based End-to-End Navigation [132.52661670308606]
We present an efficient and robust LiDAR-based end-to-end navigation framework.
We propose Fast-LiDARNet that is based on sparse convolution kernel optimization and hardware-aware model design.
We then propose Hybrid Evidential Fusion that directly estimates the uncertainty of the prediction from only a single forward pass.
arXiv Detail & Related papers (2021-05-20T17:52:37Z) - Lite-FPN for Keypoint-based Monocular 3D Object Detection [18.03406686769539]
Keypoint-based monocular 3D object detection has made tremendous progress and achieved great speed-accuracy trade-off.
We propose a sort of lightweight feature pyramid network called Lite-FPN to achieve multi-scale feature fusion.
Our proposed method achieves significantly higher accuracy and frame rate at the same time.
arXiv Detail & Related papers (2021-05-01T14:44:31Z) - A Unified Light Framework for Real-time Fault Detection of Freight Train
Images [16.721758280029302]
Real-time fault detection for freight trains plays a vital role in guaranteeing the security and optimal operation of railway transportation.
Despite the promising results for deep learning based approaches, the performance of these fault detectors on freight train images are far from satisfactory in both accuracy and efficiency.
This paper proposes a unified light framework to improve detection accuracy while supporting a real-time operation with a low resource requirement.
arXiv Detail & Related papers (2021-01-31T05:10:20Z) - SADet: Learning An Efficient and Accurate Pedestrian Detector [68.66857832440897]
This paper proposes a series of systematic optimization strategies for the detection pipeline of one-stage detector.
It forms a single shot anchor-based detector (SADet) for efficient and accurate pedestrian detection.
Though structurally simple, it presents state-of-the-art result and real-time speed of $20$ FPS for VGA-resolution images.
arXiv Detail & Related papers (2020-07-26T12:32:38Z) - Adaptive Anomaly Detection for IoT Data in Hierarchical Edge Computing [71.86955275376604]
We propose an adaptive anomaly detection approach for hierarchical edge computing (HEC) systems to solve this problem.
We design an adaptive scheme to select one of the models based on the contextual information extracted from input data, to perform anomaly detection.
We evaluate our proposed approach using a real IoT dataset, and demonstrate that it reduces detection delay by 84% while maintaining almost the same accuracy as compared to offloading detection tasks to the cloud.
arXiv Detail & Related papers (2020-01-10T05:29:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.