Deep Learning Frameworks for Pavement Distress Classification: A
Comparative Analysis
- URL: http://arxiv.org/abs/2010.10681v2
- Date: Sun, 29 Nov 2020 19:57:06 GMT
- Title: Deep Learning Frameworks for Pavement Distress Classification: A
Comparative Analysis
- Authors: Vishal Mandal, Abdul Rashid Mussah, Yaw Adu-Gyamfi
- Abstract summary: This study deploys state-of-the-art deep learning algorithms to detect and characterize pavement distresses.
The models were trained using 21,041 images captured across urban and rural streets of Japan, Czech Republic and India.
The best performing model achieved an F1 score of 0.58 and 0.57 on two test datasets released by the IEEE Global Road Damage Detection Challenge.
- Score: 2.752817022620644
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic detection and classification of pavement distresses is critical in
timely maintaining and rehabilitating pavement surfaces. With the evolution of
deep learning and high performance computing, the feasibility of vision-based
pavement defect assessments has significantly improved. In this study, the
authors deploy state-of-the-art deep learning algorithms based on different
network backbones to detect and characterize pavement distresses. The influence
of different backbone models such as CSPDarknet53, Hourglass-104 and
EfficientNet were studied to evaluate their classification performance. The
models were trained using 21,041 images captured across urban and rural streets
of Japan, Czech Republic and India. Finally, the models were assessed based on
their ability to predict and classify distresses, and tested using F1 score
obtained from the statistical precision and recall values. The best performing
model achieved an F1 score of 0.58 and 0.57 on two test datasets released by
the IEEE Global Road Damage Detection Challenge. The source code including the
trained models are made available at [1].
Related papers
- Textile Anomaly Detection: Evaluation of the State-of-the-Art for Automated Quality Inspection of Carpet [0.0]
State-of-the-art unsupervised detection models were evaluated for the purpose of automated anomaly inspection of wool carpets.
A custom dataset of four unique types of carpet textures was created to thoroughly test the models.
The metrics of importance in this study were accuracy in detecting anomalous areas, the number of false detections, and the inference times of each model for real-time performance.
arXiv Detail & Related papers (2024-07-26T01:13:59Z) - Revisiting the Performance of Deep Learning-Based Vulnerability Detection on Realistic Datasets [4.385369356819613]
This paper introduces Real-Vul, a dataset representing real-world scenarios for evaluating vulnerability detection models.
evaluating DeepWukong, LineVul, ReVeal, and IVDetect shows a significant drop in performance, with precision decreasing by up to 95 percentage points and F1 scores by up to 91 points.
Overfitting is identified as a key issue, and an augmentation technique is proposed, potentially improving performance by up to 30%.
arXiv Detail & Related papers (2024-07-03T13:34:30Z) - The Languini Kitchen: Enabling Language Modelling Research at Different
Scales of Compute [66.84421705029624]
We introduce an experimental protocol that enables model comparisons based on equivalent compute, measured in accelerator hours.
We pre-process an existing large, diverse, and high-quality dataset of books that surpasses existing academic benchmarks in quality, diversity, and document length.
This work also provides two baseline models: a feed-forward model derived from the GPT-2 architecture and a recurrent model in the form of a novel LSTM with ten-fold throughput.
arXiv Detail & Related papers (2023-09-20T10:31:17Z) - A Comprehensive Evaluation and Analysis Study for Chinese Spelling Check [53.152011258252315]
We show that using phonetic and graphic information reasonably is effective for Chinese Spelling Check.
Models are sensitive to the error distribution of the test set, which reflects the shortcomings of models.
The commonly used benchmark, SIGHAN, can not reliably evaluate models' performance.
arXiv Detail & Related papers (2023-07-25T17:02:38Z) - Robustness and Generalization Performance of Deep Learning Models on
Cyber-Physical Systems: A Comparative Study [71.84852429039881]
Investigation focuses on the models' ability to handle a range of perturbations, such as sensor faults and noise.
We test the generalization and transfer learning capabilities of these models by exposing them to out-of-distribution (OOD) samples.
arXiv Detail & Related papers (2023-06-13T12:43:59Z) - CONVIQT: Contrastive Video Quality Estimator [63.749184706461826]
Perceptual video quality assessment (VQA) is an integral component of many streaming and video sharing platforms.
Here we consider the problem of learning perceptually relevant video quality representations in a self-supervised manner.
Our results indicate that compelling representations with perceptual bearing can be obtained using self-supervised learning.
arXiv Detail & Related papers (2022-06-29T15:22:01Z) - Collision Detection: An Improved Deep Learning Approach Using SENet and
ResNext [6.736699393205048]
In this article, a deep-learning-based model comprising of ResNext architecture with SENet blocks is proposed.
The proposed model outperforms the existing baseline models achieving a ROC-AUC of 0.91 using a significantly less proportion of the GTACrash synthetic data for training.
arXiv Detail & Related papers (2022-01-13T02:10:14Z) - Evaluation and Comparison of Deep Learning Methods for Pavement Crack
Identification with Visual Images [0.0]
pavement crack identification with visual images via deep learning algorithms has the advantages of not being limited by the material of object to be detected.
In the aspect of patch sample classification, the fine-tuned TL models can be equivalent to or even slightly better than the ED models in accuracy.
In the aspect of accurate crack location, both ED and GAN algorithms can achieve pixel-level segmentation and is expected to be detected in real time on low computing power platform.
arXiv Detail & Related papers (2021-12-20T08:23:43Z) - Anomaly Detection in Cybersecurity: Unsupervised, Graph-Based and
Supervised Learning Methods in Adversarial Environments [63.942632088208505]
Inherent to today's operating environment is the practice of adversarial machine learning.
In this work, we examine the feasibility of unsupervised learning and graph-based methods for anomaly detection.
We incorporate a realistic adversarial training mechanism when training our supervised models to enable strong classification performance in adversarial environments.
arXiv Detail & Related papers (2021-05-14T10:05:10Z) - Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring
Systems [64.4896118325552]
We evaluate the current state-of-the-art AES models using a model adversarial evaluation scheme and associated metrics.
We find that AES models are highly overstable. Even heavy modifications(as much as 25%) with content unrelated to the topic of the questions do not decrease the score produced by the models.
arXiv Detail & Related papers (2020-07-14T03:49:43Z) - Deep Machine Learning Approach to Develop a New Asphalt Pavement
Condition Index [0.0]
In recent years, advancement in deep learning has enabled researchers to develop robust tools for analyzing pavement images at unprecedented accuracies.
Deep learning models necessitate a big ground truth dataset, which is often not readily accessible for pavement field.
In this study, we reviewed our previous study, which a labeled pavement dataset was presented as the first step towards a more robust, easy-to-deploy pavement condition assessment system.
arXiv Detail & Related papers (2020-04-28T05:57:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.