Pixel-Level Pavement Distress Assessment Using Instance Segmentation

• URL: http://arxiv.org/abs/2605.26095v1
• Date: Mon, 25 May 2026 17:53:23 GMT
• Title: Pixel-Level Pavement Distress Assessment Using Instance Segmentation
• Abstract summary: This paper presents a vision-based pavement distress analysis system based on Mask R-CNN instance segmentation.<n>The best-performing model achieved 84.23% precision, 90.04% recall, and an F1 score of 87.04% under the project-specific bounding-box matching protocol.<n>The results show that instance segmentation is a practical direction for field pavement imagery and aggregate crack-area estimation.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automated pavement distress assessment requires more than image-level classification or coarse bounding box detection, demanding precise localization of thin, branching, and irregular cracks to achieve the geometric precision necessary for maintenance-relevant quantification. This paper presents a vision-based pavement distress analysis system based on Mask R-CNN instance segmentation and evaluates it on UWGB-StreetCrack, a custom field-collected roadway image dataset acquired with a vehicle-mounted smartphone and manually annotated with polygon labels for longitudinal cracks, transverse cracks, alligator cracks, and potholes. Five Detectron2-based Mask R-CNN backbone variants were considered under a consistent fine-tuning protocol. The best-performing model, Mask R-CNN with a ResNet-101 FPN backbone, achieved 84.23% precision, 90.04% recall, and an F1 score of 87.04% under the project-specific bounding-box matching protocol. The same model produced an aggregate predicted crack-area fraction of 2.164%, closely matching the 2.170% ground-truth crack-area fraction. To contextualize the segmentation system against a detector-oriented alternative, a CSPDarknet53-based YOLO detector was also adapted and retrained on the dataset, reaching 27.5% precision and 20.7% recall on the validation protocol. The results show that instance segmentation is a practical direction for field pavement imagery and aggregate crack-area estimation, while also exposing open challenges in annotation consistency, class imbalance, confounder rejection, and mask-level benchmarking.

Related papers

• An End-to-End Automated Pipeline for Controllable Crack Data Synthesis [16.848359184857912]
  Vision-based crack inspection depends on segmentation networks whose reliability depends on the quantity, diversity and label quality of their training data.<n>This paper presents an end-to-end pipeline that produces labelled crack data without manual annotation and assesses the reliability of these data and of the detectors trained on them.
  arXiv  Detail & Related papers  (2026-09-11T04:40:01Z)
• Automated Borehole Core Analysis with Report-Derived Weak Labels and Supervised Crack Segmentation [16.6279494287779]
  Borehole archives commonly contain core tray photographs and corresponding digital log reports, but no native pixel-level crack annotations.<n>We investigate two complementary approaches for extracting defect-spacing information from these archives.<n>We manually annotate 5,087 extracted core-row images and evaluate fully supervised crack-segmentation models.
  arXiv  Detail & Related papers  (2026-08-12T16:51:52Z)
• GeoAI-based post-segmentation quality validation of building footprints via spatial feature engineering [1.3277276618043652]
  Deep learning-based building footprint extraction often produces top inconsistent vectors for direct GIS database ingestion.<n>We present a multidomain GeoAI quality control framework that automates error detection to purify vector footprint databases.<n>This framework successfully identified 87.34% of erroneous footprints while maintaining 98.31% of acceptable structures.
  arXiv  Detail & Related papers  (2026-08-10T02:55:07Z)
• Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction [55.11480729304395]
  We describe our PointArena 2026 solution, which achieves 77.2% overall accuracy and ranks second on the benchmark.<n>The ap proach targets three failure modes. First, agent-driven syn thesis builds large semantic and anchor-relative candidate pools.<n>Second, a determinis tic steerable-data pipeline creates a verified 10,000-sample main set, plus reserve samples, using masks, templates, and path verification.
  arXiv  Detail & Related papers  (2026-06-29T06:39:03Z)
• A Modelling and Evaluation Framework for EuroCrops-Driven Sentinel-2 Crop Segmentation [78.66324246922831]
  This work presents a pipeline for generating semantic-segmentation-ready agricultural datasets from Sentinel-2 imagery and EuroCrops parcel-level annotations.<n>The dataset contains 67,337 patches from five European countries and uses a reduced taxonomy of ten crop classes plus background.<n>A four-level U-Net with Group Normalization was trained using 10 Sentinel-2 spectral bands and a composite loss combining class-weighted cross-entropy and Dice loss.
  arXiv  Detail & Related papers  (2026-05-30T11:20:29Z)
• Towards Realistic Open-Vocabulary Remote Sensing Segmentation: Benchmark and Baseline [52.65099689153431]
  Open-vocabulary remote sensing image segmentation (OVRSIS) remains underexplored due to fragmented datasets, limited training diversity, and the lack of evaluation benchmarks.<n>We propose textitOVRSISBenchV2, a large-scale and application-oriented benchmark for OVRSIS.<n>Our results highlight the importance of realistic benchmark design and the effectiveness of perturbation-based transfer for OVRSIS.
  arXiv  Detail & Related papers  (2026-04-17T02:49:46Z)
• Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructure [52.2025114590481]
  We introduce Hybrid-Segmentor, an encoder-decoder based approach that is capable of extracting both fine-grained local and global crack features. This allows the model to improve its generalization capabilities in distinguish various type of shapes, surfaces and sizes of cracks. The proposed model outperforms existing benchmark models across 5 quantitative metrics (accuracy 0.971, precision 0.804, recall 0.744, F1-score 0.770, and IoU score 0.630), achieving state-of-the-art status.
  arXiv  Detail & Related papers  (2024-09-04T16:47:16Z)
• Structural damage detection via hierarchical damage information with volumetric assessment [1.4470320778878742]
  Structural health monitoring (SHM) is essential for ensuring the safety and longevity of infrastructure.<n>This study introduces the Guided Detection Network (Guided-DetNet), a framework designed to address these challenges.<n>Guided-DetNet is characterized by a Generative Attention Module (GAM), Hierarchical Elimination Algorithm (HEA), and Volumetric Contour Visual Assessment (VCVA)
  arXiv  Detail & Related papers  (2024-07-29T04:33:04Z)
• A quality assurance framework for real-time monitoring of deep learning segmentation models in radiotherapy [3.5752677591512487]
  This work uses cardiac substructure segmentation as an example task to establish a quality assurance framework. A benchmark dataset consisting of Computed Tomography (CT) images along with manual cardiac delineations of 241 patients was collected. An image domain shift detector was developed by utilizing a trained Denoising autoencoder (DAE) and two hand-engineered features. A regression model was trained to predict the per-patient segmentation accuracy, measured by Dice similarity coefficient (DSC)
  arXiv  Detail & Related papers  (2023-05-19T14:51:05Z)
• Dual flow fusion model for concrete surface crack segmentation [0.0]
  Cracks and other damages pose a significant threat to the safe operation of transportation infrastructure. Deep learning models have been widely applied to practical visual segmentation tasks. This paper proposes a crack segmentation model based on the fusion of dual streams.
  arXiv  Detail & Related papers  (2023-05-09T02:35:58Z)
• ISTR: End-to-End Instance Segmentation with Transformers [147.14073165997846]
  We propose an instance segmentation Transformer, termed ISTR, which is the first end-to-end framework of its kind. ISTR predicts low-dimensional mask embeddings, and matches them with ground truth mask embeddings for the set loss. Benefiting from the proposed end-to-end mechanism, ISTR demonstrates state-of-the-art performance even with approximation-based suboptimal embeddings.
  arXiv  Detail & Related papers  (2021-05-03T06:00:09Z)
• Hierarchical Convolutional Neural Network with Feature Preservation and Autotuned Thresholding for Crack Detection [5.735035463793008]
  Drone imagery is increasingly used in automated inspection for infrastructure surface defects. This paper proposes a deep learning approach using hierarchical convolutional neural networks with feature preservation. The proposed technique is then applied to identify surface cracks on the surface of roads, bridges or pavements.
  arXiv  Detail & Related papers  (2021-04-21T13:07:58Z)
• Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
  This paper explores a relatively less-studied methodology based on classification. We propose new techniques to push its frontier in two aspects. Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
  arXiv  Detail & Related papers  (2020-11-19T05:42:02Z)
• A New Mask R-CNN Based Method for Improved Landslide Detection [54.7905160534631]
  This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout. A data set of 160 elements is created containing landslide and non-landslide images. The proposed algorithm can be potentially useful for land use planners and policy makers of hilly areas.
  arXiv  Detail & Related papers  (2020-10-04T07:46:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.