Road Surface Condition Detection with Machine Learning using New York State Department of Transportation Camera Images and Weather Forecast Data

• URL: http://arxiv.org/abs/2510.06440v1
• Date: Tue, 07 Oct 2025 20:24:40 GMT
• Title: Road Surface Condition Detection with Machine Learning using New York State Department of Transportation Camera Images and Weather Forecast Data
• Authors: Carly Sutter, Kara J. Sulia, Nick P. Bassill, Christopher D. Wirz, Christopher D. Thorncroft, Jay C. Rothenberger, Vanessa Przybylo, Mariana G. Cains, Jacob Radford, David Aaron Evans,
• Abstract summary: The New York State Department of Transportation (NYSDOT) has a network of roadside traffic cameras that are used by both the NYSDOT and the public to observe road conditions.<n>NYSDOT evaluates road conditions by driving on roads and observing live cameras, tasks which are labor-intensive but necessary for making critical operational decisions during winter weather events.<n>In this study, convolutional neural networks and random forests are trained on camera images and weather data to predict road surface conditions.<n>Model generalizability is prioritized to meet the operational needs of the NYSDOT decision makers, and the weather-related road surface condition model in this study
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The New York State Department of Transportation (NYSDOT) has a network of roadside traffic cameras that are used by both the NYSDOT and the public to observe road conditions. The NYSDOT evaluates road conditions by driving on roads and observing live cameras, tasks which are labor-intensive but necessary for making critical operational decisions during winter weather events. However, machine learning models can provide additional support for the NYSDOT by automatically classifying current road conditions across the state. In this study, convolutional neural networks and random forests are trained on camera images and weather data to predict road surface conditions. Models are trained on a hand-labeled dataset of ~22,000 camera images, each classified by human labelers into one of six road surface conditions: severe snow, snow, wet, dry, poor visibility, or obstructed. Model generalizability is prioritized to meet the operational needs of the NYSDOT decision makers, and the weather-related road surface condition model in this study achieves an accuracy of 81.5% on completely unseen cameras.

Related papers

• AVOID: The Adverse Visual Conditions Dataset with Obstacles for Driving Scene Understanding [48.97660297411286]
  We introduce AVOID, a new dataset for real-time obstacle detection in a simulated environment.<n>AVOID consists of a large set of unexpected road obstacles located along each path captured under various weather and time conditions.<n>Each image is coupled with the corresponding semantic and depth maps, raw and semantic LiDAR data, and waypoints.
  arXiv  Detail & Related papers  (2025-12-29T05:34:26Z)
• Learning Traffic Anomalies from Generative Models on Real-Time Observations [49.1574468325115]
  We use the Spatiotemporal Generative Adversarial Network (STGAN) framework to capture complex spatial and temporal dependencies in traffic data.<n>We apply STGAN to real-time, minute-by-minute observations from 42 traffic cameras across Gothenburg, Sweden, collected over several months in 2020.<n>Our results demonstrate that the model effectively detects traffic anomalies with high precision and low false positive rates.
  arXiv  Detail & Related papers  (2025-02-03T14:23:23Z)
• Label Correction for Road Segmentation Using Road-side Cameras [0.44241702149260353]
  Existing roadside camera infrastructure is utilized for collecting road data in varying weather conditions automatically.<n>A novel semi-automatic annotation method for roadside cameras is proposed.<n>The proposed method is validated with roadside camera data collected from 927 cameras across Finland over 4 month time period during winter.
  arXiv  Detail & Related papers  (2025-02-03T11:52:23Z)
• Road Surface Friction Estimation for Winter Conditions Utilising General Visual Features [0.4972323953932129]
  This paper explores computer vision-based evaluation of road surface friction from roadside cameras. We propose a hybrid deep learning architecture, WCamNet, consisting of a pretrained visual transformer model and convolutional blocks.
  arXiv  Detail & Related papers  (2024-04-25T12:46:23Z)
• Lightweight Regression Model with Prediction Interval Estimation for Computer Vision-based Winter Road Surface Condition Monitoring [0.4972323953932129]
  This paper proposes a deep learning regression model, SIWNet, capable of estimating road surface friction properties from camera images. SIWNet extends state of the art by including an uncertainty estimation mechanism in the architecture. The model was trained and tested with the SeeingThroughFog dataset, which features corresponding road friction sensor readings and images from an instrumented vehicle.
  arXiv  Detail & Related papers  (2023-10-02T06:33:06Z)
• Street-View Image Generation from a Bird's-Eye View Layout [95.36869800896335]
  Bird's-Eye View (BEV) Perception has received increasing attention in recent years. Data-driven simulation for autonomous driving has been a focal point of recent research. We propose BEVGen, a conditional generative model that synthesizes realistic and spatially consistent surrounding images.
  arXiv  Detail & Related papers  (2023-01-11T18:39:34Z)
• Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving [104.32241082170044]
  We study a new task, safety-aware motion prediction with unseen vehicles for autonomous driving. Unlike the existing trajectory prediction task for seen vehicles, we aim at predicting an occupancy map. Our approach is the first one that can predict the existence of unseen vehicles in most cases.
  arXiv  Detail & Related papers  (2021-09-03T13:33:33Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• DSEC: A Stereo Event Camera Dataset for Driving Scenarios [55.79329250951028]
  This work presents the first high-resolution, large-scale stereo dataset with event cameras. The dataset contains 53 sequences collected by driving in a variety of illumination conditions. It provides ground truth disparity for the development and evaluation of event-based stereo algorithms.
  arXiv  Detail & Related papers  (2021-03-10T12:10:33Z)
• ZeroScatter: Domain Transfer for Long Distance Imaging and Vision through Scattering Media [26.401067775059154]
  We present ZeroScatter, a domain transfer method for converting RGB-only captures taken in adverse weather into clear daytime scenes. We assess the proposed method using real-world captures, and the proposed method outperforms existing monocular de-scattering approaches by 2.8 dB PSNR on controlled fog chamber measurements.
  arXiv  Detail & Related papers  (2021-02-11T04:41:17Z)
• Multimodal End-to-End Learning for Autonomous Steering in Adverse Road and Weather Conditions [0.0]
  We extend the previous work on end-to-end learning for autonomous steering to operate in adverse real-life conditions with multimodal data. We collected 28 hours of driving data in several road and weather conditions and trained convolutional neural networks to predict the car steering wheel angle.
  arXiv  Detail & Related papers  (2020-10-28T12:38:41Z)
• Design of Efficient Deep Learning models for Determining Road Surface Condition from Roadside Camera Images and Weather Data [2.8904578737516764]
  Road maintenance during the Winter season is a safety critical and resource demanding operation. One of its key activities is determining road surface condition (RSC) in order to prioritize roads and allocate cleaning efforts such as plowing or salting. Two conventional approaches for determining RSC are: visual examination of roadside camera images by trained personnel and patrolling the roads to perform on-site inspections.
  arXiv  Detail & Related papers  (2020-09-22T02:30:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.