Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review
- URL: http://arxiv.org/abs/2203.10939v1
- Date: Mon, 7 Mar 2022 17:21:07 GMT
- Title: Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review
- Authors: Abolfazl Razi, Xiwen Chen, Huayu Li, Brendan Russo, Yan Chen, Hongbin
Yu
- Abstract summary: We present a typical processing pipeline, which can be used to understand and interpret traffic videos.
This processing framework includes several steps, including video enhancement, video stabilization, semantic and incident segmentation, object detection and classification, trajectory extraction, speed estimation, event analysis, modeling and anomaly detection.
- Score: 4.228522109021283
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper explores Deep Learning (DL) methods that are used or have the
potential to be used for traffic video analysis, emphasizing driving safety for
both Autonomous Vehicles (AVs) and human-operated vehicles. We present a
typical processing pipeline, which can be used to understand and interpret
traffic videos by extracting operational safety metrics and providing general
hints and guidelines to improve traffic safety. This processing framework
includes several steps, including video enhancement, video stabilization,
semantic and incident segmentation, object detection and classification,
trajectory extraction, speed estimation, event analysis, modeling and anomaly
detection. Our main goal is to guide traffic analysts to develop their own
custom-built processing frameworks by selecting the best choices for each step
and offering new designs for the lacking modules by providing a comparative
analysis of the most successful conventional and DL-based algorithms proposed
for each step. We also review existing open-source tools and public datasets
that can help train DL models. To be more specific, we review exemplary traffic
problems and mentioned requires steps for each problem. Besides, we investigate
connections to the closely related research areas of drivers' cognition
evaluation, Crowd-sourcing-based monitoring systems, Edge Computing in roadside
infrastructures, ADS-equipped AVs, and highlight the missing gaps. Finally, we
review commercial implementations of traffic monitoring systems, their future
outlook, and open problems and remaining challenges for widespread use of such
systems.
Related papers
- Generic Multi-modal Representation Learning for Network Traffic Analysis [6.372999570085887]
Network traffic analysis is fundamental for network management, troubleshooting, and security.
We propose a flexible Multi-modal Autoencoder (MAE) pipeline that can solve different use cases.
We argue that the MAE architecture is generic and can be used to learn representations useful in multiple scenarios.
arXiv Detail & Related papers (2024-05-04T12:24:29Z) - A Holistic Framework Towards Vision-based Traffic Signal Control with
Microscopic Simulation [53.39174966020085]
Traffic signal control (TSC) is crucial for reducing traffic congestion that leads to smoother traffic flow, reduced idling time, and mitigated CO2 emissions.
In this study, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation.
We introduce a holistic traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmarking.
arXiv Detail & Related papers (2024-03-11T16:42:29Z) - AccidentGPT: Large Multi-Modal Foundation Model for Traffic Accident
Analysis [3.8763079966791523]
AccidentGPT is a foundation model of traffic accident analysis.
It incorporates multi-modal input data to automatically reconstruct the accident process video with dynamics details.
arXiv Detail & Related papers (2024-01-05T19:33:21Z) - An Explainable Ensemble-based Intrusion Detection System for Software-Defined Vehicle Ad-hoc Networks [0.0]
In this study, we explore the detection of cyber threats in vehicle networks through ensemble-based machine learning.
We propose a model that uses Random Forest and CatBoost as our main investigators, with Logistic Regression used to then reason on their outputs to make a final decision.
We observe that our approach improves classification accuracy, and results in fewer misclassifications compared to previous works.
arXiv Detail & Related papers (2023-12-08T10:39:18Z) - A Study of Situational Reasoning for Traffic Understanding [63.45021731775964]
We devise three novel text-based tasks for situational reasoning in the traffic domain.
We adopt four knowledge-enhanced methods that have shown generalization capability across language reasoning tasks in prior work.
We provide in-depth analyses of model performance on data partitions and examine model predictions categorically.
arXiv Detail & Related papers (2023-06-05T01:01:12Z) - Advances and Applications of Computer Vision Techniques in Vehicle
Trajectory Generation and Surrogate Traffic Safety Indicators [0.0]
This paper reviews the applications of Computer Vision (CV) techniques in traffic safety modeling using Surrogate Safety Measures (SSM)
The CV algorithm that are used for vehicle detection and tracking from early approaches to the state-of-the-art models are summarized.
A review of SSMs for vehicle trajectory data along with their application on traffic safety analysis is presented.
arXiv Detail & Related papers (2023-03-27T14:13:02Z) - Federated Deep Learning Meets Autonomous Vehicle Perception: Design and
Verification [168.67190934250868]
Federated learning empowered connected autonomous vehicle (FLCAV) has been proposed.
FLCAV preserves privacy while reducing communication and annotation costs.
It is challenging to determine the network resources and road sensor poses for multi-stage training.
arXiv Detail & Related papers (2022-06-03T23:55:45Z) - Towards formalization and monitoring of microscopic traffic parameters
using temporal logic [1.3706331473063877]
We develop specification-based monitoring for the analysis of traffic networks using the formal language Signal Temporal Logic.
We develop monitors that identify safety-related behavior such as conforming to speed limits and maintaining appropriate headway.
This work can be utilized by traffic management centers to study the traffic stream properties, identify possible hazards, and provide valuable feedback for automating the traffic monitoring systems.
arXiv Detail & Related papers (2021-10-12T17:59:26Z) - A First Look at Class Incremental Learning in Deep Learning Mobile
Traffic Classification [68.11005070665364]
We explore Incremental Learning (IL) techniques to add new classes to models without a full retraining, hence speeding up model's updates cycle.
We consider iCarl, a state of the art IL method, and MIRAGE-2019, a public dataset with traffic from 40 Android apps.
Despite our analysis reveals their infancy, IL techniques are a promising research area on the roadmap towards automated DL-based traffic analysis systems.
arXiv Detail & Related papers (2021-07-09T14:28:16Z) - End-to-End Intersection Handling using Multi-Agent Deep Reinforcement
Learning [63.56464608571663]
Navigating through intersections is one of the main challenging tasks for an autonomous vehicle.
In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided.
We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
arXiv Detail & Related papers (2021-04-28T07:54:40Z) - Fine-Grained Vehicle Perception via 3D Part-Guided Visual Data
Augmentation [77.60050239225086]
We propose an effective training data generation process by fitting a 3D car model with dynamic parts to vehicles in real images.
Our approach is fully automatic without any human interaction.
We present a multi-task network for VUS parsing and a multi-stream network for VHI parsing.
arXiv Detail & Related papers (2020-12-15T03:03:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.