On Salience-Sensitive Sign Classification in Autonomous Vehicle Path
Planning: Experimental Explorations with a Novel Dataset
- URL: http://arxiv.org/abs/2112.00942v1
- Date: Thu, 2 Dec 2021 02:45:30 GMT
- Title: On Salience-Sensitive Sign Classification in Autonomous Vehicle Path
Planning: Experimental Explorations with a Novel Dataset
- Authors: Ross Greer, Jason Isa, Nachiket Deo, Akshay Rangesh, Mohan M. Trivedi
- Abstract summary: We present a dataset with a novel feature, sign salience, defined to indicate whether a sign is distinctly informative to the goals of the ego vehicle.
Using convolutional networks on cropped signs, in tandem with experimental augmentation by road type, image coordinates, and planned maneuver, we predict the sign salience property with 76% accuracy.
- Score: 11.007092387379076
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Safe path planning in autonomous driving is a complex task due to the
interplay of static scene elements and uncertain surrounding agents. While all
static scene elements are a source of information, there is asymmetric
importance to the information available to the ego vehicle. We present a
dataset with a novel feature, sign salience, defined to indicate whether a sign
is distinctly informative to the goals of the ego vehicle with regards to
traffic regulations. Using convolutional networks on cropped signs, in tandem
with experimental augmentation by road type, image coordinates, and planned
maneuver, we predict the sign salience property with 76% accuracy, finding the
best improvement using information on vehicle maneuver with sign images.
Related papers
- Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment.
Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field.
We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
arXiv Detail & Related papers (2024-10-10T10:10:03Z) - Real-Time Traffic Sign Detection: A Case Study in a Santa Clara Suburban
Neighborhood [2.4087090457198435]
The project's primary objectives are to train the YOLOv5 model on a diverse dataset of traffic sign images and deploy the model on a suitable hardware platform.
The performance of the deployed system will be evaluated based on its accuracy in detecting traffic signs, real-time processing speed, and overall reliability.
arXiv Detail & Related papers (2023-10-14T17:52:28Z) - Semantic Map Learning of Traffic Light to Lane Assignment based on
Motion Data [12.853720506838043]
Autonomous vehicles commonly rely on High Definition (HD) maps that contain information about the assignment of traffic lights to lanes.
To remedy these issues, our novel approach derives the assignments from traffic light states and the corresponding motion patterns of vehicle traffic.
Our publicly available API for the Lyft Level 5 dataset enables researchers to develop and evaluate their own approaches.
arXiv Detail & Related papers (2023-09-26T09:42:21Z) - Pedestrian Environment Model for Automated Driving [54.16257759472116]
We propose an environment model that includes the position of the pedestrians as well as their pose information.
We extract the skeletal information with a neural network human pose estimator from the image.
To obtain the 3D information of the position, we aggregate the data from consecutive frames in conjunction with the vehicle position.
arXiv Detail & Related papers (2023-08-17T16:10:58Z) - OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping [84.65114565766596]
We present OpenLane-V2, the first dataset on topology reasoning for traffic scene structure.
OpenLane-V2 consists of 2,000 annotated road scenes that describe traffic elements and their correlation to the lanes.
We evaluate various state-of-the-art methods, and present their quantitative and qualitative results on OpenLane-V2 to indicate future avenues for investigating topology reasoning in traffic scenes.
arXiv Detail & Related papers (2023-04-20T16:31:22Z) - Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over
Full Visual Context [2.799896314754614]
Various traffic signs in a driving scene have an unequal impact on the driver's decisions.
We construct a traffic sign detection model which emphasizes performance on salient signs.
We show that a model trained with Salience-Sensitive Focal Loss outperforms a model trained without.
arXiv Detail & Related papers (2023-01-14T01:47:09Z) - Street-View Image Generation from a Bird's-Eye View Layout [95.36869800896335]
Bird's-Eye View (BEV) Perception has received increasing attention in recent years.
Data-driven simulation for autonomous driving has been a focal point of recent research.
We propose BEVGen, a conditional generative model that synthesizes realistic and spatially consistent surrounding images.
arXiv Detail & Related papers (2023-01-11T18:39:34Z) - Structured Bird's-Eye-View Traffic Scene Understanding from Onboard
Images [128.881857704338]
We study the problem of extracting a directed graph representing the local road network in BEV coordinates, from a single onboard camera image.
We show that the method can be extended to detect dynamic objects on the BEV plane.
We validate our approach against powerful baselines and show that our network achieves superior performance.
arXiv Detail & Related papers (2021-10-05T12:40:33Z) - RAIST: Learning Risk Aware Traffic Interactions via Spatio-Temporal
Graph Convolutional Networks [19.582873794287632]
A key aspect of driving a road vehicle is to interact with other road users, assess their intentions and make risk-aware tactical decisions.
We propose a novel driving framework for egocentric views based on traffic graphs.
We claim that our framework learns risk-aware representations by improving on the task of risk object identification.
arXiv Detail & Related papers (2020-11-17T15:49:22Z) - Implicit Latent Variable Model for Scene-Consistent Motion Forecasting [78.74510891099395]
In this paper, we aim to learn scene-consistent motion forecasts of complex urban traffic directly from sensor data.
We model the scene as an interaction graph and employ powerful graph neural networks to learn a distributed latent representation of the scene.
arXiv Detail & Related papers (2020-07-23T14:31:25Z) - Towards Accurate Vehicle Behaviour Classification With Multi-Relational
Graph Convolutional Networks [22.022759283770377]
We propose a pipeline for understanding vehicle behaviour from a monocular image sequence or video.
A temporal sequence of such encodings is fed to a recurrent network to label vehicle behaviours.
The proposed framework can classify a variety of vehicle behaviours to high fidelity on datasets that are diverse.
arXiv Detail & Related papers (2020-02-03T14:34:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.