Enhanced Behavioral Cloning with Environmental Losses for Self-Driving Vehicles

• URL: http://arxiv.org/abs/2202.09271v1
• Date: Fri, 4 Feb 2022 10:27:10 GMT
• Title: Enhanced Behavioral Cloning with Environmental Losses for Self-Driving Vehicles
• Authors: Nelson Fernandez Pinto and Thomas Gilles
• Abstract summary: Recent works on behavioral cloning show that simple imitation of expert observations is not sufficient to handle complex driving scenarios. This paper proposes a set of loss functions, namely Social loss and Road loss, which account for modelling risky social interactions in path planning. We validated this approach on a large-scale urban driving dataset.
• Score: 1.468677167874397
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Learned path planners have attracted research interest due to their ability to model human driving behavior and rapid inference. Recent works on behavioral cloning show that simple imitation of expert observations is not sufficient to handle complex driving scenarios. Besides, predictions that land outside drivable areas can lead to potentially dangerous situations. This paper proposes a set of loss functions, namely Social loss and Road loss, which account for modelling risky social interactions in path planning. These losses act as a repulsive scalar field that surrounds non-drivable areas. Predictions that land near these regions incur in a higher training cost, which is minimized using backpropagation. This methodology provides additional environment feedback to the traditional supervised learning set up. We validated this approach on a large-scale urban driving dataset. The results show the agent learns to imitate human driving while exhibiting better safety metrics. Furthermore, the proposed methodology has positive effects on inference without the need to artificially generate unsafe driving examples. The explanability study suggests that the benefits obtained are associated with a higher relevance of non-drivable areas in the agent's decisions compared to classical behavioral cloning.

Related papers

• Traffic and Safety Rule Compliance of Humans in Diverse Driving Situations [48.924085579865334]
  Analyzing human data is crucial for developing autonomous systems that replicate safe driving practices. This paper presents a comparative evaluation of human compliance with traffic and safety rules across multiple trajectory prediction datasets.
  arXiv  Detail & Related papers  (2024-11-04T09:21:00Z)
• Masked EEG Modeling for Driving Intention Prediction [27.606175591082756]
  This paper pioneers a novel research direction in BCI-assisted driving, studying the neural patterns related to driving intentions. We propose a novel Masked EEG Modeling framework for predicting human driving intentions, including the intention for left turning, right turning, and straight proceeding. Our model attains an accuracy of 85.19% when predicting driving intentions for drowsy subjects, which shows its promising potential for mitigating traffic accidents related to drowsy driving.
  arXiv  Detail & Related papers  (2024-08-08T03:49:05Z)
• Variable-Agnostic Causal Exploration for Reinforcement Learning [56.52768265734155]
  We introduce a novel framework, Variable-Agnostic Causal Exploration for Reinforcement Learning (VACERL) Our approach automatically identifies crucial observation-action steps associated with key variables using attention mechanisms. It constructs the causal graph connecting these steps, which guides the agent towards observation-action pairs with greater causal influence on task completion.
  arXiv  Detail & Related papers  (2024-07-17T09:45:27Z)
• Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space [3.487370856323828]
  This work introduces an integrated prediction and planning approach that incorporates the uncertainties of predicted pedestrian states in the training of a model-free DRL algorithm. A novel reward function encourages the AV to respect pedestrians' personal space, decrease speed during close approaches, and minimize the collision probability with their predicted paths. Results show a 40% decrease in collision rate and a 15% increase in minimum distance to pedestrians compared to the state of the art model that does not account for prediction uncertainty.
  arXiv  Detail & Related papers  (2024-05-22T20:09:21Z)
• Interpretable Goal-Based model for Vehicle Trajectory Prediction in Interactive Scenarios [4.1665957033942105]
  Social interaction between a vehicle and its surroundings is critical for road safety in autonomous driving. We propose a neural network-based model for the task of vehicle trajectory prediction in an interactive environment. We implement and evaluate our model using the INTERACTION dataset and demonstrate the effectiveness of our proposed architecture.
  arXiv  Detail & Related papers  (2023-08-08T15:00:12Z)
• Simulation-Based Counterfactual Causal Discovery on Real World Driver Behaviour [6.273003557777915]
  We present three variants of the proposed counterfactual causal discovery method. We evaluate these against state of the art observational temporal causal discovery methods across 3396 causal scenes extracted from a real world driving dataset.
  arXiv  Detail & Related papers  (2023-06-06T02:10:20Z)
• Studying the Impact of Semi-Cooperative Drivers on Overall Highway Flow [76.38515853201116]
  Semi-cooperative behaviors are intrinsic properties of human drivers and should be considered for autonomous driving. New autonomous planners can consider the social value orientation (SVO) of human drivers to generate socially-compliant trajectories. We present study of implicit semi-cooperative driving where agents deploy a game-theoretic version of iterative best response.
  arXiv  Detail & Related papers  (2023-04-23T16:01:36Z)
• Behavioral Intention Prediction in Driving Scenes: A Survey [70.53285924851767]
  Behavioral Intention Prediction (BIP) simulates a human consideration process and fulfills the early prediction of specific behaviors. This work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications.
  arXiv  Detail & Related papers  (2022-11-01T11:07:37Z)
• Mathematical Models of Human Drivers Using Artificial Risk Fields [8.074019565026544]
  We use the concept of artificial risk fields to predict how human operators control a vehicle in response to upcoming road situations. We observe that the risk fields are excellent at predicting future trajectory with high prediction accuracy for up to twenty seconds prediction horizons.
  arXiv  Detail & Related papers  (2022-05-24T15:39:01Z)
• Deep Structured Reactive Planning [94.92994828905984]
  We propose a novel data-driven, reactive planning objective for self-driving vehicles. We show that our model outperforms a non-reactive variant in successfully completing highly complex maneuvers.
  arXiv  Detail & Related papers  (2021-01-18T01:43:36Z)
• The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
  Roads have well defined geometries, topologies, and traffic rules. In this paper we propose to incorporate structured priors as a loss function. We demonstrate the effectiveness of our approach on real-world self-driving datasets.
  arXiv  Detail & Related papers  (2020-06-04T03:56:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.