Good Data Is All Imitation Learning Needs

• URL: http://arxiv.org/abs/2409.17605v1
• Date: Thu, 26 Sep 2024 07:43:12 GMT
• Title: Good Data Is All Imitation Learning Needs
• Authors: Amir Samadi, Konstantinos Koufos, Kurt Debattista, and Mehrdad Dianati
• Abstract summary: We introduce the use of Counterfactual Explanations (CFEs) as a novel data augmentation technique for end-to-end automated driving systems. CFEs, by generating training samples near decision boundaries, lead to a more comprehensive representation of expert driver strategies. Our experiments in the CARLA simulator demonstrate that CF-Driver outperforms the current state-of-the-art method.
• Score: 13.26174103650211
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we address the limitations of traditional teacher-student models, imitation learning, and behaviour cloning in the context of Autonomous/Automated Driving Systems (ADS), where these methods often struggle with incomplete coverage of real-world scenarios. To enhance the robustness of such models, we introduce the use of Counterfactual Explanations (CFEs) as a novel data augmentation technique for end-to-end ADS. CFEs, by generating training samples near decision boundaries through minimal input modifications, lead to a more comprehensive representation of expert driver strategies, particularly in safety-critical scenarios. This approach can therefore help improve the model's ability to handle rare and challenging driving events, such as anticipating darting out pedestrians, ultimately leading to safer and more trustworthy decision-making for ADS. Our experiments in the CARLA simulator demonstrate that CF-Driver outperforms the current state-of-the-art method, achieving a higher driving score and lower infraction rates. Specifically, CF-Driver attains a driving score of 84.2, surpassing the previous best model by 15.02 percentage points. These results highlight the effectiveness of incorporating CFEs in training end-to-end ADS. To foster further research, the CF-Driver code is made publicly available.

Related papers

• MetaFollower: Adaptable Personalized Autonomous Car Following [63.90050686330677]
  We propose an adaptable personalized car-following framework - MetaFollower. We first utilize Model-Agnostic Meta-Learning (MAML) to extract common driving knowledge from various CF events. We additionally combine Long Short-Term Memory (LSTM) and Intelligent Driver Model (IDM) to reflect temporal heterogeneity with high interpretability.
  arXiv  Detail & Related papers  (2024-06-23T15:30:40Z)
• RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality [51.244807332133696]
  This paper introduces RACER, a cutting-edge deep learning car-following model to predict Adaptive Cruise Control (ACC) driving behavior. Unlike conventional models, RACER effectively integrates Rational Driving Constraints (RDCs), crucial tenets of actual driving. RACER excels across key metrics, such as acceleration, velocity, and spacing, registering zero violations.
  arXiv  Detail & Related papers  (2023-12-12T06:21:30Z)
• CAT: Closed-loop Adversarial Training for Safe End-to-End Driving [54.60865656161679]
  Adversarial Training (CAT) is a framework for safe end-to-end driving in autonomous vehicles. Cat aims to continuously improve the safety of driving agents by training the agent on safety-critical scenarios. Cat can effectively generate adversarial scenarios countering the agent being trained.
  arXiv  Detail & Related papers  (2023-10-19T02:49:31Z)
• Continual Driving Policy Optimization with Closed-Loop Individualized Curricula [2.903150959383393]
  We develop a continuous driving policy optimization framework featuring Closed-Loop Individualized Curricula (CLIC) CLIC frames AV Evaluation as a collision prediction task, where it estimates the chance of AV failures in these scenarios at each iteration. We show that CLIC surpasses other curriculum-based training strategies, showing substantial improvement in managing risky scenarios.
  arXiv  Detail & Related papers  (2023-09-25T15:14:54Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• survAIval: Survival Analysis with the Eyes of AI [0.6445605125467573]
  We propose a novel approach to enrich the training data for automated driving by using a self-designed driving simulator and two human drivers. Our results show that incorporating these corner cases during training improves the recognition of corner cases during testing.
  arXiv  Detail & Related papers  (2023-05-23T15:20:31Z)
• Learning from Demonstrations of Critical Driving Behaviours Using Driver's Risk Field [4.272601420525791]
  imitation learning (IL) has been widely used in industry as the core of autonomous vehicle (AV) planning modules. Previous IL works show sample inefficiency and low generalisation in safety-critical scenarios, on which they are rarely tested. We present an IL model using the spline coefficient parameterisation and offline expert queries to enhance safety and training efficiency.
  arXiv  Detail & Related papers  (2022-10-04T17:07:35Z)
• On the Choice of Data for Efficient Training and Validation of End-to-End Driving Models [32.381828309166195]
  We investigate the influence of several data design choices regarding training and validation of deep driving models trainable in an end-to-end fashion. We show by correlation analysis, which validation design enables the driving performance measured during validation to generalize to unknown test environments.
  arXiv  Detail & Related papers  (2022-06-01T16:25:28Z)
• UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planning [1.1339580074756188]
  Offline reinforcement learning (RL) provides a framework for learning decision-making from offline data. Self-driving vehicles (SDV) learn a policy, which potentially even outperforms the behavior in the sub-optimal data set. This motivates the use of model-based offline RL approaches, which leverage planning.
  arXiv  Detail & Related papers  (2021-11-22T10:37:52Z)
• Bayesian Optimization and Deep Learning forsteering wheel angle prediction [58.720142291102135]
  This work aims to obtain an accurate model for the prediction of the steering angle in an automated driving system. BO was able to identify, within a limited number of trials, a model -- namely BOST-LSTM -- which resulted, the most accurate when compared to classical end-to-end driving models.
  arXiv  Detail & Related papers  (2021-10-22T15:25:14Z)
• Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction [71.97877759413272]
  Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions. Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many. Our work addresses two key challenges in trajectory prediction, learning outputs, and better predictions by imposing constraints using driving knowledge.
  arXiv  Detail & Related papers  (2021-04-16T17:58:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.