End-to-End Vision-Based Adaptive Cruise Control (ACC) Using Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2001.09181v1
• Date: Fri, 24 Jan 2020 20:02:50 GMT
• Title: End-to-End Vision-Based Adaptive Cruise Control (ACC) Using Deep Reinforcement Learning
• Authors: Zhensong Wei, Yu Jiang, Xishun Liao, Xuewei Qi, Ziran Wang, Guoyuan Wu, Peng Hao, Matthew Barth
• Abstract summary: This paper presented a deep reinforcement learning method named Double Deep Q-networks to design an end-to-end vision-based adaptive cruise control (ACC) system. Well-designed reward functions associated with the following distance and throttle/brake force were implemented in the reinforcement learning model. The proposed system can be well adaptive to different speed trajectories of the preceding vehicle and operated in real-time.
• Score: 12.100265694989627
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presented a deep reinforcement learning method named Double Deep Q-networks to design an end-to-end vision-based adaptive cruise control (ACC) system. A simulation environment of a highway scene was set up in Unity, which is a game engine that provided both physical models of vehicles and feature data for training and testing. Well-designed reward functions associated with the following distance and throttle/brake force were implemented in the reinforcement learning model for both internal combustion engine (ICE) vehicles and electric vehicles (EV) to perform adaptive cruise control. The gap statistics and total energy consumption are evaluated for different vehicle types to explore the relationship between reward functions and powertrain characteristics. Compared with the traditional radar-based ACC systems or human-in-the-loop simulation, the proposed vision-based ACC system can generate either a better gap regulated trajectory or a smoother speed trajectory depending on the preset reward function. The proposed system can be well adaptive to different speed trajectories of the preceding vehicle and operated in real-time.

Related papers

• MetaFollower: Adaptable Personalized Autonomous Car Following [63.90050686330677]
  We propose an adaptable personalized car-following framework - MetaFollower. We first utilize Model-Agnostic Meta-Learning (MAML) to extract common driving knowledge from various CF events. We additionally combine Long Short-Term Memory (LSTM) and Intelligent Driver Model (IDM) to reflect temporal heterogeneity with high interpretability.
  arXiv  Detail & Related papers  (2024-06-23T15:30:40Z)
• EditFollower: Tunable Car Following Models for Customizable Adaptive Cruise Control Systems [28.263763430300504]
  We propose a data-driven car-following model that allows for adjusting driving discourtesy levels. Our model provides valuable insights for the development of ACC systems that take into account drivers' social preferences.
  arXiv  Detail & Related papers  (2024-06-23T15:04:07Z)
• LSTM-based Preceding Vehicle Behaviour Prediction during Aggressive Lane Change for ACC Application [4.693170687870612]
  We propose a Long Short-Term Memory (LSTM) based Adaptive Cruise Control (ACC) system. The model is constructed based on the real-world highD dataset, acquired from German highways with the assistance of camera-equipped drones. We show that the LSTM-based system is 19.25% more accurate than the ANN model and 5.9% more accurate than the MPC model in terms of predicting future values of subject vehicle acceleration.
  arXiv  Detail & Related papers  (2023-05-01T21:33:40Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• Tuning Path Tracking Controllers for Autonomous Cars Using Reinforcement Learning [0.0]
  This paper proposes an adaptable path tracking control system based on Reinforcement Learning (RL) for autonomous cars. The tuning of the tracker uses an educated Q-Learning algorithm to minimize the lateral and steering trajectory errors.
  arXiv  Detail & Related papers  (2023-01-09T14:17:12Z)
• Deep Learning-Based Vehicle Speed Prediction for Ecological Adaptive Cruise Control in Urban and Highway Scenarios [0.5161531917413706]
  In a typical car-following scenario, target vehicle speed fluctuations act as an external disturbance to the host vehicle and in turn affect its energy consumption. Deep recurrent neural network-based vehicle speed prediction using long-short term memory (LSTM) and gated recurrent units (GRU) is studied in this work. The proposed speed prediction models are evaluated for long-term predictions (up to 10 s) of target vehicle future velocities.
  arXiv  Detail & Related papers  (2022-11-30T22:50:43Z)
• Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds [100.61456258283245]
  This paper presents a multi-layer motion planning and control architecture for autonomous racing. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 $m/s2$.
  arXiv  Detail & Related papers  (2022-07-22T15:16:54Z)
• Tackling Real-World Autonomous Driving using Deep Reinforcement Learning [63.3756530844707]
  In this work, we propose a model-free Deep Reinforcement Learning Planner training a neural network that predicts acceleration and steering angle. In order to deploy the system on board the real self-driving car, we also develop a module represented by a tiny neural network.
  arXiv  Detail & Related papers  (2022-07-05T16:33:20Z)
• COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles [54.61668577827041]
  We introduce COOPERNAUT, an end-to-end learning model that uses cross-vehicle perception for vision-based cooperative driving. Our experiments on AutoCastSim suggest that our cooperative perception driving models lead to a 40% improvement in average success rate.
  arXiv  Detail & Related papers  (2022-05-04T17:55:12Z)
• Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learning [52.2663102239029]
  We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle on idle-hailing platforms. Our approach learns ride-based state-value function using a batch training algorithm with deep value. We benchmark our algorithm with baselines in a ride-hailing simulation environment to demonstrate its superiority in improving income efficiency.
  arXiv  Detail & Related papers  (2021-03-08T05:34:05Z)
• D-ACC: Dynamic Adaptive Cruise Control for Highways with Ramps Based on Deep Q-Learning [17.412117389855226]
  We propose a dynamic adaptive cruise control system (D-ACC) based on deep reinforcement learning. D-ACC improves the traffic flow by up to 70% compared with a state-of-the-art intelligent ACC system in a highway segment with a ramp.
  arXiv  Detail & Related papers  (2020-06-02T06:28:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.