Dueling Deep Q Network for Highway Decision Making in Autonomous
Vehicles: A Case Study
- URL: http://arxiv.org/abs/2007.08343v1
- Date: Thu, 16 Jul 2020 14:09:20 GMT
- Title: Dueling Deep Q Network for Highway Decision Making in Autonomous
Vehicles: A Case Study
- Authors: Teng Liu, Xingyu Mu, Xiaolin Tang, Bing Huang, Hong Wang, Dongpu Cao
- Abstract summary: This work optimize the highway decision making strategy of autonomous vehicles by using deep reinforcement learning (DRL)
The overtaking decision-making problem of the automated vehicle is formulated as an optimal control problem.
Simulation results reveal that the ego vehicle could safely and efficiently accomplish the driving task after learning and training.
- Score: 9.602219035367066
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This work optimizes the highway decision making strategy of autonomous
vehicles by using deep reinforcement learning (DRL). First, the highway driving
environment is built, wherein the ego vehicle, surrounding vehicles, and road
lanes are included. Then, the overtaking decision-making problem of the
automated vehicle is formulated as an optimal control problem. Then relevant
control actions, state variables, and optimization objectives are elaborated.
Finally, the deep Q-network is applied to derive the intelligent driving
policies for the ego vehicle. Simulation results reveal that the ego vehicle
could safely and efficiently accomplish the driving task after learning and
training.
Related papers
- Exploring the Causality of End-to-End Autonomous Driving [57.631400236930375]
We propose a comprehensive approach to explore and analyze the causality of end-to-end autonomous driving.
Our work is the first to unveil the mystery of end-to-end autonomous driving and turn the black box into a white one.
arXiv Detail & Related papers (2024-07-09T04:56:11Z) - Work-in-Progress: Crash Course: Can (Under Attack) Autonomous Driving Beat Human Drivers? [60.51287814584477]
This paper evaluates the inherent risks in autonomous driving by examining the current landscape of AVs.
We develop specific claims highlighting the delicate balance between the advantages of AVs and potential security challenges in real-world scenarios.
arXiv Detail & Related papers (2024-05-14T09:42:21Z) - Comprehensive Training and Evaluation on Deep Reinforcement Learning for
Automated Driving in Various Simulated Driving Maneuvers [0.4241054493737716]
This study implements, evaluating, and comparing the two DRL algorithms, Deep Q-networks (DQN) and Trust Region Policy Optimization (TRPO)
Models trained on the designed ComplexRoads environment can adapt well to other driving maneuvers with promising overall performance.
arXiv Detail & Related papers (2023-06-20T11:41:01Z) - Deep Q-Network Based Decision Making for Autonomous Driving [1.0152838128195467]
This paper introduces a method for safely navigating an autonomous vehicle in highway scenarios by combining deep Q-Networks and insight from control theory.
A Deep Q-Network is trained in simulation to serve as a central decision-making unit by proposing targets for a trajectory planner.
The generated trajectories in combination with a controller for longitudinal movement are used to execute lane change maneuvers.
arXiv Detail & Related papers (2023-03-21T07:01:22Z) - Tackling Real-World Autonomous Driving using Deep Reinforcement Learning [63.3756530844707]
In this work, we propose a model-free Deep Reinforcement Learning Planner training a neural network that predicts acceleration and steering angle.
In order to deploy the system on board the real self-driving car, we also develop a module represented by a tiny neural network.
arXiv Detail & Related papers (2022-07-05T16:33:20Z) - An Intelligent Self-driving Truck System For Highway Transportation [81.12838700312308]
In this paper, we introduce an intelligent self-driving truck system.
Our presented system consists of three main components, 1) a realistic traffic simulation module for generating realistic traffic flow in testing scenarios, 2) a high-fidelity truck model which is designed and evaluated for mimicking real truck response in real-world deployment.
We also deploy our proposed system on a real truck and conduct real world experiments which shows our system's capacity of mitigating sim-to-real gap.
arXiv Detail & Related papers (2021-12-31T04:54:13Z) - A Software Architecture for Autonomous Vehicles: Team LRM-B Entry in the
First CARLA Autonomous Driving Challenge [49.976633450740145]
This paper presents the architecture design for the navigation of an autonomous vehicle in a simulated urban environment.
Our architecture was made towards meeting the requirements of CARLA Autonomous Driving Challenge.
arXiv Detail & Related papers (2020-10-23T18:07:48Z) - Driving Tasks Transfer in Deep Reinforcement Learning for
Decision-making of Autonomous Vehicles [6.578495322360851]
This paper constructs a transfer deep reinforcement learning framework to transform the driving tasks in inter-section environments.
The goal of the autonomous ego vehicle (AEV) is to drive through the intersection situation efficiently and safely.
Decision-making strategies related to similar tasks are transferable.
arXiv Detail & Related papers (2020-09-07T17:34:01Z) - Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement
Learning with Continuous Action Horizon [14.059728921828938]
This paper utilizes the deep reinforcement learning (DRL) method to address the continuous-horizon decision-making problem on the highway.
The running objective of the ego automated vehicle is to execute an efficient and smooth policy without collision.
The PPO-DRL-based decision-making strategy is estimated from multiple perspectives, including the optimality, learning efficiency, and adaptability.
arXiv Detail & Related papers (2020-08-26T22:49:27Z) - Decision-making Strategy on Highway for Autonomous Vehicles using Deep
Reinforcement Learning [6.298084785377199]
A deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the overtaking behaviors on the highway.
A hierarchical control framework is presented to control these vehicles, which indicates the upper-level manages the driving decisions.
The DDQN-based overtaking policy could accomplish highway driving tasks efficiently and safely.
arXiv Detail & Related papers (2020-07-16T23:41:48Z) - Intelligent Roundabout Insertion using Deep Reinforcement Learning [68.8204255655161]
We present a maneuver planning module able to negotiate the entering in busy roundabouts.
The proposed module is based on a neural network trained to predict when and how entering the roundabout throughout the whole duration of the maneuver.
arXiv Detail & Related papers (2020-01-03T11:16:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.