Multi-Agent Routing Value Iteration Network
- URL: http://arxiv.org/abs/2007.05096v2
- Date: Fri, 14 Aug 2020 18:08:25 GMT
- Title: Multi-Agent Routing Value Iteration Network
- Authors: Quinlan Sykora, Mengye Ren, Raquel Urtasun
- Abstract summary: We propose a graph neural network based model that is able to perform multi-agent routing based on learned value in a sparsely connected graph.
We show that our model trained with only two agents on graphs with a maximum of 25 nodes can easily generalize to situations with more agents and/or nodes.
- Score: 88.38796921838203
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper we tackle the problem of routing multiple agents in a
coordinated manner. This is a complex problem that has a wide range of
applications in fleet management to achieve a common goal, such as mapping from
a swarm of robots and ride sharing. Traditional methods are typically not
designed for realistic environments hich contain sparsely connected graphs and
unknown traffic, and are often too slow in runtime to be practical. In
contrast, we propose a graph neural network based model that is able to perform
multi-agent routing based on learned value iteration in a sparsely connected
graph with dynamically changing traffic conditions. Moreover, our learned
communication module enables the agents to coordinate online and adapt to
changes more effectively. We created a simulated environment to mimic realistic
mapping performed by autonomous vehicles with unknown minimum edge coverage and
traffic conditions; our approach significantly outperforms traditional solvers
both in terms of total cost and runtime. We also show that our model trained
with only two agents on graphs with a maximum of 25 nodes can easily generalize
to situations with more agents and/or nodes.
Related papers
- Improving Traffic Flow Predictions with SGCN-LSTM: A Hybrid Model for Spatial and Temporal Dependencies [55.2480439325792]
This paper introduces the Signal-Enhanced Graph Convolutional Network Long Short Term Memory (SGCN-LSTM) model for predicting traffic speeds across road networks.
Experiments on the PEMS-BAY road network traffic dataset demonstrate the SGCN-LSTM model's effectiveness.
arXiv Detail & Related papers (2024-11-01T00:37:00Z) - Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs [19.107744041461316]
Traffic signal control systems (TSCSs) are integral to intelligent traffic management, fostering efficient vehicle flow.
Traditional approaches often simplify road networks into standard graphs.
We propose a novel TSCS framework to realize intelligent traffic control.
arXiv Detail & Related papers (2024-04-17T02:46:18Z) - Dynamic Graph Message Passing Networks for Visual Recognition [112.49513303433606]
Modelling long-range dependencies is critical for scene understanding tasks in computer vision.
A fully-connected graph is beneficial for such modelling, but its computational overhead is prohibitive.
We propose a dynamic graph message passing network, that significantly reduces the computational complexity.
arXiv Detail & Related papers (2022-09-20T14:41:37Z) - Feudal Multi-Agent Reinforcement Learning with Adaptive Network
Partition for Traffic Signal Control [44.09601435685123]
Multi-agent reinforcement learning (MARL) has been applied and shown great potential in traffic signal control.
Previous work partitions the traffic network into several regions and learns policies for agents in a feudal structure.
We propose a novel feudal MARL approach with adaptive network partition.
arXiv Detail & Related papers (2022-05-27T09:02:10Z) - End-to-End Intersection Handling using Multi-Agent Deep Reinforcement
Learning [63.56464608571663]
Navigating through intersections is one of the main challenging tasks for an autonomous vehicle.
In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided.
We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
arXiv Detail & Related papers (2021-04-28T07:54:40Z) - Autonomous Navigation through intersections with Graph
ConvolutionalNetworks and Conditional Imitation Learning for Self-driving
Cars [10.080958939027363]
In autonomous driving, navigation through unsignaled intersections is a challenging task.
We propose a novel branched network G-CIL for the navigation policy learning.
Our end-to-end trainable neural network outperforms the baselines with higher success rate and shorter navigation time.
arXiv Detail & Related papers (2021-02-01T07:33:12Z) - Multi-intersection Traffic Optimisation: A Benchmark Dataset and a
Strong Baseline [85.9210953301628]
Control of traffic signals is fundamental and critical to alleviate traffic congestion in urban areas.
Because of the high complexity of modelling the problem, experimental settings of current works are often inconsistent.
We propose a novel and strong baseline model based on deep reinforcement learning with the encoder-decoder structure.
arXiv Detail & Related papers (2021-01-24T03:55:39Z) - TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors [74.67698916175614]
We propose TrafficSim, a multi-agent behavior model for realistic traffic simulation.
In particular, we leverage an implicit latent variable model to parameterize a joint actor policy.
We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines.
arXiv Detail & Related papers (2021-01-17T00:29:30Z) - Optimizing Large-Scale Fleet Management on a Road Network using
Multi-Agent Deep Reinforcement Learning with Graph Neural Network [0.8702432681310401]
We propose a novel approach to optimize fleet management by combining multi-agent reinforcement learning with graph neural network.
We design a realistic simulator that emulates the empirical taxi call data, and confirm the effectiveness of the proposed model under various conditions.
arXiv Detail & Related papers (2020-11-12T03:01:37Z) - IG-RL: Inductive Graph Reinforcement Learning for Massive-Scale Traffic
Signal Control [4.273991039651846]
Scaling adaptive traffic-signal control involves dealing with state and action spaces.
We introduce Inductive Graph Reinforcement Learning (IG-RL) based on graph-convolutional networks.
Our model can generalize to new road networks, traffic distributions, and traffic regimes.
arXiv Detail & Related papers (2020-03-06T17:17:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.