A Game-Theoretic Framework for Joint Forecasting and Planning

• URL: http://arxiv.org/abs/2308.06137v2
• Date: Fri, 20 Oct 2023 03:40:56 GMT
• Title: A Game-Theoretic Framework for Joint Forecasting and Planning
• Authors: Kushal Kedia, Prithwish Dan, Sanjiban Choudhury
• Abstract summary: Planning safe robot motions in the presence of humans requires reliable forecasts of future human motion. We propose a novel game-theoretic framework for joint planning and forecasting with the payoff being the performance of the planner against the demonstrator. Our proposed algorithm results in safer plans in a crowd navigation simulator and real-world datasets of pedestrian motion.
• Score: 9.299721998201543
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Planning safe robot motions in the presence of humans requires reliable forecasts of future human motion. However, simply predicting the most likely motion from prior interactions does not guarantee safety. Such forecasts fail to model the long tail of possible events, which are rarely observed in limited datasets. On the other hand, planning for worst-case motions leads to overtly conservative behavior and a "frozen robot". Instead, we aim to learn forecasts that predict counterfactuals that humans guard against. We propose a novel game-theoretic framework for joint planning and forecasting with the payoff being the performance of the planner against the demonstrator, and present practical algorithms to train models in an end-to-end fashion. We demonstrate that our proposed algorithm results in safer plans in a crowd navigation simulator and real-world datasets of pedestrian motion. We release our code at https://github.com/portal-cornell/Game-Theoretic-Forecasting-Planning.

Related papers

• ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting [8.274511768083665]
  We present ManiCast, a novel framework that learns cost-aware human forecasts and feeds them to a model predictive control planner. Our framework enables fluid, real-time interactions between a human and a 7-DoF robot arm across a number of real-world tasks.
  arXiv  Detail & Related papers  (2023-10-20T03:34:31Z)
• Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving [68.95178518732965]
  A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
  arXiv  Detail & Related papers  (2023-08-02T23:39:24Z)
• Robust Forecasting for Robotic Control: A Game-Theoretic Approach [12.345619675058416]
  Current methods rely heavily on historical time series to accurately predict the future. We propose a novel framework for generating robust forecasts for robotic control. We show that our proposed game may be solved to a local Nash equilibrium using gradient-based optimization techniques.
  arXiv  Detail & Related papers  (2022-09-22T06:10:35Z)
• Are socially-aware trajectory prediction models really socially-aware? [75.36961426916639]
  We introduce a socially-attended attack to assess the social understanding of prediction models. An attack is a small yet carefully-crafted perturbations to fail predictors. We show that our attack can be employed to increase the social understanding of state-of-the-art models.
  arXiv  Detail & Related papers  (2021-08-24T17:59:09Z)
• Probabilistic Human Motion Prediction via A Bayesian Neural Network [71.16277790708529]
  We propose a probabilistic model for human motion prediction in this paper. Our model could generate several future motions when given an observed motion sequence. We extensively validate our approach on a large scale benchmark dataset Human3.6m.
  arXiv  Detail & Related papers  (2021-07-14T09:05:33Z)
• Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Models [82.34305824719101]
  Humans have a remarkable ability to make decisions by accurately reasoning about future events. We develop a general-purpose contingency planner that is learned end-to-end using high-dimensional scene observations. We show how this model can tractably learn contingencies from behavioral observations.
  arXiv  Detail & Related papers  (2021-04-21T14:30:20Z)
• Anticipatory Navigation in Crowds by Probabilistic Prediction of Pedestrian Future Movements [33.37913533544612]
  Process Anticipatory Navigation (SPAN) is a framework that enables nonholonomic robots to navigate in environments with crowds. SPAN predicts continuous-time processes to model future movement of pedestrians. We demonstrate the capability of SPAN in crowded simulation environments, as well as with a real-world pedestrian dataset.
  arXiv  Detail & Related papers  (2020-11-12T07:18:20Z)
• Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations [81.05412704590707]
  We propose a novel end-to-end learnable network that performs joint perception, prediction and motion planning for self-driving vehicles. Our network is learned end-to-end from human demonstrations.
  arXiv  Detail & Related papers  (2020-08-13T14:40:46Z)
• The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
  Roads have well defined geometries, topologies, and traffic rules. In this paper we propose to incorporate structured priors as a loss function. We demonstrate the effectiveness of our approach on real-world self-driving datasets.
  arXiv  Detail & Related papers  (2020-06-04T03:56:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.