Robust Forecasting for Robotic Control: A Game-Theoretic Approach

• URL: http://arxiv.org/abs/2209.10802v3
• Date: Wed, 5 Apr 2023 01:22:09 GMT
• Title: Robust Forecasting for Robotic Control: A Game-Theoretic Approach
• Authors: Shubhankar Agarwal, David Fridovich-Keil, Sandeep P. Chinchali
• Abstract summary: Current methods rely heavily on historical time series to accurately predict the future. We propose a novel framework for generating robust forecasts for robotic control. We show that our proposed game may be solved to a local Nash equilibrium using gradient-based optimization techniques.
• Score: 12.345619675058416
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Modern robots require accurate forecasts to make optimal decisions in the real world. For example, self-driving cars need an accurate forecast of other agents' future actions to plan safe trajectories. Current methods rely heavily on historical time series to accurately predict the future. However, relying entirely on the observed history is problematic since it could be corrupted by noise, have outliers, or not completely represent all possible outcomes. To solve this problem, we propose a novel framework for generating robust forecasts for robotic control. In order to model real-world factors affecting future forecasts, we introduce the notion of an adversary, which perturbs observed historical time series to increase a robot's ultimate control cost. Specifically, we model this interaction as a zero-sum two-player game between a robot's forecaster and this hypothetical adversary. We show that our proposed game may be solved to a local Nash equilibrium using gradient-based optimization techniques. Furthermore, we show that a forecaster trained with our method performs 30.14% better on out-of-distribution real-world lane change data than baselines.

Related papers

• JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds [79.00975648564483]
  Trajectory forecasting models, employed in fields such as robotics, autonomous vehicles, and navigation, face challenges in real-world scenarios. This dataset provides comprehensive data, including the locations of all agents, scene images, and point clouds, all from the robot's perspective. The objective is to predict the future positions of agents relative to the robot using raw sensory input data.
  arXiv  Detail & Related papers  (2023-11-05T18:59:31Z)
• ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting [8.274511768083665]
  We present ManiCast, a novel framework that learns cost-aware human forecasts and feeds them to a model predictive control planner. Our framework enables fluid, real-time interactions between a human and a 7-DoF robot arm across a number of real-world tasks.
  arXiv  Detail & Related papers  (2023-10-20T03:34:31Z)
• A Game-Theoretic Framework for Joint Forecasting and Planning [9.299721998201543]
  Planning safe robot motions in the presence of humans requires reliable forecasts of future human motion. We propose a novel game-theoretic framework for joint planning and forecasting with the payoff being the performance of the planner against the demonstrator. Our proposed algorithm results in safer plans in a crowd navigation simulator and real-world datasets of pedestrian motion.
  arXiv  Detail & Related papers  (2023-08-11T13:56:39Z)
• AdvDO: Realistic Adversarial Attacks for Trajectory Prediction [87.96767885419423]
  Trajectory prediction is essential for autonomous vehicles to plan correct and safe driving behaviors. We devise an optimization-based adversarial attack framework to generate realistic adversarial trajectories. Our attack can lead an AV to drive off road or collide into other vehicles in simulation.
  arXiv  Detail & Related papers  (2022-09-19T03:34:59Z)
• PreTR: Spatio-Temporal Non-Autoregressive Trajectory Prediction Transformer [0.9786690381850356]
  We introduce a model called PRediction Transformer (PReTR) that extracts features from the multi-agent scenes by employing a factorized-temporal attention module. It shows less computational needs than previously studied models with empirically better results. We leverage encoder-decoder Transformer networks for parallel decoding a set of learned object queries.
  arXiv  Detail & Related papers  (2022-03-17T12:52:23Z)
• Are socially-aware trajectory prediction models really socially-aware? [75.36961426916639]
  We introduce a socially-attended attack to assess the social understanding of prediction models. An attack is a small yet carefully-crafted perturbations to fail predictors. We show that our attack can be employed to increase the social understanding of state-of-the-art models.
  arXiv  Detail & Related papers  (2021-08-24T17:59:09Z)
• Probabilistic Human Motion Prediction via A Bayesian Neural Network [71.16277790708529]
  We propose a probabilistic model for human motion prediction in this paper. Our model could generate several future motions when given an observed motion sequence. We extensively validate our approach on a large scale benchmark dataset Human3.6m.
  arXiv  Detail & Related papers  (2021-07-14T09:05:33Z)
• Future Frame Prediction for Robot-assisted Surgery [57.18185972461453]
  We propose a ternary prior guided variational autoencoder (TPG-VAE) model for future frame prediction in robotic surgical video sequences. Besides content distribution, our model learns motion distribution, which is novel to handle the small movements of surgical tools.
  arXiv  Detail & Related papers  (2021-03-18T15:12:06Z)
• Multimodal semantic forecasting based on conditional generation of future features [0.0]
  This paper considers semantic forecasting in road-driving scenes. Most existing approaches address this problem as deterministic regression of future features or future predictions given observed frames. We propose to formulate multimodal forecasting as sampling of a multimodal generative model conditioned on the observed frames.
  arXiv  Detail & Related papers  (2020-10-18T18:59:52Z)
• The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
  Roads have well defined geometries, topologies, and traffic rules. In this paper we propose to incorporate structured priors as a loss function. We demonstrate the effectiveness of our approach on real-world self-driving datasets.
  arXiv  Detail & Related papers  (2020-06-04T03:56:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.