Stochastic Future Prediction in Real World Driving Scenarios
- URL: http://arxiv.org/abs/2209.10693v1
- Date: Wed, 21 Sep 2022 22:34:31 GMT
- Title: Stochastic Future Prediction in Real World Driving Scenarios
- Authors: Adil Kaan Akan
- Abstract summary: A future prediction method should cover the whole possibilities to be robust.
In autonomous driving, covering multiple modes in the prediction part is crucially important to make safety-critical decisions.
We propose solutions by modeling the motion explicitly in a way and learning the temporal dynamics in a latent space.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Uncertainty plays a key role in future prediction. The future is uncertain.
That means there might be many possible futures. A future prediction method
should cover the whole possibilities to be robust. In autonomous driving,
covering multiple modes in the prediction part is crucially important to make
safety-critical decisions. Although computer vision systems have advanced
tremendously in recent years, future prediction remains difficult today.
Several examples are uncertainty of the future, the requirement of full scene
understanding, and the noisy outputs space. In this thesis, we propose
solutions to these challenges by modeling the motion explicitly in a stochastic
way and learning the temporal dynamics in a latent space.
Related papers
- Existence Is Chaos: Enhancing 3D Human Motion Prediction with Uncertainty Consideration [27.28184416632815]
We argue that the recorded motion in training data could be an observation of possible future, rather than a predetermined result.
A novel computationally efficient encoder-decoder model with uncertainty consideration is proposed.
arXiv Detail & Related papers (2024-03-21T03:34:18Z) - Learning Future Object Prediction with a Spatiotemporal Detection
Transformer [1.1543275835002982]
We train a detection transformer to directly output future objects.
We extend existing transformers in two ways to capture scene dynamics.
Our final approach learns to capture the dynamics and make predictions on par with an oracle for 100 ms prediction horizons.
arXiv Detail & Related papers (2022-04-21T17:58:36Z) - A-ACT: Action Anticipation through Cycle Transformations [89.83027919085289]
We take a step back to analyze how the human capability to anticipate the future can be transferred to machine learning algorithms.
A recent study on human psychology explains that, in anticipating an occurrence, the human brain counts on both systems.
In this work, we study the impact of each system for the task of action anticipation and introduce a paradigm to integrate them in a learning framework.
arXiv Detail & Related papers (2022-04-02T21:50:45Z) - StretchBEV: Stretching Future Instance Prediction Spatially and
Temporally [0.0]
In self-driving cars, predicting future in terms of location and motion of all the agents around the vehicle is a crucial requirement for planning.
Recently, a new joint formulation of perception and prediction has emerged by fusing rich sensory information perceived from multiple cameras into a compact bird's-eye view representation to perform prediction.
However, the quality of future predictions degrades over time while extending to longer time horizons due to multiple plausible predictions.
In this work, we address this inherent uncertainty in future predictions with a temporal model.
arXiv Detail & Related papers (2022-03-25T13:28:44Z) - Safety-aware Motion Prediction with Unseen Vehicles for Autonomous
Driving [104.32241082170044]
We study a new task, safety-aware motion prediction with unseen vehicles for autonomous driving.
Unlike the existing trajectory prediction task for seen vehicles, we aim at predicting an occupancy map.
Our approach is the first one that can predict the existence of unseen vehicles in most cases.
arXiv Detail & Related papers (2021-09-03T13:33:33Z) - Policy Gradients Incorporating the Future [66.20567145291342]
We introduce a method that allows an agent to "look into the future" without explicitly predicting it.
We propose to allow an agent, during its training on past experience, to observe what emphactually happened in the future at that time.
This gives our agent the opportunity to utilize rich and useful information about the future trajectory dynamics in addition to the present.
arXiv Detail & Related papers (2021-08-04T14:57:11Z) - LookOut: Diverse Multi-Future Prediction and Planning for Self-Driving [139.33800431159446]
LookOut is an approach to jointly perceive the environment and predict a diverse set of futures from sensor data.
We show that our model demonstrates significantly more diverse and sample-efficient motion forecasting in a large-scale self-driving dataset.
arXiv Detail & Related papers (2021-01-16T23:19:22Z) - Long Term Motion Prediction Using Keyposes [122.22758311506588]
We argue that, to achieve long term forecasting, predicting human pose at every time instant is unnecessary.
We call such poses "keyposes", and approximate complex motions by linearly interpolating between subsequent keyposes.
We show that learning the sequence of such keyposes allows us to predict very long term motion, up to 5 seconds in the future.
arXiv Detail & Related papers (2020-12-08T20:45:51Z) - Multimodal semantic forecasting based on conditional generation of
future features [0.0]
This paper considers semantic forecasting in road-driving scenes.
Most existing approaches address this problem as deterministic regression of future features or future predictions given observed frames.
We propose to formulate multimodal forecasting as sampling of a multimodal generative model conditioned on the observed frames.
arXiv Detail & Related papers (2020-10-18T18:59:52Z) - The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
Roads have well defined geometries, topologies, and traffic rules.
In this paper we propose to incorporate structured priors as a loss function.
We demonstrate the effectiveness of our approach on real-world self-driving datasets.
arXiv Detail & Related papers (2020-06-04T03:56:11Z) - Probabilistic Future Prediction for Video Scene Understanding [11.236856606065514]
We present a novel deep learning architecture for probabilistic future prediction from video.
We predict the future semantics, motion of complex real-world urban scenes and use this representation to control an autonomous vehicle.
arXiv Detail & Related papers (2020-03-13T17:48:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.