TrajFlow: A Generative Framework for Occupancy Density Estimation Using Normalizing Flows
- URL: http://arxiv.org/abs/2501.14266v2
- Date: Sat, 02 Aug 2025 14:43:48 GMT
- Title: TrajFlow: A Generative Framework for Occupancy Density Estimation Using Normalizing Flows
- Authors: Mitch Kosieradzki, Seongjin Choi,
- Abstract summary: We propose a generative framework for estimating the occupancy density of dynamic agents.<n>Our framework utilizes a causal encoder to extract semantically meaningful embeddings of the observed trajectory.<n>We present a novel architecture based entirely on neural differential equations as an implementation of this framework.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: For intelligent transportation systems and autonomous vehicles to operate safely and efficiently, they must reliably predict the future motion and trajectory of surrounding agents within complex traffic environments. At the same time, the motion of these agents is inherently uncertain, making accurate prediction difficult. In this paper, we propose \textbf{TrajFlow}, a generative framework for estimating the occupancy density of dynamic agents. Our framework utilizes a causal encoder to extract semantically meaningful embeddings of the observed trajectory, as well as a normalizing flow to decode these embeddings and determine the most likely future location of an agent at some time point in the future. Our formulation differs from existing approaches because we model the marginal distribution of spatial locations instead of the joint distribution of unobserved trajectories. The advantages of a marginal formulation are numerous. First, we demonstrate that the marginal formulation produces higher accuracy on challenging trajectory forecasting benchmarks. Second, the marginal formulation allows for fully continuous sampling of future locations. Finally, marginal densities are better suited for downstream tasks as they allow for the computation of per-agent motion trajectories and occupancy grids, the two most commonly used representations for motion forecasting. We present a novel architecture based entirely on neural differential equations as an implementation of this framework and provide ablations to demonstrate the advantages of a continuous implementation over a more traditional discrete neural network based approach. The code is available at https://github.com/UMN-Choi-Lab/TrajFlow.
Related papers
- Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics [34.570579623171476]
"First Reasoning, Then Forecasting" is a strategy that explicitly incorporates behavior intentions as spatial guidance for trajectory prediction.<n>We introduce an interpretable, reward-driven intention reasoner grounded in a novel query-centric Inverse Reinforcement Learning scheme.<n>Our approach significantly enhances trajectory prediction confidence, achieving highly competitive performance relative to state-of-the-art methods.
arXiv Detail & Related papers (2025-07-16T09:46:17Z) - TrajFlow: Multi-modal Motion Prediction via Flow Matching [29.274577509291973]
We introduce TrajFlow, a novel flow matching-based motion prediction framework.<n>TrajFlow predicts multiple plausible future trajectories in a single pass, significantly reducing computational overhead.<n>It achieves state-of-the-art performance across various key metrics, underscoring its effectiveness for safety-critical autonomous driving applications.
arXiv Detail & Related papers (2025-06-10T08:08:31Z) - Fine-Grained Behavior and Lane Constraints Guided Trajectory Prediction Method [3.303114252531234]
We present BLNet, a novel dualstream architecture that integrates behavioral intention recognition and lane constraint modeling.
Our network exhibits significant performance gains over existing direct regression and goal-based algorithms.
arXiv Detail & Related papers (2025-03-27T13:06:57Z) - OPUS: Occupancy Prediction Using a Sparse Set [64.60854562502523]
We present a framework to simultaneously predict occupied locations and classes using a set of learnable queries.
OPUS incorporates a suite of non-trivial strategies to enhance model performance.
Our lightest model achieves superior RayIoU on the Occ3D-nuScenes dataset at near 2x FPS, while our heaviest model surpasses previous best results by 6.1 RayIoU.
arXiv Detail & Related papers (2024-09-14T07:44:22Z) - Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models.
Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML)
We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
arXiv Detail & Related papers (2024-07-18T15:44:23Z) - Streaming Motion Forecasting for Autonomous Driving [71.7468645504988]
We introduce a benchmark that queries future trajectories on streaming data and we refer to it as "streaming forecasting"
Our benchmark inherently captures the disappearance and re-appearance of agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks.
We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster.
arXiv Detail & Related papers (2023-10-02T17:13:16Z) - Implicit Occupancy Flow Fields for Perception and Prediction in
Self-Driving [68.95178518732965]
A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants.
Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene.
This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
arXiv Detail & Related papers (2023-08-02T23:39:24Z) - Likely, Light, and Accurate Context-Free Clusters-based Trajectory
Prediction [0.0]
We introduce a new deep feature clustering method, underlying self-conditioned GAN, which copes better with distribution shifts than traditional methods.
We also propose novel distance-based ranking proposals to assign probabilities to the generated trajectories.
The overall system surpasses context-free deep generative models in human and road agents trajectory data.
arXiv Detail & Related papers (2023-07-27T11:29:57Z) - Motion Transformer with Global Intention Localization and Local Movement
Refinement [103.75625476231401]
Motion TRansformer (MTR) models motion prediction as the joint optimization of global intention localization and local movement refinement.
MTR achieves state-of-the-art performance on both the marginal and joint motion prediction challenges.
arXiv Detail & Related papers (2022-09-27T16:23:14Z) - Exploring Attention GAN for Vehicle Motion Prediction [2.887073662645855]
We study the influence of attention in generative models for motion prediction, considering both physical and social context.
We validate our method using the Argoverse Motion Forecasting Benchmark 1.1, achieving competitive unimodal results.
arXiv Detail & Related papers (2022-09-26T13:18:32Z) - VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow
Prediction [18.277777620073685]
We propose a novel occupancy flow fields predictor to produce accurate occupancy and flow predictions.
Our model ranks 3rd place on the Open dataset Occupancy and Flow Prediction Challenge, and achieves the best performance in the occluded occupancy and flow prediction task.
arXiv Detail & Related papers (2022-08-09T03:49:04Z) - Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion [88.45326906116165]
We present a new framework to formulate the trajectory prediction task as a reverse process of motion indeterminacy diffusion (MID)
We encode the history behavior information and the social interactions as a state embedding and devise a Transformer-based diffusion model to capture the temporal dependencies of trajectories.
Experiments on the human trajectory prediction benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the superiority of our method.
arXiv Detail & Related papers (2022-03-25T16:59:08Z) - Occupancy Flow Fields for Motion Forecasting in Autonomous Driving [36.64394937525725]
We propose Occupancy Flow Fields, a new representation for motion forecasting of multiple agents.
Our representation is a-temporal grid with each grid cell containing both the probability magnitude of the cell being occupied by any agent, and a two-dimensional flow vector representing the direction of the motion in that cell.
We report experimental results on a large in-house autonomous driving dataset and the INTERACTION dataset, and show that our model outperforms state-of-the-art models.
arXiv Detail & Related papers (2022-03-08T06:26:50Z) - Probabilistic Trajectory Prediction with Structural Constraints [38.90152893402733]
This work addresses the problem of predicting the motion trajectories of dynamic objects in the environment.
Recent advances in predicting motion patterns often rely on machine learning techniques to extrapolate motion patterns from observed trajectories.
We propose a novel framework, which combines probabilistic learning and constrained trajectory optimisation.
arXiv Detail & Related papers (2021-07-09T03:48:14Z) - Implicit Latent Variable Model for Scene-Consistent Motion Forecasting [78.74510891099395]
In this paper, we aim to learn scene-consistent motion forecasts of complex urban traffic directly from sensor data.
We model the scene as an interaction graph and employ powerful graph neural networks to learn a distributed latent representation of the scene.
arXiv Detail & Related papers (2020-07-23T14:31:25Z) - The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
Roads have well defined geometries, topologies, and traffic rules.
In this paper we propose to incorporate structured priors as a loss function.
We demonstrate the effectiveness of our approach on real-world self-driving datasets.
arXiv Detail & Related papers (2020-06-04T03:56:11Z) - TPNet: Trajectory Proposal Network for Motion Prediction [81.28716372763128]
Trajectory Proposal Network (TPNet) is a novel two-stage motion prediction framework.
TPNet first generates a candidate set of future trajectories as hypothesis proposals, then makes the final predictions by classifying and refining the proposals.
Experiments on four large-scale trajectory prediction datasets, show that TPNet achieves the state-of-the-art results both quantitatively and qualitatively.
arXiv Detail & Related papers (2020-04-26T00:01:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.