DynoJEPP: Joint Estimation, Prediction and Planning in Dynamic Environments

• URL: http://arxiv.org/abs/2605.12897v1
• Date: Wed, 13 May 2026 02:18:58 GMT
• Title: DynoJEPP: Joint Estimation, Prediction and Planning in Dynamic Environments
• Abstract summary: DynoJEPP is a factor-graph-based framework that jointly formulates and simultaneously optimize estimation, prediction, and planning.<n>In conventional factor-graph-based approaches that jointly formulate estimation, prediction, and planning, information from prediction and planning feeds back into state estimation.<n>We introduce a novel directed factor that enforces directional information flow within the factor graph, preventing prediction and planning from corrupting state estimation.
• Score: 5.939977356761951
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: DynoJEPP is a factor-graph-based framework that jointly formulates and simultaneously optimizes estimation, prediction, and planning in dynamic environments. In conventional factor-graph-based approaches that jointly formulate estimation, prediction, and planning, information from prediction and planning feeds back into state estimation, yielding corrupted estimates, undesired behaviors, and unsafe plans. To address this, DynoJEPP introduces a novel directed factor that enforces directional information flow within the factor graph, preventing prediction and planning from corrupting state estimation. We evaluate the impact of directed factors on inter-module interactions during navigation in both static and dynamic environments. Our results demonstrate that these factors are critical for safe operation, as without them, the robot collides in the majority of experiments. Building on this, we further introduce Cooperative DynoJEPP, which enables the ego robot to incorporate cooperative object behavior into its prediction and trajectory planning.

Related papers

• Orthogonal JEPA: Factorized Predictive States for Latent World Models [95.20158869896393]
  We introduce method, a latent world-modeling framework based on predictive factorization.<n>We show that method can allocate redundant capacity to dominant signals while providing weak or conflicting gradients to less dominant predictive structure.<n>Experiments on controlled vision, single-cell transcriptomics, longitudinal health records, continuous control, and molecular dynamics evaluate representation quality, forecasting, planning, and long-horizon stability.
  arXiv  Detail & Related papers  (2026-08-20T13:59:57Z)
• Active Interaction-Aware Model Predictive Path Integral via Ego-Conditioned Generative Predictions [15.278521134124077]
  We propose a planning framework that integrates an ego-conditioned generative autoregressive prediction model within Model Predictive Path Integral control.<n>The generative prediction model outputs, multi-modal predictions of surrounding agents conditioned on each of the ego's considered future actions.<n>We show that closed-loop simulations demonstrate improved safety and efficiency compared to conventional predict-then-plan and passive interaction-aware approaches.
  arXiv  Detail & Related papers  (2026-08-06T22:51:26Z)
• Joint Prediction of Human Motions and Actions in Human-Robot Collaboration [81.20389836121502]
  We introduce textsfMA-HERP, a hierarchical framework for the emphjoint estimation and prediction of human movements and actions.<n>We present a preliminary experimental evaluation based on musculoskeletal simulations of reaching movements, showing accurate motion prediction and robust action inference under noise.
  arXiv  Detail & Related papers  (2026-04-03T14:40:07Z)
• Position: Beyond Model-Centric Prediction -- Agentic Time Series Forecasting [49.05788441962762]
  We argue for agentic time series forecasting (ATSF), which reframes forecasting as an agentic process composed of perception, planning, action, reflection, and memory.<n>We outline three representative implementation paradigms -- workflow-based design, agentic reinforcement learning, and a hybrid agentic workflow paradigm -- and discuss the opportunities and challenges that arise when shifting from model-centric prediction to agentic forecasting.
  arXiv  Detail & Related papers  (2026-02-02T08:01:11Z)
• Predicting Future Actions of Reinforcement Learning Agents [27.6973598477153]
  This paper experimentally evaluates and compares the effectiveness of future action and event prediction for three types of reinforcement learning agents. We employ two approaches: the inner state approach, which involves predicting based on the inner computations of the agents, and a simulation-based approach, which involves unrolling the agent in a learned world model. Using internal plans proves more robust to model quality compared to simulation-based approaches when predicting actions, while the results for event prediction are more mixed.
  arXiv  Detail & Related papers  (2024-10-29T18:48:18Z)
• Hybrid-Prediction Integrated Planning for Autonomous Driving [26.549857543338963]
  We introduce a hybrid-prediction integrated planning (HPP) system, which possesses three novelly designed modules. First, we introduce marginal-conditioned occupancy prediction to align joint occupancy with agent-wise perceptions. Second, we propose a game-theoretic motion predictor, GTFormer, to model the interactive future among individual agents with their joint awareness. Third, hybrid prediction patterns are concurrently integrated with Ego Planner and optimized by prediction guidance.
  arXiv  Detail & Related papers  (2024-02-04T09:51:19Z)
• PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Driving [57.89801036693292]
  PPAD (Iterative Interaction of Prediction and Planning Autonomous Driving) considers the timestep-wise interaction to better integrate prediction and planning. We design ego-to-agent, ego-to-map, and ego-to-BEV interaction mechanisms with hierarchical dynamic key objects attention to better model the interactions.
  arXiv  Detail & Related papers  (2023-11-14T11:53:24Z)
• Interactive Joint Planning for Autonomous Vehicles [19.479300967537675]
  In interactive driving scenarios, the actions of one agent greatly influences those of its neighbors. We present Interactive Joint Planning (IJP) that bridges MPC with learned prediction models. IJP significantly outperforms the baselines that are either without joint optimization or running sampling-based planning.
  arXiv  Detail & Related papers  (2023-10-27T17:48:25Z)
• Motion-Scenario Decoupling for Rat-Aware Video Position Prediction: Strategy and Benchmark [49.58762201363483]
  We introduce RatPose, a bio-robot motion prediction dataset constructed by considering the influence factors of individuals and environments. We propose a Dual-stream Motion-Scenario Decoupling framework that effectively separates scenario-oriented and motion-oriented features. We demonstrate significant performance improvements of the proposed textitDMSD framework on different difficulty-level tasks.
  arXiv  Detail & Related papers  (2023-05-17T14:14:31Z)
• P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Driving [28.948224519638913]
  We evaluate state-of-the-art predictors through novel conflict-related metrics. We propose a simple but effective alternative that combines a physics-based trajectory generator and a learning-based predictor. Our predictor, P4P, achieves superior performance over existing learning-based predictors in realistic interactive driving scenarios.
  arXiv  Detail & Related papers  (2022-11-03T07:51:40Z)
• Behavioral Intention Prediction in Driving Scenes: A Survey [70.53285924851767]
  Behavioral Intention Prediction (BIP) simulates a human consideration process and fulfills the early prediction of specific behaviors. This work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications.
  arXiv  Detail & Related papers  (2022-11-01T11:07:37Z)
• The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
  Roads have well defined geometries, topologies, and traffic rules. In this paper we propose to incorporate structured priors as a loss function. We demonstrate the effectiveness of our approach on real-world self-driving datasets.
  arXiv  Detail & Related papers  (2020-06-04T03:56:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.