DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States

• URL: http://arxiv.org/abs/2410.05982v1
• Date: Tue, 8 Oct 2024 12:27:49 GMT
• Title: DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States
• Authors: Bozhou Zhang, Nan Song, Li Zhang,
• Abstract summary: We introduce DeMo, a framework that decouples multi-modal trajectory queries into two types. By leveraging this format, we separately optimize the multi-modality and dynamic evolutionary properties of trajectories. We additionally introduce combined Attention and Mamba techniques for global information aggregation and state sequence modeling.
• Score: 6.856351850183536
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate motion forecasting for traffic agents is crucial for ensuring the safety and efficiency of autonomous driving systems in dynamically changing environments. Mainstream methods adopt a one-query-one-trajectory paradigm, where each query corresponds to a unique trajectory for predicting multi-modal trajectories. While straightforward and effective, the absence of detailed representation of future trajectories may yield suboptimal outcomes, given that the agent states dynamically evolve over time. To address this problem, we introduce DeMo, a framework that decouples multi-modal trajectory queries into two types: mode queries capturing distinct directional intentions and state queries tracking the agent's dynamic states over time. By leveraging this format, we separately optimize the multi-modality and dynamic evolutionary properties of trajectories. Subsequently, the mode and state queries are integrated to obtain a comprehensive and detailed representation of the trajectories. To achieve these operations, we additionally introduce combined Attention and Mamba techniques for global information aggregation and state sequence modeling, leveraging their respective strengths. Extensive experiments on both the Argoverse 2 and nuScenes benchmarks demonstrate that our DeMo achieves state-of-the-art performance in motion forecasting.

Related papers

• Motion Forecasting in Continuous Driving [41.6423398623095]
  In autonomous driving, motion forecasting takes place repeatedly and continuously as the self-driving car moves. Existing forecasting methods process each driving scene within a certain range independently. We propose a novel motion forecasting framework for continuous driving, named RealMotion.
  arXiv  Detail & Related papers  (2024-10-08T13:04:57Z)
• Trajeglish: Traffic Modeling as Next-Token Prediction [67.28197954427638]
  A longstanding challenge for self-driving development is simulating dynamic driving scenarios seeded from recorded driving logs. We apply tools from discrete sequence modeling to model how vehicles, pedestrians and cyclists interact in driving scenarios. Our model tops the Sim Agents Benchmark, surpassing prior work along the realism meta metric by 3.3% and along the interaction metric by 9.9%.
  arXiv  Detail & Related papers  (2023-12-07T18:53:27Z)
• DESTINE: Dynamic Goal Queries with Temporal Transductive Alignment for Trajectory Prediction [8.25651323214656]
  We propose Dynamic goal quErieS with temporal Transductive alIgNmEnt (DESTINE) method. We show that our method achieves state-of-the-art performance on various metrics.
  arXiv  Detail & Related papers  (2023-10-11T12:41:32Z)
• MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying [110.83590008788745]
  Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. In this paper, we propose Motion TRansformer (MTR) frameworks to address these challenges. The initial MTR framework utilizes a transformer encoder-decoder structure with learnable intention queries. We introduce an advanced MTR++ framework, extending the capability of MTR to simultaneously predict multimodal motion for multiple agents.
  arXiv  Detail & Related papers  (2023-06-30T16:23:04Z)
• MotionTrack: Learning Motion Predictor for Multiple Object Tracking [68.68339102749358]
  We introduce a novel motion-based tracker, MotionTrack, centered around a learnable motion predictor. Our experimental results demonstrate that MotionTrack yields state-of-the-art performance on datasets such as Dancetrack and SportsMOT.
  arXiv  Detail & Related papers  (2023-06-05T04:24:11Z)
• Motion Transformer with Global Intention Localization and Local Movement Refinement [103.75625476231401]
  Motion TRansformer (MTR) models motion prediction as the joint optimization of global intention localization and local movement refinement. MTR achieves state-of-the-art performance on both the marginal and joint motion prediction challenges.
  arXiv  Detail & Related papers  (2022-09-27T16:23:14Z)
• Event-Aware Multimodal Mobility Nowcasting [11.540605108140538]
  Events-awaretemporal network EAST-Net is evaluated on real-world datasets with a wide variety and coverage of societal datasets. Results verify the superiority of our approach compared with the state-of-the-art baselines.
  arXiv  Detail & Related papers  (2021-12-14T12:35:20Z)
• Instance-Aware Predictive Navigation in Multi-Agent Environments [93.15055834395304]
  We propose an Instance-Aware Predictive Control (IPC) approach, which forecasts interactions between agents as well as future scene structures. We adopt a novel multi-instance event prediction module to estimate the possible interaction among agents in the ego-centric view. We design a sequential action sampling strategy to better leverage predicted states on both scene-level and instance-level.
  arXiv  Detail & Related papers  (2021-01-14T22:21:25Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.