Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges

• URL: http://arxiv.org/abs/2512.00021v1
• Date: Fri, 31 Oct 2025 18:05:02 GMT
• Title: Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges
• Abstract summary: Multi-modal foundation models have transformed the technology for autonomous driving.<n>We provide a comprehensive examination of such methods through a unifying taxonomy.<n>We assess these approaches with respect to the openness of their source code and datasets.
• Score: 53.47232506143113
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The emergence of multi-modal foundation models has markedly transformed the technology for autonomous driving, shifting away from conventional and mostly hand-crafted design choices towards unified, foundation-model-based approaches, capable of directly inferring motion trajectories from raw sensory inputs. This new class of methods can also incorporate natural language as an additional modality, with Vision-Language-Action (VLA) models serving as a representative example. In this review, we provide a comprehensive examination of such methods through a unifying taxonomy to critically evaluate their architectural design choices, methodological strengths, and their inherent capabilities and limitations. Our survey covers 37 recently proposed approaches that span the landscape of trajectory planning with foundation models. Furthermore, we assess these approaches with respect to the openness of their source code and datasets, offering valuable information to practitioners and researchers. We provide an accompanying webpage that catalogs the methods based on our taxonomy, available at: https://github.com/fiveai/FMs-for-driving-trajectories

Related papers

• The Emerging Paradigm of Geospatial Foundation Models: From Pre-Training to Agentic Reasoning [0.0]
  The analysis of satellite and aerial imagery has entered a new era with the advent of foundation models.<n>This paper describes the concept of Geospatial Foundation Models (GeoFMs), which are artificial intelligence/machine learning (AI/ML) models pre-trained on massive geospatial datasets.
  arXiv  Detail & Related papers  (2026-07-13T21:50:50Z)
• Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective [91.23306722968509]
  Generalizable feed-forward 3D reconstruction has witnessed rapid development in recent years.<n>Existing feed-forward approaches share similar high-level architectural patterns.<n>We propose a novel taxonomy centered on model design strategies that are agnostic to the output format.
  arXiv  Detail & Related papers  (2026-04-15T16:07:18Z)
• Building a Foundation Model for Trajectory from Scratch [0.764671395172401]
  Foundation models are transformative in artificial intelligence, but building them from scratch, especially for mobility trajectories, is not yet clear or documented.<n>This tutorial bridges this gap by demonstrating the steps and code of a minimal implementation of a trajectory-focused foundation model starting from GPT-2.
  arXiv  Detail & Related papers  (2025-11-25T18:37:55Z)
• Continual Learning for Generative AI: From LLMs to MLLMs and Beyond [56.29231194002407]
  We present a comprehensive survey of continual learning methods for mainstream generative AI models.<n>We categorize these approaches into three paradigms: architecture-based, regularization-based, and replay-based.<n>We analyze continual learning setups for different generative models, including training objectives, benchmarks, and core backbones.
  arXiv  Detail & Related papers  (2025-06-16T02:27:25Z)
• A Concise Survey on Lane Topology Reasoning for HD Mapping [30.73664953504888]
  Lane topology reasoning techniques play a crucial role in high-definition (HD) mapping and autonomous driving applications.<n>Recent years have witnessed significant advances in this field, but there has been limited effort to consolidate these works into a comprehensive overview.<n>This survey systematically reviews the evolution and current state of lane topology reasoning methods.
  arXiv  Detail & Related papers  (2025-03-31T11:30:40Z)
• A Survey of Model Architectures in Information Retrieval [59.61734783818073]
  The period from 2019 to the present has represented one of the biggest paradigm shifts in information retrieval (IR) and natural language processing (NLP)<n>We trace the development from traditional term-based methods to modern neural approaches, particularly highlighting the impact of transformer-based models and subsequent large language models (LLMs)<n>We conclude with a forward-looking discussion of emerging challenges and future directions.
  arXiv  Detail & Related papers  (2025-02-20T18:42:58Z)
• Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents [22.94671478021277]
  Foundation model-enabled generative artificial intelligence facilitates the development and implementation of agents. There is a lack of systematic knowledge to guide practitioners in designing the agents. We present a pattern catalogue consisting of 18 architectural patterns with analyses of the context, forces, and trade-offs.
  arXiv  Detail & Related papers  (2024-05-16T23:24:48Z)
• A Survey for Foundation Models in Autonomous Driving [10.315409708116865]
  Large language models contribute to planning and simulation in autonomous driving. vision foundation models are increasingly adapted for critical tasks such as 3D object detection and tracking. Multi-modal foundation models, integrating diverse inputs, exhibit exceptional visual understanding and spatial reasoning.
  arXiv  Detail & Related papers  (2024-02-02T02:44:59Z)
• Towards Efficient Task-Driven Model Reprogramming with Foundation Models [52.411508216448716]
  Vision foundation models exhibit impressive power, benefiting from the extremely large model capacity and broad training data. However, in practice, downstream scenarios may only support a small model due to the limited computational resources or efficiency considerations. This brings a critical challenge for the real-world application of foundation models: one has to transfer the knowledge of a foundation model to the downstream task.
  arXiv  Detail & Related papers  (2023-04-05T07:28:33Z)
• Deep Inverse Reinforcement Learning for Route Choice Modeling [0.6853165736531939]
  Route choice modeling is a fundamental task in transportation planning and demand forecasting. This study proposes a general deep inverse reinforcement learning (IRL) framework for link-based route choice modeling. Experiment results based on taxi GPS data from Shanghai, China validate the improved performance of the proposed model.
  arXiv  Detail & Related papers  (2022-06-18T06:33:06Z)
• Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models [89.44031286278347]
  We propose a Hub-Pathway framework to enable knowledge transfer from a model hub. The proposed framework can be trained end-to-end with the target task-specific loss. Experiment results on computer vision and reinforcement learning tasks demonstrate that the framework achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-06-08T08:00:12Z)
• Planning with Diffusion for Flexible Behavior Synthesis [125.24438991142573]
  We consider what it would look like to fold as much of the trajectory optimization pipeline as possible into the modeling problem. The core of our technical approach lies in a diffusion probabilistic model that plans by iteratively denoising trajectories.
  arXiv  Detail & Related papers  (2022-05-20T07:02:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.