ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Experts

• URL: http://arxiv.org/abs/2511.11740v1
• Date: Thu, 13 Nov 2025 13:14:17 GMT
• Title: ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Experts
• Abstract summary: ExpertAD is a novel framework that enhances the performance of autonomous driving systems.<n>Our experiments show that ExpertAD reduces average collision rates by up to 20% and inference latency by 25% compared to prior methods.
• Score: 13.846892166111646
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advancements in end-to-end autonomous driving systems (ADSs) underscore their potential for perception and planning capabilities. However, challenges remain. Complex driving scenarios contain rich semantic information, yet ambiguous or noisy semantics can compromise decision reliability, while interference between multiple driving tasks may hinder optimal planning. Furthermore, prolonged inference latency slows decision-making, increasing the risk of unsafe driving behaviors. To address these challenges, we propose ExpertAD, a novel framework that enhances the performance of ADS with Mixture of Experts (MoE) architecture. We introduce a Perception Adapter (PA) to amplify task-critical features, ensuring contextually relevant scene understanding, and a Mixture of Sparse Experts (MoSE) to minimize task interference during prediction, allowing for effective and efficient planning. Our experiments show that ExpertAD reduces average collision rates by up to 20% and inference latency by 25% compared to prior methods. We further evaluate its multi-skill planning capabilities in rare scenarios (e.g., accidents, yielding to emergency vehicles) and demonstrate strong generalization to unseen urban environments. Additionally, we present a case study that illustrates its decision-making process in complex driving scenarios.

Related papers

• A Multi-Modal Perception Pipeline for Object Detection and Tracking in Autonomous Racing [1.3281177137699656]
  This paper presents a multi-modal late-fusion perception pipeline for object detection and tracking in an autonomous racing domain.<n>Independent detections from cameras, LiDARs, and RADARs are combined to provide timely and robust state estimates of surrounding vehicles.<n>The tracking method explicitly compensates for detection delays and embeds in its model prior knowledge of vehicle dynamics and track layout.
  arXiv  Detail & Related papers  (2026-09-08T07:11:38Z)
• A Collaborative Multi-Modality Interaction for VLA-based End-to-End Autonomous Driving [96.81243316566764]
  Vision-Language-Action (VLA) models have emerged as a powerful paradigm for end-to-end autonomous driving.<n>We propose a robust VLA-based end-to-end autonomous driving system that combines multi-modality interaction with multi-trajectory planning and optimization.
  arXiv  Detail & Related papers  (2026-08-21T09:06:16Z)
• CarPLAN: Context-Adaptive and Robust Planning with Dynamic Scene Awareness for Autonomous Driving [24.617191209246226]
  CarPLAN is a novel IL-based motion planning framework that explicitly enhances driving context understanding.<n> Displacement-Aware Predictive generalization (DPE) improves the model's spatial awareness.<n> Context-adaptive Multi-Expert Decoder (CMD) improves the model's ability to handle diverse driving contexts.
  arXiv  Detail & Related papers  (2026-03-13T03:22:32Z)
• Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving [82.69496624372944]
  "Only driving like the expert" suffers from limited generalization.<n>Can an E2E-AD system make reliable decisions without any expert action supervision?<n>We propose a unified framework named Risk-aware World Model Predictive Control.
  arXiv  Detail & Related papers  (2026-02-26T17:32:30Z)
• Enhancing End-to-End Autonomous Driving with Risk Semantic Distillaion from VLM [14.016225216093643]
  We introduce Risk Semantic Distillation (RSD), a novel framework that leverages Vision-Language Models (VLMs) to enhance the training of End-to-End (E2E) autonomous driving backbones.<n>Specifically, we introduce RiskHead, a plug-in module that distills causal risk estimates from Vision-Language Models into Bird's-Eye-View (BEV) features.<n>Our experiments on the Bench2Drive benchmark demonstrate the effectiveness of RSD in managing complex and unpredictable driving conditions.
  arXiv  Detail & Related papers  (2025-11-18T13:46:18Z)
• A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing [43.930171390617055]
  This paper presents KDP, a knowledge-driven diffusion policy that integrates generative diffusion modeling with a sparse mixture-of-experts routing mechanism.<n>Experiments across representative driving scenarios demonstrate that KDP achieves consistently higher success rates, reduced collision risk, and smoother control compared to prevailing paradigms.<n>These results establish diffusion with expert routing as a scalable and interpretable paradigm for knowledge-driven end-to-end autonomous driving.
  arXiv  Detail & Related papers  (2025-09-05T07:07:18Z)
• ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Driving [64.12414815634847]
  Vision-Language Models (VLMs) and Driving World Models (DWMs) have independently emerged as powerful recipes addressing different aspects of this challenge.<n>We propose ImagiDrive, a novel end-to-end autonomous driving framework that integrates a VLM-based driving agent with a DWM-based scene imaginer.
  arXiv  Detail & Related papers  (2025-08-15T12:06:55Z)
• World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving [1.8277374107085946]
  We propose a comprehensive framework combining generative augmentation scene with adaptive temporal reasoning.<n>We develop a video generation pipeline that utilizes a world model by guided domain-informed prompts to create high-resolution, statistically consistent driving scenarios.<n>In parallel, we construct a dynamic prediction model that encodes-temporal relationships through strengthened graph convolutions and dilated temporal operators.
  arXiv  Detail & Related papers  (2025-07-17T03:34:54Z)
• DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving [62.62464518137153]
  DriveTransformer is a simplified E2E-AD framework for the ease of scaling up.<n>It is composed of three unified operations: task self-attention, sensor cross-attention, temporal cross-attention.<n>It achieves state-of-the-art performance in both simulated closed-loop benchmark Bench2Drive and real world open-loop benchmark nuScenes with high FPS.
  arXiv  Detail & Related papers  (2025-03-07T11:41:18Z)
• Traffic and Safety Rule Compliance of Humans in Diverse Driving Situations [48.924085579865334]
  Analyzing human data is crucial for developing autonomous systems that replicate safe driving practices. This paper presents a comparative evaluation of human compliance with traffic and safety rules across multiple trajectory prediction datasets.
  arXiv  Detail & Related papers  (2024-11-04T09:21:00Z)
• DiFSD: Ego-Centric Fully Sparse Paradigm with Uncertainty Denoising and Iterative Refinement for Efficient End-to-End Self-Driving [55.53171248839489]
  We propose an ego-centric fully sparse paradigm, named DiFSD, for end-to-end self-driving.<n>Specifically, DiFSD mainly consists of sparse perception, hierarchical interaction and iterative motion planner.<n>Experiments conducted on nuScenes and Bench2Drive datasets demonstrate the superior planning performance and great efficiency of DiFSD.
  arXiv  Detail & Related papers  (2024-09-15T15:55:24Z)
• Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities [10.020039700138692]
  Collaborative perception with connected and autonomous vehicles (CAVs) shows a promising solution to overcoming these limitations.<n>In this article, we first identify the challenges of collaborative perception, such as data sharing asynchrony, data volume, and pose errors.<n>We propose a scheme to deal with communication efficiency and latency problems, which is a channel-aware collaborative perception framework.
  arXiv  Detail & Related papers  (2024-01-03T05:33:14Z)
• Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimation [58.21683603243387]
  We propose three auxiliary tasks with relational-temporal reasoning and integrate them into the standard Deep Learning framework. These auxiliary tasks provide additional supervision signals to infer the behavior patterns other interactive agents. Our approach achieves robust and state-of-the-art performance in terms of standard evaluation metrics.
  arXiv  Detail & Related papers  (2023-11-27T18:57:42Z)
• ReasonNet: End-to-End Driving with Temporal and Global Reasoning [31.319673950804972]
  We present ReasonNet, a novel end-to-end driving framework that extensively exploits both temporal and global information of the driving scene. Our method can effectively process the interactions and relationships among features in different frames. Reasoning about the global information of the scene can also improve overall perception performance.
  arXiv  Detail & Related papers  (2023-05-17T18:24:43Z)
• Reinforcement Learning with a Terminator [80.34572413850186]
  We learn the parameters of the TerMDP and leverage the structure of the estimation problem to provide state-wise confidence bounds. We use these to construct a provably-efficient algorithm, which accounts for termination, and bound its regret.
  arXiv  Detail & Related papers  (2022-05-30T18:40:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.