FuguReport

FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planning

Authors Xirui Li, Zhe Liu, Xiaoqing Ye, Wenhua Han, Yifeng Pan, Junyu Han, Hengshuang Zhao
Affiliations The University of Hong Kong / Changan Automobile
Categories Method / Driving Planning / Multimodal action distribution learning, Method / Reinforcement Learning / Hard safety constraints under reward noise, Evaluation / Sampling Methods / Controllable test-time sampling techniques
License CC BY 4.0

Abstract Overview

FlowR2A is a multimodal driving planner that learns a reward-conditioned action distribution, reframing simulation rewards from discriminative labels into conditions for trajectory generation. The method combines dense trajectory-reward pairs from a large action vocabulary with a flow-matching decoder, aiming to unify the dense supervision used in scoring-based planners with the flexible proposal generation of anchor-based planners. To better balance hard safety constraints and softer progress objectives, it uses fine-grained per-timestep reward signals for key constraints and adds noise to continuous rewards during training. At inference, the generative setup supports controllable sampling through reward guidance and anchored sampling, with a separate mode selector ranking the generated proposals.

Novelty

The paper's main novelty is to model multimodal driving planning as learning the reward-to-action distribution p(a|r) rather than predicting rewards for actions or generating proposals from fixed anchors. It also introduces a reward-conditioning design tailored to driving, combining per-timestep safety and compliance signals with reward noise augmentation to make high-reward conditioning practical.

Results

On NAVSIM v1, FlowR2A reports 92.8 PDMS with 60 proposals, outperforming prior methods listed in the paper, and its single-proposal variant reaches 90.0 PDMS. On NAVSIM v2, it achieves 88.9 EPDMS and leads the reported methods on NC, TTC, and EP, while the authors note weaker extended comfort. Proposal-quality analysis shows stronger average proposal quality and lower variance than compared anchor-based baselines, indicating more consistently feasible sampled trajectories.

Key Points

  1. FlowR2A learns reward-conditioned trajectory generation from dense action-reward pairs, bridging scoring-based dense supervision and anchor-based proposal generation.
  2. The method strengthens reward conditioning with per-timestep safety/compliance signals and reward noise augmentation to better handle the trade-off between hard constraints and continuous objectives.
  3. Experiments on NAVSIM v1 and v2 show state-of-the-art benchmark performance and markedly stronger proposal quality than the compared multimodal baselines.

References

This page was created using generative AI such as GPT-5, Claude Opus 4, Gemini 3, Gemini 3.1 Flash Image, and their higher-end successor versions. No guarantee can be made regarding its contents.