FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planning
Abstract Overview
FlowR2A is a multimodal driving planner that learns a reward-conditioned action distribution, reframing simulation rewards from discriminative labels into conditions for trajectory generation. The method combines dense trajectory-reward pairs from a large action vocabulary with a flow-matching decoder, aiming to unify the dense supervision used in scoring-based planners with the flexible proposal generation of anchor-based planners. To better balance hard safety constraints and softer progress objectives, it uses fine-grained per-timestep reward signals for key constraints and adds noise to continuous rewards during training. At inference, the generative setup supports controllable sampling through reward guidance and anchored sampling, with a separate mode selector ranking the generated proposals.
Novelty
The paper's main novelty is to model multimodal driving planning as learning the reward-to-action distribution p(a|r) rather than predicting rewards for actions or generating proposals from fixed anchors. It also introduces a reward-conditioning design tailored to driving, combining per-timestep safety and compliance signals with reward noise augmentation to make high-reward conditioning practical.
Results
On NAVSIM v1, FlowR2A reports 92.8 PDMS with 60 proposals, outperforming prior methods listed in the paper, and its single-proposal variant reaches 90.0 PDMS. On NAVSIM v2, it achieves 88.9 EPDMS and leads the reported methods on NC, TTC, and EP, while the authors note weaker extended comfort. Proposal-quality analysis shows stronger average proposal quality and lower variance than compared anchor-based baselines, indicating more consistently feasible sampled trajectories.
Key Points
- FlowR2A learns reward-conditioned trajectory generation from dense action-reward pairs, bridging scoring-based dense supervision and anchor-based proposal generation.
- The method strengthens reward conditioning with per-timestep safety/compliance signals and reward noise augmentation to better handle the trade-off between hard constraints and continuous objectives.
- Experiments on NAVSIM v1 and v2 show state-of-the-art benchmark performance and markedly stronger proposal quality than the compared multimodal baselines.
References
- arXiv: https://arxiv.org/abs/2606.24231v1
- Fugu-MT: https://fugumt.com/fugumt/paper_check/2606.24231v1
- Hugging Face Papers: https://huggingface.co/papers/2606.24231
- Project: https://lixirui142.github.io/flowr2a-ad