Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction

• URL: http://arxiv.org/abs/2603.10821v1
• Date: Wed, 11 Mar 2026 14:30:52 GMT
• Title: Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction
• Abstract summary: We develop and evaluate a new defense mechanism for trajectory prediction models based on randomized smoothing.<n>Our results demonstrate that randomized smoothing offers a simple and computationally inexpensive technique for mitigating adversarial attacks in trajectory prediction.
• Score: 9.678379563415204
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate and robust trajectory prediction is essential for safe and efficient autonomous driving, yet recent work has shown that even state-of-the-art prediction models are highly vulnerable to inputs being mildly perturbed by adversarial attacks. Although model vulnerabilities to such attacks have been studied, work on effective countermeasures remains limited. In this work, we develop and evaluate a new defense mechanism for trajectory prediction models based on randomized smoothing -- an approach previously applied successfully in other domains. We evaluate its ability to improve model robustness through a series of experiments that test different strategies of randomized smoothing. We show that our approach can consistently improve prediction robustness of multiple base trajectory prediction models in various datasets without compromising accuracy in non-adversarial settings. Our results demonstrate that randomized smoothing offers a simple and computationally inexpensive technique for mitigating adversarial attacks in trajectory prediction.

Related papers

• Adversarial Training of Linear Models under Stealthy Attacks [5.3909333359654275]
  We propose a detector-based switched model, in which optimal attack strategies are stealthy.<n>For linear prediction models, we derive a convex formulation of the resulting adversarial risk.<n> Numerical simulations on real and synthetic data show improved performance on partially attacked data, even for misspecified attack probabilities.
  arXiv  Detail & Related papers  (2026-08-26T11:57:25Z)
• Countering adversarial evasion in regression analysis [0.7136933021609079]
  Adversarial evasion considers scenarios where adversaries adapt their data to influence particular outcomes from established prediction models.<n>This article serves to propose a pessimistic bilevel optimisation program for regression scenarios.
  arXiv  Detail & Related papers  (2025-09-26T09:35:26Z)
• Adaptive Conformal Prediction Intervals Over Trajectory Ensembles [50.31074512684758]
  Future trajectories play an important role across domains such as autonomous driving, hurricane forecasting, and epidemic modeling.<n>We propose a unified framework based on conformal prediction that transforms sampled trajectories into calibrated prediction intervals with theoretical coverage guarantees.
  arXiv  Detail & Related papers  (2025-08-18T21:14:07Z)
• Realistic Adversarial Attacks for Robustness Evaluation of Trajectory Prediction Models via Future State Perturbation [1.124958340749622]
  Trajectory prediction is a key element of autonomous vehicle systems.<n>Current approaches tend to focus on perturbing the past positions of surrounding agents.<n>We introduce new performance measures to assess the realism and impact of these adversarial trajectories.
  arXiv  Detail & Related papers  (2025-05-09T15:40:32Z)
• Motion Forecasting via Model-Based Risk Minimization [13.524251552252489]
  We propose a novel sampling method applicable to trajectory prediction based on the predictions of multiple models.<n>We first show that conventional sampling based on predicted probabilities can degrade performance due to missing alignment between models.<n>By using state-of-the-art models as base learners, our approach constructs diverse and effective ensembles for optimal trajectory sampling.
  arXiv  Detail & Related papers  (2024-09-16T09:03:28Z)
• Certified Human Trajectory Prediction [66.1736456453465]
  We propose a certification approach tailored for trajectory prediction that provides guaranteed robustness.<n>To mitigate the inherent performance drop through certification, we propose a diffusion-based trajectory denoiser and integrate it into our method.<n>We demonstrate the accuracy and robustness of the certified predictors and highlight their advantages over the non-certified ones.
  arXiv  Detail & Related papers  (2024-03-20T17:41:35Z)
• On the Robustness of Random Forest Against Untargeted Data Poisoning: An Ensemble-Based Approach [42.81632484264218]
  In machine learning models, perturbations of fractions of the training set (poisoning) can seriously undermine the model accuracy. This paper aims to implement a novel hash-based ensemble approach that protects random forest against untargeted, random poisoning attacks.
  arXiv  Detail & Related papers  (2022-09-28T11:41:38Z)
• AdvDO: Realistic Adversarial Attacks for Trajectory Prediction [87.96767885419423]
  Trajectory prediction is essential for autonomous vehicles to plan correct and safe driving behaviors. We devise an optimization-based adversarial attack framework to generate realistic adversarial trajectories. Our attack can lead an AV to drive off road or collide into other vehicles in simulation.
  arXiv  Detail & Related papers  (2022-09-19T03:34:59Z)
• Robust Multivariate Time-Series Forecasting: Adversarial Attacks and Defense Mechanisms [17.75675910162935]
  A new attack pattern negatively impacts the forecasting of a target time series. We develop two defense strategies to mitigate the impact of such attack. Experiments on real-world datasets confirm that our attack schemes are powerful.
  arXiv  Detail & Related papers  (2022-07-19T22:00:41Z)
• Uncertainty estimation of pedestrian future trajectory using Bayesian approximation [137.00426219455116]
  Under dynamic traffic scenarios, planning based on deterministic predictions is not trustworthy. The authors propose to quantify uncertainty during forecasting using approximation which deterministic approaches fail to capture. The effect of dropout weights and long-term prediction on future state uncertainty has been studied.
  arXiv  Detail & Related papers  (2022-05-04T04:23:38Z)
• Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding [121.66374635092097]
  Trajectories obtained from object detection and tracking are inevitably noisy. We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
  arXiv  Detail & Related papers  (2022-02-03T09:09:56Z)
• Trust but Verify: Assigning Prediction Credibility by Counterfactual Constrained Learning [123.3472310767721]
  Prediction credibility measures are fundamental in statistics and machine learning. These measures should account for the wide variety of models used in practice. The framework developed in this work expresses the credibility as a risk-fit trade-off.
  arXiv  Detail & Related papers  (2020-11-24T19:52:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.