Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion

• URL: http://arxiv.org/abs/2603.19533v1
• Date: Fri, 20 Mar 2026 00:19:34 GMT
• Title: Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion
• Abstract summary: We present a lightweight, socially informed architecture for pedestrian intention prediction.<n>It fuses four behavioral streams (attention, position, situation, and interaction) using highway encoders, a compact 4-token Transformer, and global self-attention pooling.<n>The proposed approach is modality-agnostic, easy to integrate with vision language pipelines, and suitable for risk-aware intent prediction on resource-constrained platforms.
• Score: 6.689013818004752
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pedestrian intention prediction needs to be accurate for autonomous vehicles to navigate safely in urban environments. We present a lightweight, socially informed architecture for pedestrian intention prediction. It fuses four behavioral streams (attention, position, situation, and interaction) using highway encoders, a compact 4-token Transformer, and global self-attention pooling. To quantify uncertainty, we incorporate two complementary heads: a variational bottleneck whose KL divergence captures epistemic uncertainty, and a Mahalanobis distance detector that identifies distributional shift. Together, these components yield calibrated probabilities and actionable risk scores without compromising efficiency. On the PSI 1.0 benchmark, our model outperforms recent vision language models by achieving 0.9 F1, 0.94 AUC-ROC, and 0.78 MCC by using only structured, interpretable features. On the more diverse PSI 2.0 dataset, where, to the best of our knowledge, no prior results exist, we establish a strong initial baseline of 0.78 F1 and 0.79 AUC-ROC. Selective prediction based on Mahalanobis scores increases test accuracy by up to 0.4 percentage points at 80% coverage. Qualitative attention heatmaps further show how the model shifts its cross-stream focus under ambiguity. The proposed approach is modality-agnostic, easy to integrate with vision language pipelines, and suitable for risk-aware intent prediction on resource-constrained platforms.

Related papers

• Tyche: One Step Flow for Efficient Probabilistic Weather Forecasting [48.263481135566316]
  We present Tyche, a one-step conditional flow model for efficient probabilistic weather forecasting.<n>Experiments on ERA5 at 1.5$circ$ and 6-hour resolution show that our Tyche, using merely a single NFE, matches or exceeds the forecast skill and calibration of state-of-the-art multi-step generative baselines.
  arXiv  Detail & Related papers  (2026-05-07T20:25:28Z)
• The Predictive-Causal Gap: An Impossibility Theorem and Large-Scale Neural Evidence [1.8867357521563244]
  We report a systematic failure mode in predictive representation learning.<n>Across 2695 neural network configurations trained to predict linear-Gaussian dynamics, the optimal encoder tracks the environment rather than the system it is meant to model.
  arXiv  Detail & Related papers  (2026-05-06T15:25:37Z)
• Bi-Level Chaotic Fusion Based Graph Convolutional Network for Stock Market Prediction Interval [0.0]
  Financial market forecasting is inherently uncertain, yet most deep learning approaches rely on single estimates without uncertainty.<n>The problem can be solved using prediction intervals, which allow obtaining an uncertainty and lower bound for the prediction.<n>Yet, the current methods tend to disregard relationships between assets or cannot simultaneously ensure good calibration sharpness.
  arXiv  Detail & Related papers  (2026-05-05T05:06:42Z)
• Differentiable latent structure discovery for interpretable forecasting in clinical time series [38.473526928012724]
  We introduce StructGP, a continuous-time multi-task Gaussian process that couples differentiable structure learning to uncover a sparse, ordered directed acyclic graph (DAG) of inter-variable dependencies while preserving principled uncertainty.<n>We propose LP-StructGP, which augments StructGP with latent pathways-shared, temporally shifted trajectories inferred via subject-specific coupling filters and a softmax gating mechanism-to capture cross-patient progression patterns.
  arXiv  Detail & Related papers  (2026-04-30T14:59:50Z)
• Collaborative Trajectory Prediction via Late Fusion [17.045815575131915]
  Collaborative vehicle-to-vehicle approaches help reduce uncertainty by sharing complementary information.<n>We introduce a late-fusion framework for shared forecasts.<n>We evaluate the approach on the OPV2V, V2V4Real, and DeepAccident datasets.
  arXiv  Detail & Related papers  (2026-04-24T19:34:56Z)
• AI-Driven Predictive Maintenance with Real-Time Contextual Data Fusion for Connected Vehicles: A Multi-Dataset Evaluation [0.0]
  This paper presents a simulation-validated proof-of-concept framework for V2X-augmented predictive maintenance.<n>It integrates on-board sensor streams with external contextual signals.<n>Edge inference is estimated to reduce latency from 3.5s to under 1.0s versus cloud-only processing.
  arXiv  Detail & Related papers  (2026-03-07T06:08:45Z)
• d-TreeRPO: Towards More Reliable Policy Optimization for Diffusion Language Models [45.27333046908981]
  emphd-TreeRPO is a reliable reinforcement learning framework for dLLMs.<n>We show that emphd-TreeRPO achieves significant gains on multiple reasoning benchmarks.
  arXiv  Detail & Related papers  (2025-12-10T14:20:07Z)
• A Conditional Diffusion Model for Probabilistic Prediction of Battery Capacity Degradation [0.0]
  This paper presents a novel method, termed the Diffusion U-Net with Attention (CDUA), which integrates feature engineering and deep learning to address this challenge.<n>The proposed approach employs a diffusion-based generative model for time-series forecasting and incorporates attention mechanisms to enhance predictive performance.<n> Experimental validation on the real-world vehicle data demonstrates that the proposed CDUA model achieves a relative Mean Absolute Error (MAE) of 0.94% and a relative Root Mean Square Error (RMSE) of 1.14%, with a narrow 95% confidence interval of 3.74% in relative width.
  arXiv  Detail & Related papers  (2025-10-20T10:56:28Z)
• Leveraging Cellular Automata for Real-Time Wildfire Spread Modeling in California [0.0]
  The present study develops a predictive model based on cellular automata (CA) that incorporates key environmental variables.<n> Evaluation of the model using a confusion matrix against burn scars from the 2025 Pacific Palisades Fire yielded a recall of 0.860, a precision of 0.605, and an overall F1 score of 0.711.
  arXiv  Detail & Related papers  (2025-10-10T02:31:57Z)
• ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving [64.42138266293202]
  ResAD is a Normalized Residual Trajectory Modeling framework.<n>It reframes the learning task to predict the residual deviation from an inertial reference.<n>On the NAVSIM benchmark, ResAD achieves a state-of-the-art PDMS of 88.6 using a vanilla diffusion policy.
  arXiv  Detail & Related papers  (2025-10-09T17:59:36Z)
• RoHOI: Robustness Benchmark for Human-Object Interaction Detection [84.78366452133514]
  Human-Object Interaction (HOI) detection is crucial for robot-human assistance, enabling context-aware support.<n>We introduce the first benchmark for HOI detection, evaluating model resilience under diverse challenges.<n>Our benchmark, RoHOI, includes 20 corruption types based on the HICO-DET and V-COCO datasets and a new robustness-focused metric.
  arXiv  Detail & Related papers  (2025-07-12T01:58:04Z)
• Towards Robust Unsupervised Attention Prediction in Autonomous Driving [40.84001015982244]
  We propose a robust unsupervised attention prediction method for self-driving systems.<n>An Uncertainty Mining Branch refines predictions by analyzing commonalities and differences across multiple pre-trained models on natural scenes.<n>A Knowledge Embedding Block bridges the domain gap by incorporating driving knowledge to adaptively enhance pseudo-labels.<n>A novel data augmentation method improves robustness against corruption through soft attention and dynamic augmentation.
  arXiv  Detail & Related papers  (2025-01-25T03:01:26Z)
• Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructure [52.2025114590481]
  We introduce Hybrid-Segmentor, an encoder-decoder based approach that is capable of extracting both fine-grained local and global crack features. This allows the model to improve its generalization capabilities in distinguish various type of shapes, surfaces and sizes of cracks. The proposed model outperforms existing benchmark models across 5 quantitative metrics (accuracy 0.971, precision 0.804, recall 0.744, F1-score 0.770, and IoU score 0.630), achieving state-of-the-art status.
  arXiv  Detail & Related papers  (2024-09-04T16:47:16Z)
• Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture [17.78048571619575]
  Safety and robustness are crucial factors in developing trustworthy autonomous vehicles. We propose the Sequential Neural Variational Agent (SeNeVA), a generative model that describes the distribution of future trajectories for a single moving object. Our approach can distinguish Out-of-Distribution data while quantifying uncertainty and achieving competitive performance.
  arXiv  Detail & Related papers  (2024-04-04T20:04:12Z)
• MixedNUTS: Training-Free Accuracy-Robustness Balance via Nonlinearly Mixed Classifiers [41.56951365163419]
  "MixedNUTS" is a training-free method where the output logits of a robust classifier are processed by nonlinear transformations with only three parameters. MixedNUTS then converts the transformed logits into probabilities and mixes them as the overall output. On CIFAR-10, CIFAR-100, and ImageNet datasets, experimental results with custom strong adaptive attacks demonstrate MixedNUTS's vastly improved accuracy and near-SOTA robustness.
  arXiv  Detail & Related papers  (2024-02-03T21:12:36Z)
• Multi-Path Long-Term Vessel Trajectories Forecasting with Probabilistic Feature Fusion for Problem Shifting [8.970625329763559]
  This paper addresses the challenge of boosting the precision of multi-path long-term vessel trajectory forecasting on engineered sequences of Automatic Identification System (AIS) data. We have developed a deep auto-encoder model and a phased framework approach to predict the next 12 hours of vessel trajectories using 1 to 3 hours of AIS data as input. We have shown that our model achieves more accurate forecasting with average and median errors of 11km and 6km, respectively, a 25% improvement from the current state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-10-29T09:15:22Z)
• End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation [86.41437210485932]
  We aim at advancing zero-shot HOI detection to detect both seen and unseen HOIs simultaneously. We propose a novel end-to-end zero-shot HOI Detection framework via vision-language knowledge distillation. Our method outperforms the previous SOTA by 8.92% on unseen mAP and 10.18% on overall mAP.
  arXiv  Detail & Related papers  (2022-04-01T07:27:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.