Learn to Quantify Social Interaction with Constraints for Pedestrian Walking

• URL: http://arxiv.org/abs/2606.17897v1
• Date: Tue, 16 Jun 2026 13:18:22 GMT
• Title: Learn to Quantify Social Interaction with Constraints for Pedestrian Walking
• Abstract summary: Social interactions in pedestrian walking are intuitively massive and hard to label and quantify.<n>We propose Learn to Cluster to quantify and interpret how pedestrians interact with others.<n>Our method is able to learn the patterns of social interactions and effectively integrate the patterns to pedestrian trajectory prediction.
• Score: 2.418953973082761
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Long-term human path forecasting in crowds is critical for autonomous moving platforms (like autonomous driving cars and social robots) to avoid collision and make high-quality planning. Although the current research take into account social interactions for prediction, they don't reveal the exact kinds of social interactions happened among people and how the social interactions affect the decision-making process of pedestrians, which further limits its robustness. Social interactions in pedestrian walking are intuitively massive and hard to label and quantify. In this paper, we explore creatively to quantify and interpret how pedestrians interact with others by proposing Learn to Cluster. Our clustering social interactions is probabilistic latent variable generative, learning directly from sequential trajectory observations, scalable to arbitrary number of pedestrians. Learn to cluster is label-free and can be naturally integrated into the training process of the prediction model. The latent variables will then serve as 'labels' to categorize social interactions. Extensive experiments over several trajectory prediction benchmarks demonstrate that our method is able to learn the patterns of social interactions and effectively integrate the patterns to pedestrian trajectory prediction.

Related papers

• Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models [81.44955493339835]
  Social-Mamba is a forecasting architecture that reformulates social interactions as structured sequential processes.<n>Social-Mamba organizes agents on an egocentric grid and introduces social triplet factorization.<n>Experiments on five trajectory forecasting benchmarks show that Social-Mamba achieves state-of-the-art accuracy.
  arXiv  Detail & Related papers  (2026-05-14T21:16:01Z)
• From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection [57.74400052368147]
  This paper presents a social robot navigation framework that integrates geometric planning with contextual social reasoning.<n>The system first extracts obstacles and human dynamics to generate geometrically feasible candidate paths, then leverages a fine-tuned vision-language model (VLM) to evaluate these paths.<n>Experiments in four social navigation contexts demonstrate that our method achieves the best overall performance with the lowest personal space violation duration, the minimal pedestrian-facing time, and no social zone intrusions.
  arXiv  Detail & Related papers  (2026-02-09T18:46:12Z)
• Social-Transmotion: Promptable Human Trajectory Prediction [65.80068316170613]
  Social-Transmotion is a generic Transformer-based model that exploits diverse and numerous visual cues to predict human behavior.<n>Our approach is validated on multiple datasets, including JTA, JRDB, Pedestrians and Cyclists in Road Traffic, and ETH-UCY.
  arXiv  Detail & Related papers  (2023-12-26T18:56:49Z)
• IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction [1.3597551064547502]
  Predicting the trajectory of pedestrians in crowd scenarios is indispensable in self-driving or autonomous mobile robot field. Previous researchers focused on how to model human-human interactions but neglected the relative importance of interactions. New mechanism based on correntropy is introduced to measure the relative importance of human-human interactions.
  arXiv  Detail & Related papers  (2023-11-26T05:17:11Z)
• SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Prediction [19.075215661355486]
  We build a new anglebased trainable social interaction representation, named SocialCircle, for continuously reflecting the context of social interactions. We validate the effect of the proposed SocialCircle by training it along with several newly released trajectory prediction models. Experiments show that the SocialCircle not only quantitatively improves the prediction performance, but also qualitatively helps better simulate social interactions.
  arXiv  Detail & Related papers  (2023-10-09T02:59:21Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Social-DualCVAE: Multimodal Trajectory Forecasting Based on Social Interactions Pattern Aware and Dual Conditional Variational Auto-Encoder [14.05141917351931]
  We present a conditional variational auto-encoder (Social-DualCVAE) for multi-modal trajectory forecasting. It is based on a generative model conditioned not only on the past trajectories but also the unsupervised classification of interaction patterns. The proposed model is evaluated on widely used trajectory benchmarks and outperforms the prior state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-02-08T16:04:47Z)
• SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction [59.064925464991056]
  We propose one new prediction model named Social Soft Attention Graph Convolution Network (SSAGCN) SSAGCN aims to simultaneously handle social interactions among pedestrians and scene interactions between pedestrians and environments. Experiments on public available datasets prove the effectiveness of SSAGCN and have achieved state-of-the-art results.
  arXiv  Detail & Related papers  (2021-12-05T01:49:18Z)
• PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception [50.551003004553806]
  We create a dataset of physically-grounded abstract social events, PHASE, that resemble a wide range of real-life social interactions. Phase is validated with human experiments demonstrating that humans perceive rich interactions in the social events. As a baseline model, we introduce a Bayesian inverse planning approach, SIMPLE, which outperforms state-of-the-art feed-forward neural networks.
  arXiv  Detail & Related papers  (2021-03-02T18:44:57Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.