SRA-LSTM: Social Relationship Attention LSTM for Human Trajectory Prediction

• URL: http://arxiv.org/abs/2103.17045v1
• Date: Wed, 31 Mar 2021 12:56:39 GMT
• Title: SRA-LSTM: Social Relationship Attention LSTM for Human Trajectory Prediction
• Authors: Yusheng Peng, Gaofeng Zhang, Jun Shi, Benzhu Xu, Liping Zheng
• Abstract summary: Social relationship among pedestrians is a key factor influencing pedestrian walking patterns. Social Relationship Attention LSTM (SRA-LSTM) model to predict future trajectories.
• Score: 3.1703939581903864
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pedestrian trajectory prediction for surveillance video is one of the important research topics in the field of computer vision and a key technology of intelligent surveillance systems. Social relationship among pedestrians is a key factor influencing pedestrian walking patterns but was mostly ignored in the literature. Pedestrians with different social relationships play different roles in the motion decision of target pedestrian. Motivated by this idea, we propose a Social Relationship Attention LSTM (SRA-LSTM) model to predict future trajectories. We design a social relationship encoder to obtain the representation of their social relationship through the relative position between each pair of pedestrians. Afterwards, the social relationship feature and latent movements are adopted to acquire the social relationship attention of this pair of pedestrians. Social interaction modeling is achieved by utilizing social relationship attention to aggregate movement information from neighbor pedestrians. Experimental results on two public walking pedestrian video datasets (ETH and UCY), our model achieves superior performance compared with state-of-the-art methods. Contrast experiments with other attention methods also demonstrate the effectiveness of social relationship attention.

Related papers

• From a Social Cognitive Perspective: Context-aware Visual Social Relationship Recognition [59.57095498284501]
  We propose a novel approach that recognizes textbfContextual textbfSocial textbfRelationships (textbfConSoR) from a social cognitive perspective. We construct social-aware descriptive language prompts with social relationships for each image. Impressively, ConSoR outperforms previous methods with a 12.2% gain on the People-in-Social-Context (PISC) dataset and a 9.8% increase on the People-in-Photo-Album (PIPA) benchmark.
  arXiv  Detail & Related papers  (2024-06-12T16:02:28Z)
• Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation [55.65482030032804]
  Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. We propose a systematic relational reasoning approach with explicit inference of the underlying dynamically evolving relational structures. Our approach infers dynamically evolving relation graphs and hypergraphs to capture the evolution of relations, which the trajectory predictor employs to generate future states.
  arXiv  Detail & Related papers  (2024-01-22T18:58:22Z)
• IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction [1.3597551064547502]
  Predicting the trajectory of pedestrians in crowd scenarios is indispensable in self-driving or autonomous mobile robot field. Previous researchers focused on how to model human-human interactions but neglected the relative importance of interactions. New mechanism based on correntropy is introduced to measure the relative importance of human-human interactions.
  arXiv  Detail & Related papers  (2023-11-26T05:17:11Z)
• SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents [107.4138224020773]
  We present SOTOPIA, an open-ended environment to simulate complex social interactions between artificial agents and humans. In our environment, agents role-play and interact under a wide variety of scenarios; they coordinate, collaborate, exchange, and compete with each other to achieve complex social goals. We find that GPT-4 achieves a significantly lower goal completion rate than humans and struggles to exhibit social commonsense reasoning and strategic communication skills.
  arXiv  Detail & Related papers  (2023-10-18T02:27:01Z)
• SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Prediction [19.075215661355486]
  We build a new anglebased trainable social interaction representation, named SocialCircle, for continuously reflecting the context of social interactions. We validate the effect of the proposed SocialCircle by training it along with several newly released trajectory prediction models. Experiments show that the SocialCircle not only quantitatively improves the prediction performance, but also qualitatively helps better simulate social interactions.
  arXiv  Detail & Related papers  (2023-10-09T02:59:21Z)
• Social-DualCVAE: Multimodal Trajectory Forecasting Based on Social Interactions Pattern Aware and Dual Conditional Variational Auto-Encoder [14.05141917351931]
  We present a conditional variational auto-encoder (Social-DualCVAE) for multi-modal trajectory forecasting. It is based on a generative model conditioned not only on the past trajectories but also the unsupervised classification of interaction patterns. The proposed model is evaluated on widely used trajectory benchmarks and outperforms the prior state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-02-08T16:04:47Z)
• SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction [59.064925464991056]
  We propose one new prediction model named Social Soft Attention Graph Convolution Network (SSAGCN) SSAGCN aims to simultaneously handle social interactions among pedestrians and scene interactions between pedestrians and environments. Experiments on public available datasets prove the effectiveness of SSAGCN and have achieved state-of-the-art results.
  arXiv  Detail & Related papers  (2021-12-05T01:49:18Z)
• Soft Attention: Does it Actually Help to Learn Social Interactions in Pedestrian Trajectory Prediction? [2.180763067449862]
  We consider the problem of predicting the future path of a pedestrian using its motion history and the motion history of the surrounding pedestrians. Deep-learning has become the main tool used to model the impact of social interactions on a pedestrian's motion.
  arXiv  Detail & Related papers  (2021-06-16T17:39:35Z)
• PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception [50.551003004553806]
  We create a dataset of physically-grounded abstract social events, PHASE, that resemble a wide range of real-life social interactions. Phase is validated with human experiments demonstrating that humans perceive rich interactions in the social events. As a baseline model, we introduce a Bayesian inverse planning approach, SIMPLE, which outperforms state-of-the-art feed-forward neural networks.
  arXiv  Detail & Related papers  (2021-03-02T18:44:57Z)
• Graph-Based Social Relation Reasoning [101.9402771161935]
  We propose a graph relational reasoning network (GR2N) for social relation recognition. Our method considers the paradigm of jointly inferring the relations by constructing a social relation graph. Experimental results illustrate that our method generates a reasonable and consistent social relation graph.
  arXiv  Detail & Related papers  (2020-07-15T03:01:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.