Didn't see that coming: a survey on non-verbal social human behavior
forecasting
- URL: http://arxiv.org/abs/2203.02480v1
- Date: Fri, 4 Mar 2022 18:25:30 GMT
- Title: Didn't see that coming: a survey on non-verbal social human behavior
forecasting
- Authors: German Barquero and Johnny N\'u\~nez and Sergio Escalera and Zhen Xu
and Wei-Wei Tu and Isabelle Guyon and Cristina Palmero
- Abstract summary: Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years.
Its direct applications to human-robot interaction and socially-aware human motion generation make it a very attractive field.
We define the behavior forecasting problem for multiple interactive agents in a generic way that aims at unifying the fields of social signals prediction and human motion forecasting.
- Score: 47.99589136455976
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Non-verbal social human behavior forecasting has increasingly attracted the
interest of the research community in recent years. Its direct applications to
human-robot interaction and socially-aware human motion generation make it a
very attractive field. In this survey, we define the behavior forecasting
problem for multiple interactive agents in a generic way that aims at unifying
the fields of social signals prediction and human motion forecasting,
traditionally separated. We hold that both problem formulations refer to the
same conceptual problem, and identify many shared fundamental challenges:
future stochasticity, context awareness, history exploitation, etc. We also
propose a taxonomy that comprises methods published in the last 5 years in a
very informative way and describes the current main concerns of the community
with regard to this problem. In order to promote further research on this
field, we also provide a summarised and friendly overview of audiovisual
datasets featuring non-acted social interactions. Finally, we describe the most
common metrics used in this task and their particular issues.
Related papers
- Decoding the Silent Majority: Inducing Belief Augmented Social Graph
with Large Language Model for Response Forecasting [74.68371461260946]
SocialSense is a framework that induces a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics.
Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings.
arXiv Detail & Related papers (2023-10-20T06:17:02Z) - Human Motion Generation: A Survey [67.38982546213371]
Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications.
Most research within this field focuses on generating human motions based on conditional signals, such as text, audio, and scene contexts.
We present a comprehensive literature review of human motion generation, which is the first of its kind in this field.
arXiv Detail & Related papers (2023-07-20T14:15:20Z) - Gaze-based intention estimation: principles, methodologies, and
applications in HRI [0.0]
This review aims to draw a line between insights in the psychological literature on visuomotor control and relevant applications of gaze-based intention recognition.
The use of eye tracking and gaze-based models for intent recognition in Human-Robot Interaction is considered.
arXiv Detail & Related papers (2023-02-09T09:44:13Z) - Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A
Survey [71.43956423427397]
We aim to identify the nonverbal cues and computational methodologies resulting in effective performance.
This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings.
Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
arXiv Detail & Related papers (2022-07-20T13:37:57Z) - Capturing Stance Dynamics in Social Media: Open Challenges and Research
Directions [6.531659195805749]
Social media platforms provide a goldmine for mining public opinion on issues of wide societal interest.
Opinion mining is a problem that can be operationalised by capturing and aggregating the stance of individual social media posts.
We investigate the intersection between computational linguistics and the temporal evolution of human communication in digital media.
arXiv Detail & Related papers (2021-09-01T16:28:24Z) - Social Processes: Self-Supervised Forecasting of Nonverbal Cues in
Social Conversations [22.302509912465077]
We take the first step in the direction of a bottom-up self-supervised approach in the domain of social human interactions.
We formulate the task of Social Cue Forecasting to leverage the larger amount of unlabeled low-level behavior cues.
We propose the Social Process (SP) models--socially aware sequence-to-sequence (Seq2Seq) models within the Neural Process (NP) family.
arXiv Detail & Related papers (2021-07-28T18:01:08Z) - Prevention and Resolution of Conflicts in Social Navigation -- a Survey [39.89946101238849]
Recent developments in robotics have encountered and tackled some of the challenges of navigating in mixed human-robot environments.
Many of the relevant papers are not comparable and there is no standard vocabulary between the researchers.
This paper propose some future directions and problems that are currently in the frontier of social navigation to help focus research efforts.
arXiv Detail & Related papers (2021-06-23T01:10:22Z) - PHASE: PHysically-grounded Abstract Social Events for Machine Social
Perception [50.551003004553806]
We create a dataset of physically-grounded abstract social events, PHASE, that resemble a wide range of real-life social interactions.
Phase is validated with human experiments demonstrating that humans perceive rich interactions in the social events.
As a baseline model, we introduce a Bayesian inverse planning approach, SIMPLE, which outperforms state-of-the-art feed-forward neural networks.
arXiv Detail & Related papers (2021-03-02T18:44:57Z) - Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
We present an in-depth analysis of existing deep learning-based methods for modelling social interactions.
We propose two knowledge-based data-driven methods to effectively capture these social interactions.
We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
arXiv Detail & Related papers (2020-07-07T17:19:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.