Human-Inspired Social Engagement Analysis via Interpretable Mutual Visual Attention

• URL: http://arxiv.org/abs/2608.24580v1
• Date: Tue, 25 Aug 2026 14:05:35 GMT
• Title: Human-Inspired Social Engagement Analysis via Interpretable Mutual Visual Attention
• Abstract summary: We propose an interpretable computational model of social engagement inspired by psychological theories of mutual visual attention.<n>Our framework explicitly models dyadic visual attention and aggregates these cues into interpretable measures of individual and group engagement.
• Score: 7.72838047070244
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding social interactions from non-verbal visual data is important for behavior analysis and activity monitoring. We propose an interpretable computational model of social engagement inspired by psychological theories of mutual visual attention. Rather than learning interaction patterns end-to-end, our framework explicitly models dyadic visual attention and aggregates these cues into interpretable measures of individual and group engagement. The resulting modular framework combines state-of-the-art head orientation estimation with lightweight geometric reasoning, producing explanations that remain accessible to non-technical users. We evaluate the proposed approach on a variety of data through quantitative experiments and demonstrate its practical usefulness with qualitative visualizations designed to support teachers, caregivers, and social workers in understanding group interaction dynamics.

Related papers

• Measuring Inclusion in Interaction: Inclusion Analytics for Human-AI Collaborative Learning [1.0742675209112622]
  We introduce inclusion analytics, a discourse-based framework for examining inclusion as a dynamic, interactional process in problem solving.<n>We demonstrate how these constructs can be made analytically visible using scalable, interaction-level measures.<n>This work represents an initial step toward process-oriented approaches to measuring inclusion in human-AI collaborative learning environments.
  arXiv  Detail & Related papers  (2026-02-09T23:07:15Z)
• Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media [52.313084466769375]
  We propose a novel framework for assessing cognitive-behavioral fixation by analyzing users' multimodal social media engagement patterns.<n> Experiments on existing benchmarks and a newly curated multimodal dataset demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2025-09-05T05:50:00Z)
• Designing Gaze Analytics for ELA Instruction: A User-Centered Dashboard with Conversational AI Support [3.741199946315248]
  Eye-tracking offers rich insights into student cognition and engagement.<n>However, it remains underutilized in classroom-facing educational technology.<n>We present the iterative design and evaluation of a gaze-based learning analytics dashboard for English Language Arts.
  arXiv  Detail & Related papers  (2025-09-03T22:01:14Z)
• Learning Predictive Visuomotor Coordination [25.41320518416861]
  This work introduces a forecasting-based task for visuomotor modeling.<n>The goal is to predict head pose, gaze, and upper-body motion from egocentric visual and kinematic observations.<n>We extend a diffusion-based motion modeling framework that integrates egocentric vision and kinematic sequences.
  arXiv  Detail & Related papers  (2025-03-30T03:46:45Z)
• Visual-Geometric Collaborative Guidance for Affordance Learning [63.038406948791454]
  We propose a visual-geometric collaborative guided affordance learning network that incorporates visual and geometric cues. Our method outperforms the representative models regarding objective metrics and visual quality.
  arXiv  Detail & Related papers  (2024-10-15T07:35:51Z)
• Graph Enhanced Reinforcement Learning for Effective Group Formation in Collaborative Problem Solving [3.392758494801288]
  This study addresses the challenge of forming effective groups in collaborative problem-solving environments. We propose a novel approach leveraging graph theory and reinforcement learning.
  arXiv  Detail & Related papers  (2024-03-15T04:04:40Z)
• Predicting the long-term collective behaviour of fish pairs with deep learning [52.83927369492564]
  This study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results of a state-of-the-art analytical model. We demonstrate that machine learning models social interactions can directly compete with their analytical counterparts in subtle experimental observables.
  arXiv  Detail & Related papers  (2023-02-14T05:25:03Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Visualizing and Understanding Contrastive Learning [22.553990823550784]
  We design visual explanation methods that contribute towards understanding similarity learning tasks from pairs of images. We also adapt existing metrics, used to evaluate visual explanations of image classification systems, to suit pairs of explanations.
  arXiv  Detail & Related papers  (2022-06-20T13:01:46Z)
• Causal Reasoning Meets Visual Representation Learning: A Prospective Study [117.08431221482638]
  Lack of interpretability, robustness, and out-of-distribution generalization are becoming the challenges of the existing visual models. Inspired by the strong inference ability of human-level agents, recent years have witnessed great effort in developing causal reasoning paradigms. This paper aims to provide a comprehensive overview of this emerging field, attract attention, encourage discussions, bring to the forefront the urgency of developing novel causal reasoning methods.
  arXiv  Detail & Related papers  (2022-04-26T02:22:28Z)
• Exploring Visual Engagement Signals for Representation Learning [56.962033268934015]
  We present VisE, a weakly supervised learning approach, which maps social images to pseudo labels derived by clustered engagement signals. We then study how models trained in this way benefit subjective downstream computer vision tasks such as emotion recognition or political bias detection.
  arXiv  Detail & Related papers  (2021-04-15T20:50:40Z)
• Towards a Human-Centred Cognitive Model of Visuospatial Complexity in Everyday Driving [3.480626767752489]
  We develop a human-centred, cognitive model of visuospatial complexity in naturalistic driving conditions. With a focus on visual perception, the model incorporates quantitative, structural, and dynamic attributes identifiable in the chosen context.
  arXiv  Detail & Related papers  (2020-05-29T20:12:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.