Gaze-Anchored Social Net: Decoding Implicit Relations via Joint Modeling

• URL: http://arxiv.org/abs/2607.22847v1
• Date: Fri, 24 Jul 2026 18:39:14 GMT
• Title: Gaze-Anchored Social Net: Decoding Implicit Relations via Joint Modeling
• Abstract summary: We propose ANCHOR, a target-centric paradigm designed to decode gaze-anchored social intent.<n>Our approach surfaces these dependencies as the latent structural scaffolding of gaze behavior.<n>We validate our framework on an extended benchmark featuring dense multi-person annotations and novel social influence rankings.
• Score: 42.54041031276457
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Human gaze does more than point to visual targets; it serves as a subtle indicator of social intent within static images, whereas standard models typically process individuals independently, treating gaze as an i.i.d. quantity or predicting social semantics in isolation. Recent multi-person methods attempt to address this but often treat social relations as rigid, post-hoc classifications decoupled from the gaze estimation process. This oversimplification fails to capture the nuanced nature of social intent, which acts as an underlying driver of gaze behavior rather than a secondary categorical output. We address these limitations by proposing ANCHOR, a target-centric paradigm designed to decode gaze-anchored social intent by modeling the joint distribution of visual attention and latent implicit relations. Our approach surfaces these dependencies as the latent structural scaffolding of gaze behavior. The architecture utilizes a relational attention mechanism to capture fine-grained interpersonal links, leveraging feature-wise modulation for efficient multi-person parsing from a single vision backbone. To stabilize the training of this coupled formulation, we implement an optimization synergy to resolve the inherent conflicts between spatial gaze accuracy and latent social reasoning. This approach ensures robust generalization by seeking stable, flat minima while simultaneously harmonizing competing task gradients. We validate our framework on an extended benchmark featuring dense multi-person annotations and novel social influence rankings. Our results demonstrate state-of-the-art performance and provide the first quantitative evidence that implicit social hierarchies can be robustly disentangled and learned directly from static gaze patterns.

Related papers

• Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis [55.78822230833247]
  We present Inter-X++, a comprehensive and large-scale benchmark designed to empower versatile HHI analysis.<n>Inter-X++ provides 11,388 high-fidelity interaction sequences and over 8.1M frames, featuring precise whole-body movements and detailed finger articulations.<n>We propose OpenHHI, a single and unified HHI representation and modeling framework that jointly optimize interaction reconstruction and semantic understanding.
  arXiv  Detail & Related papers  (2026-08-20T17:51:48Z)
• ST-DiffEye: Diffusion-based Continuous Gaze Generation via Joint Scanpath-Trajectory Modeling [36.51837241351688]
  We study the problem of human gaze modeling, which aims to generate gaze patterns a viewer produces while observing a visual stimulus.<n>Because gaze varies substantially across viewers and trials, we treat this variability as a defining property rather than noise and model gaze as a generative process.<n>We introduce ST-DiffEye, a joint trajectory-scanpath diffusion framework that couples both modalities by concatenating them as an additional raw input channel.
  arXiv  Detail & Related papers  (2026-06-13T21:56:08Z)
• Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models [81.44955493339835]
  Social-Mamba is a forecasting architecture that reformulates social interactions as structured sequential processes.<n>Social-Mamba organizes agents on an egocentric grid and introduces social triplet factorization.<n>Experiments on five trajectory forecasting benchmarks show that Social-Mamba achieves state-of-the-art accuracy.
  arXiv  Detail & Related papers  (2026-05-14T21:16:01Z)
• SODE: Analyzing Social Dynamics in LLM Agents [17.885513252130373]
  We introduce SODE (Social Dynamics Evaluation), a framework that evaluates AI agents across three evolutionary dimensions.<n>Applying SODE reveals systematic divergences.<n>We demonstrate that a "long-horizon framing" can unlock reciprocal capabilities in reasoning models.
  arXiv  Detail & Related papers  (2026-05-06T14:50:07Z)
• SocialMirror: Reconstructing 3D Human Interaction Behaviors from Monocular Videos with Semantic and Geometric Guidance [49.69016078147708]
  Accurately reconstructing human behavior in close-interaction scenarios is crucial for enabling realistic virtual interactions in augmented reality.<n>We propose SocialMirror, a diffusion-based framework that integrates semantic and geometric cues to effectively address these issues.<n>SocialMirror achieves state-of-the-art performance in reconstructing interactive human meshes, demonstrating strong generalization across unseen datasets and in-the-wild scenarios.
  arXiv  Detail & Related papers  (2026-04-15T07:41:52Z)
• LLM-MC-Affect: LLM-Based Monte Carlo Modeling of Affective Trajectories and Latent Ambiguity for Interpersonal Dynamic Insight [1.1119672724275114]
  Emotional coordination is a core property of human interaction that shapes how meaning is constructed in real time.<n>We introduce a probabilistic framework that characterizes emotion not as a static label, but as a continuous latent probability distribution.<n>This work establishes a scalable and deployable pathway for understanding interpersonal dynamics, offering a generalizable solution.
  arXiv  Detail & Related papers  (2026-01-07T06:50:41Z)
• Part-Aware Bottom-Up Group Reasoning for Fine-Grained Social Interaction Detection [82.70752567211251]
  We propose a part-aware bottom-up group reasoning framework for fine-grained social interaction detection.<n>The proposed method infers social groups and their interactions using body part features and their interpersonal relations.<n>Our model first detects individuals and enhances their features using part-aware cues, and then infers group configuration by associating individuals via similarity-based reasoning.
  arXiv  Detail & Related papers  (2025-11-05T17:33:03Z)
• Causal Spherical Hypergraph Networks for Modelling Social Uncertainty [3.0181801777983086]
  We propose Causal Spherical Hypergraph Networks (Causal-SphHN), a principled framework for socially grounded prediction.<n>Our method represents individuals as hyperspherical embeddings and group contexts as hyperedges, capturing semantic and relational geometry.<n>Experiments on SNARE (offline networks), PHEME (online discourse), and AMIGOS (multimodal affect) show that Causal-SphHN improves predictive accuracy, robustness, and calibration over strong baselines.
  arXiv  Detail & Related papers  (2025-06-21T22:30:04Z)
• Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation [50.01551945190676]
  Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. We propose a systematic relational reasoning approach with explicit inference of the underlying dynamically evolving relational structures. We demonstrate its effectiveness for multi-agent trajectory prediction and social robot navigation.
  arXiv  Detail & Related papers  (2024-01-22T18:58:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.