Strategic Shaping of Human Prosociality: A Latent-State POMDP Framework

• URL: http://arxiv.org/abs/2603.02379v1
• Date: Mon, 02 Mar 2026 20:47:54 GMT
• Title: Strategic Shaping of Human Prosociality: A Latent-State POMDP Framework
• Abstract summary: We propose a decision-theoretic framework in which a robot strategically can shape inferred human's prosocial state during repeated interactions.<n>We formalize this as a latent-state POMDP with limited observations and learn the transition and observation dynamics using expectation.<n>The resulting belief-based policy balances task and social objectives, selecting actions that maximize long-term cooperative outcomes.
• Score: 7.7861151179406605
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We propose a decision-theoretic framework in which a robot strategically can shape inferred human's prosocial state during repeated interactions. Modeling the human's prosociality as a latent state that evolves over time, the robot learns to infer and influence this state through its own actions, including helping and signaling. We formalize this as a latent-state POMDP with limited observations and learn the transition and observation dynamics using expectation maximization. The resulting belief-based policy balances task and social objectives, selecting actions that maximize long-term cooperative outcomes. We evaluate the model using data from user studies and show that the learned policy outperforms baseline strategies in both team performance and increasing observed human cooperative behavior.

Related papers

• SocialRL: Refining LLMs' Social Intelligence through Multi-turn Reinforcement Learning and Reward Design [52.69818441707104]
  Social intelligence enables agents to read social context, infer intent, and adapt over sustained dialogue.<n>Existing reinforcement learning methods optimize single-turn utterances and sparse outcome rewards.<n>We propose SocialRL, a multi-turn reinforcement learning framework addressing both challenges.
  arXiv  Detail & Related papers  (2026-09-09T06:06:34Z)
• Robots Influencing Humans to Reveal their Goals during Collaboration and Competition [0.7157957528875097]
  We propose a unified strategy for fast goal inference in human-robot interaction.<n>We formalise CDPs using a goal-conditioned policy divergence measure and incorporate them into a Receding-Horizon Planner.<n>We evaluate this approach in both a collaborative, fully observable cooking task and a competitive, partially observable hide-and-seek game.
  arXiv  Detail & Related papers  (2026-08-31T17:33:04Z)
• HRIBench: Benchmarking Interaction-Centric Human-Robot Collaboration [62.19372189311434]
  We introduce HRIBench, a diagnostic benchmark for intent-aware human-robot collaboration based on executable scenarios.<n>HRIBench represents collaborative tasks as structured scenario scripts that explicitly model agent roles, temporal dependencies, coordination constraints, and human behavior distributions.<n>Results show that current foundation robot policies struggle substantially in collaborative settings despite strong manipulation ability.
  arXiv  Detail & Related papers  (2026-07-05T09:15:35Z)
• SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLA [7.574275066394319]
  Vision-Language-Action (VLA) policies can be brittle under out-of-distribution spatial and semantic perturbations.<n>We introduce Shared Autonomy for Policy Steering (SAPS), a framework that blends real-time human teleoperation commands with pretrained policy actions at the action level.<n> SAPS requires no policy retraining, auxiliary dynamics models, or architectural modifications.
  arXiv  Detail & Related papers  (2026-06-14T03:09:30Z)
• SODE: Analyzing Social Dynamics in LLM Agents [17.885513252130373]
  We introduce SODE (Social Dynamics Evaluation), a framework that evaluates AI agents across three evolutionary dimensions.<n>Applying SODE reveals systematic divergences.<n>We demonstrate that a "long-horizon framing" can unlock reciprocal capabilities in reasoning models.
  arXiv  Detail & Related papers  (2026-05-06T14:50:07Z)
• Joint Prediction of Human Motions and Actions in Human-Robot Collaboration [81.20389836121502]
  We introduce textsfMA-HERP, a hierarchical framework for the emphjoint estimation and prediction of human movements and actions.<n>We present a preliminary experimental evaluation based on musculoskeletal simulations of reaching movements, showing accurate motion prediction and robust action inference under noise.
  arXiv  Detail & Related papers  (2026-04-03T14:40:07Z)
• DynamiX: Large-Scale Dynamic Social Network Simulator [101.65679342680542]
  DynamiX is a novel large-scale social network simulator dedicated to dynamic social network modeling.<n>For opinion leaders, we propose an information-stream-based link prediction method recommending potential users with similar stances.<n>For ordinary users, we construct an inequality-oriented behavior decision-making module.
  arXiv  Detail & Related papers  (2025-07-26T12:13:30Z)
• How large language models judge and influence human cooperation [82.07571393247476]
  We assess how state-of-the-art language models judge cooperative actions.<n>We observe a remarkable agreement in evaluating cooperation against good opponents.<n>We show that the differences revealed between models can significantly impact the prevalence of cooperation.
  arXiv  Detail & Related papers  (2025-06-30T09:14:42Z)
• Latent Adaptive Planner for Dynamic Manipulation [43.959104380268066]
  Latent Adaptive Planner (LAP) is a trajectory-level latent-variable policy for dynamic nonprehensile manipulation.<n>LAP formulates planning as inference in a low-dimensional latent space and is learned effectively from human demonstration videos.
  arXiv  Detail & Related papers  (2025-05-06T00:09:09Z)
• A Grounded Observer Framework for Establishing Guardrails for Foundation Models in Socially Sensitive Domains [1.9116784879310025]
  Given the complexities of foundation models, traditional techniques for constraining agent behavior cannot be directly applied.<n>We propose a grounded observer framework for constraining foundation model behavior that offers both behavioral guarantees and real-time variability.
  arXiv  Detail & Related papers  (2024-12-23T22:57:05Z)
• Learning Goal-oriented Bimanual Dough Rolling Using Dynamic Heterogeneous Graph Based on Human Demonstration [19.74767906744719]
  Soft object manipulation poses significant challenges for robots, requiring effective techniques for state representation and manipulation policy learning. This research paper introduces a novel approach: a dynamic heterogeneous graph-based model for learning goal-oriented soft object manipulation policies.
  arXiv  Detail & Related papers  (2024-10-15T16:12:00Z)
• Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation [50.01551945190676]
  Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. We propose a systematic relational reasoning approach with explicit inference of the underlying dynamically evolving relational structures. We demonstrate its effectiveness for multi-agent trajectory prediction and social robot navigation.
  arXiv  Detail & Related papers  (2024-01-22T18:58:22Z)
• Social Motion Prediction with Cognitive Hierarchies [19.71780279070757]
  We introduce a new benchmark, a novel formulation, and a cognition-inspired framework. We present Wusi, a 3D multi-person motion dataset under the context of team sports. We develop a cognitive hierarchy framework to predict strategic human social interactions.
  arXiv  Detail & Related papers  (2023-11-08T14:51:17Z)
• Training Socially Aligned Language Models on Simulated Social Interactions [99.39979111807388]
  Social alignment in AI systems aims to ensure that these models behave according to established societal values. Current language models (LMs) are trained to rigidly replicate their training corpus in isolation. This work presents a novel training paradigm that permits LMs to learn from simulated social interactions.
  arXiv  Detail & Related papers  (2023-05-26T14:17:36Z)
• Predicting the long-term collective behaviour of fish pairs with deep learning [52.83927369492564]
  This study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results of a state-of-the-art analytical model. We demonstrate that machine learning models social interactions can directly compete with their analytical counterparts in subtle experimental observables.
  arXiv  Detail & Related papers  (2023-02-14T05:25:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.