Social Value Orientation and Integral Emotions in Multi-Agent Systems
- URL: http://arxiv.org/abs/2305.05549v1
- Date: Tue, 9 May 2023 15:33:50 GMT
- Title: Social Value Orientation and Integral Emotions in Multi-Agent Systems
- Authors: Daniel Collins, Conor Houghton, Nirav Ajmeri
- Abstract summary: Human social behavior is influenced by individual differences in social preferences.
Social value orientation (SVO) is a measurable personality trait.
Integral emotions, the emotions which arise in direct response to a decision-making scenario, have been linked to temporary shifts in decision-making preferences.
- Score: 1.5469452301122173
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Human social behavior is influenced by individual differences in social
preferences. Social value orientation (SVO) is a measurable personality trait
which indicates the relative importance an individual places on their own and
on others' welfare when making decisions. SVO and other individual difference
variables are strong predictors of human behavior and social outcomes. However,
there are transient changes human behavior associated with emotions that are
not captured by individual differences alone. Integral emotions, the emotions
which arise in direct response to a decision-making scenario, have been linked
to temporary shifts in decision-making preferences.
In this work, we investigated the effects of moderating social preferences
with integral emotions in multi-agent societies. We developed Svoie, a method
for designing agents which make decisions based on established SVO policies, as
well as alternative integral emotion policies in response to task outcomes. We
conducted simulation experiments in a resource-sharing task environment, and
compared societies of Svoie agents with societies of agents with fixed SVO
policies. We find that societies of agents which adapt their behavior through
integral emotions achieved similar collective welfare to societies of agents
with fixed SVO policies, but with significantly reduced inequality between the
welfare of agents with different SVO traits. We observed that by allowing
agents to change their policy in response to task outcomes, agents can moderate
their behavior to achieve greater social equality. \end{abstract}
Related papers
- SocialGFs: Learning Social Gradient Fields for Multi-Agent Reinforcement Learning [58.84311336011451]
We propose a novel gradient-based state representation for multi-agent reinforcement learning.
We employ denoising score matching to learn the social gradient fields (SocialGFs) from offline samples.
In practice, we integrate SocialGFs into the widely used multi-agent reinforcement learning algorithms, e.g., MAPPO.
arXiv Detail & Related papers (2024-05-03T04:12:19Z) - SocialBench: Sociality Evaluation of Role-Playing Conversational Agents [85.6641890712617]
Large language models (LLMs) have advanced the development of various AI conversational agents.
SocialBench is the first benchmark designed to evaluate the sociality of role-playing conversational agents at both individual and group levels.
We find that agents excelling in individual level does not imply their proficiency in group level.
arXiv Detail & Related papers (2024-03-20T15:38:36Z) - Agent Alignment in Evolving Social Norms [65.45423591744434]
We propose an evolutionary framework for agent evolution and alignment, named EvolutionaryAgent.
In an environment where social norms continuously evolve, agents better adapted to the current social norms will have a higher probability of survival and proliferation.
We show that EvolutionaryAgent can align progressively better with the evolving social norms while maintaining its proficiency in general tasks.
arXiv Detail & Related papers (2024-01-09T15:44:44Z) - SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents [107.4138224020773]
We present SOTOPIA, an open-ended environment to simulate complex social interactions between artificial agents and humans.
In our environment, agents role-play and interact under a wide variety of scenarios; they coordinate, collaborate, exchange, and compete with each other to achieve complex social goals.
We find that GPT-4 achieves a significantly lower goal completion rate than humans and struggles to exhibit social commonsense reasoning and strategic communication skills.
arXiv Detail & Related papers (2023-10-18T02:27:01Z) - Heterogeneous Social Value Orientation Leads to Meaningful Diversity in
Sequential Social Dilemmas [15.171556039829161]
Social Value Orientation (SVO) describes an individual's propensity to allocate resources between themself and others.
Prior studies show that groups of agents endowed with heterogeneous SVO learn diverse policies in settings that resemble the incentive structure of Prisoner's dilemma.
We show that these best-response agents learn policies that are conditioned on their co-players, which we posit is the reason for improved zero-shot generalization results.
arXiv Detail & Related papers (2023-05-01T11:09:23Z) - Wearable Sensor-based Multimodal Physiological Responses of Socially
Anxious Individuals across Social Contexts [7.85990334927929]
We present results using passively collected data from a within-subject experiment that assessed physiological response across different social contexts.
Our results suggest that social context is more reliably distinguishable than social phase, group size, or level of social threat, but that there is considerable variability in physiological response patterns even among these distinguishable contexts.
arXiv Detail & Related papers (2023-04-03T18:34:54Z) - Learning Roles with Emergent Social Value Orientations [49.16026283952117]
This paper introduces the typical "division of labor or roles" mechanism in human society.
We provide a promising solution for intertemporal social dilemmas (ISD) with social value orientations (SVO)
A novel learning framework, called Learning Roles with Emergent SVOs (RESVO), is proposed to transform the learning of roles into the social value orientation emergence.
arXiv Detail & Related papers (2023-01-31T17:54:09Z) - Aligning to Social Norms and Values in Interactive Narratives [89.82264844526333]
We focus on creating agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games.
We introduce the GALAD agent that uses the social commonsense knowledge present in specially trained language models to contextually restrict its action space to only those actions that are aligned with socially beneficial values.
arXiv Detail & Related papers (2022-05-04T09:54:33Z) - Prosocial Norm Emergence in Multiagent Systems [14.431260905391138]
We consider a setting where not only the member agents are adaptive but also the multiagent system itself is adaptive.
We focus on prosocial norms, which help achieve positive outcomes for society and often provide guidance to agents to act in a manner that takes into account the welfare of others.
arXiv Detail & Related papers (2020-12-29T02:59:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.