Prosocial Norm Emergence in Multiagent Systems
- URL: http://arxiv.org/abs/2012.14581v1
- Date: Tue, 29 Dec 2020 02:59:55 GMT
- Title: Prosocial Norm Emergence in Multiagent Systems
- Authors: Mehdi Mashayekhi and Nirav Ajmeri and George F. List and Munindar P.
Singh
- Abstract summary: We consider a setting where not only the member agents are adaptive but also the multiagent system itself is adaptive.
We focus on prosocial norms, which help achieve positive outcomes for society and often provide guidance to agents to act in a manner that takes into account the welfare of others.
- Score: 14.431260905391138
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Multiagent systems provide a basis of developing systems of autonomous
entities and thus find application in a variety of domains. We consider a
setting where not only the member agents are adaptive but also the multiagent
system itself is adaptive. Specifically, the social structure of a multiagent
system can be reflected in the social norms among its members. It is well
recognized that the norms that arise in society are not always beneficial to
its members. We focus on prosocial norms, which help achieve positive outcomes
for society and often provide guidance to agents to act in a manner that takes
into account the welfare of others.
Specifically, we propose Cha, a framework for the emergence of prosocial
norms. Unlike previous norm emergence approaches, Cha supports continual change
to a system (agents may enter and leave), and dynamism (norms may change when
the environment changes). Importantly, Cha agents incorporate prosocial
decision making based on inequity aversion theory, reflecting an intuition of
guilt from being antisocial. In this manner, Cha brings together two important
themes in prosociality: decision making by individuals and fairness of
system-level outcomes. We demonstrate via simulation that Cha can improve
aggregate societal gains and fairness of outcomes.
Related papers
- SocialGFs: Learning Social Gradient Fields for Multi-Agent Reinforcement Learning [58.84311336011451]
We propose a novel gradient-based state representation for multi-agent reinforcement learning.
We employ denoising score matching to learn the social gradient fields (SocialGFs) from offline samples.
In practice, we integrate SocialGFs into the widely used multi-agent reinforcement learning algorithms, e.g., MAPPO.
arXiv Detail & Related papers (2024-05-03T04:12:19Z) - Emergence of Social Norms in Generative Agent Societies: Principles and Architecture [8.094425852451643]
We propose a novel architecture, named CRSEC, to empower the emergence of social norms within generative MASs.
Our architecture consists of four modules: Creation & Representation, Spreading, Evaluation, and Compliance.
Our experiments demonstrate the capability of our architecture to establish social norms and reduce social conflicts within generative MASs.
arXiv Detail & Related papers (2024-03-13T05:08:10Z) - Learning and Sustaining Shared Normative Systems via Bayesian Rule
Induction in Markov Games [2.307051163951559]
We build learning agents that cooperate flexibly with the human institutions they are embedded in.
By assuming shared norms, a newly introduced agent can infer the norms of an existing population from observations of compliance and violation.
Since agents can bootstrap common knowledge of the norms, this leads the norms to be widely adhered to, enabling new entrants to rapidly learn those norms.
arXiv Detail & Related papers (2024-02-20T21:58:40Z) - Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents [15.315985512420568]
A multiagent system is a society of autonomous agents whose interactions can be regulated via social norms.
We think of these reactions by an agent to the satisfactory or unsatisfactory behaviors of another agent as communications from the first agent to the second agent.
We develop Nest, a framework that models social intelligence via a wider variety of communications and understanding of them than in previous work.
arXiv Detail & Related papers (2024-01-29T11:09:45Z) - Agent Alignment in Evolving Social Norms [65.45423591744434]
We propose an evolutionary framework for agent evolution and alignment, named EvolutionaryAgent.
In an environment where social norms continuously evolve, agents better adapted to the current social norms will have a higher probability of survival and proliferation.
We show that EvolutionaryAgent can align progressively better with the evolving social norms while maintaining its proficiency in general tasks.
arXiv Detail & Related papers (2024-01-09T15:44:44Z) - "One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors [57.63649797577999]
We conduct case studies in which we perturb different types of identity-related language features (names, roles, locations, dialect, and style) in NLG system inputs.
We find that motivations for adaptation include social norms, cultural differences, feature-specific information, and accommodation.
In contrast, motivations for invariance include perspectives that favor prescriptivism, view adaptation as unnecessary or too difficult for NLG systems to do appropriately, and are wary of false assumptions.
arXiv Detail & Related papers (2023-10-23T23:00:34Z) - Learning Roles with Emergent Social Value Orientations [49.16026283952117]
This paper introduces the typical "division of labor or roles" mechanism in human society.
We provide a promising solution for intertemporal social dilemmas (ISD) with social value orientations (SVO)
A novel learning framework, called Learning Roles with Emergent SVOs (RESVO), is proposed to transform the learning of roles into the social value orientation emergence.
arXiv Detail & Related papers (2023-01-31T17:54:09Z) - Social Practices: a Complete Formalization [1.370633147306388]
We present a formalization of a social framework for agents based on the concept of Social Practices.
Social practices facilitate the practical reasoning of agents in standard social interactions.
They also come with a social context that gives handles for social planning and deliberation.
arXiv Detail & Related papers (2022-05-22T09:58:42Z) - Aligning to Social Norms and Values in Interactive Narratives [89.82264844526333]
We focus on creating agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games.
We introduce the GALAD agent that uses the social commonsense knowledge present in specially trained language models to contextually restrict its action space to only those actions that are aligned with socially beneficial values.
arXiv Detail & Related papers (2022-05-04T09:54:33Z) - Noe: Norms Emergence and Robustness Based on Emotions in Multiagent
Systems [0.0]
This paper investigates how modeling emotions affect the emergence and robustness of social norms via social simulation experiments.
We find that an ability in agents to consider emotional responses to the outcomes of norm satisfaction and violation promote norm compliance.
arXiv Detail & Related papers (2021-04-30T14:42:22Z) - Social Chemistry 101: Learning to Reason about Social and Moral Norms [73.23298385380636]
We present Social Chemistry, a new conceptual formalism to study people's everyday social norms and moral judgments.
Social-Chem-101 is a large-scale corpus that catalogs 292k rules-of-thumb.
Our model framework, Neural Norm Transformer, learns and generalizes Social-Chem-101 to successfully reason about previously unseen situations.
arXiv Detail & Related papers (2020-11-01T20:16:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.