Integrating upstream and downstream reciprocity stabilizes cooperator-defector coexistence in N-player giving games
- URL: http://arxiv.org/abs/2509.04743v1
- Date: Fri, 05 Sep 2025 01:49:26 GMT
- Title: Integrating upstream and downstream reciprocity stabilizes cooperator-defector coexistence in N-player giving games
- Authors: Tatsuya Sasaki, Satoshi Uchida, Isamu Okada, Hitoshi Yamamoto, Yutaka Nakai,
- Abstract summary: We show how pay-it-forward chains and reputation systems can jointly maintain social including cooperation despite cognitive limitations and group size challenges.<n>This framework demonstrates how pay-it-forward chains and reputation systems can jointly maintain social including cooperation despite cognitive limitations and group size challenges.
- Score: 1.1381558444077822
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human cooperation persists among strangers despite theoretical predictions of difficulties in large, well-mixed populations, leaving a fundamental evolutionary puzzle. While upstream (pay-it-forward: helping others because you were helped) and downstream (rewarding-reputation: helping those with good reputations) indirect reciprocity have been independently considered as solutions, their joint dynamics in multiplayer contexts remain unexplored. We study N-player giving games with benefit b and cost c and analyze evolutionary dynamics for three strategies: unconditional cooperation (X), unconditional defection (Y), and an integrated reciprocal strategy (Z) combining unconditional forwarding with reputation-based discrimination. We show that integrating upstream and downstream reciprocity can yield a globally asymptotically stable mixed equilibrium of unconditional defectors and integrated reciprocators whenever the benefit-to-cost ratio exceeds a threshold (b/c > 2). Counterintuitively, introducing small complexity costs, rather than destabilizing, stabilizes the equilibrium by preventing not only unconditional cooperators (viewed as second-order freeloaders) but also alternative conditional strategies from invading. While the equilibrium frequency of integrated reciprocators decreases with group size N, it remains positive for any finite N. Rather than requiring uniformity, our model reveals one pathway to stable cooperation through strategic diversity. Defectors serve as "evolutionary shields" preventing system collapse while integrated reciprocators flexibly combine open and discriminative responses. This framework demonstrates how pay-it-forward chains and reputation systems can jointly maintain social polymorphism including cooperation despite cognitive limitations and group size challenges, offering a potential evolutionary foundation for behavioral diversity in human societies.
Related papers
- Fairness over Equality: Correcting Social Incentives in Asymmetric Sequential Social Dilemmas [14.346045345458416]
Sequential Social Dilemmas (SSDs) provide a key framework for studying how cooperation emerges when individual incentives conflict with collective welfare.<n>Most existing methods assume that agents face identical incentives in the dilemma and require continuous access to global information about other agents to assess fairness.<n>We introduce asymmetric variants of well-known SSD environments and examine how natural differences between agents influence cooperation dynamics.
arXiv Detail & Related papers (2026-02-17T07:31:20Z) - The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societies [57.387081435669835]
Multi-agent systems built from large language models offer a promising paradigm for scalable collective intelligence and self-evolution.<n>We show that an agent society satisfying continuous self-evolution, complete isolation, and safety invariance is impossible.<n>We propose several solution directions to alleviate the identified safety concern.
arXiv Detail & Related papers (2026-02-10T15:18:19Z) - Toward a Sustainable Federated Learning Ecosystem: A Practical Least Core Mechanism for Payoff Allocation [71.86087908416255]
We introduce a payoff allocation framework based on the least core (LC) concept.<n>Unlike traditional methods, the LC prioritizes the cohesion of the federation by minimizing the maximum dissatisfaction.<n>Case studies in federated intrusion detection demonstrate that our mechanism correctly identifies pivotal contributors and strategic alliances.
arXiv Detail & Related papers (2026-02-03T11:10:50Z) - Integrated strong reciprocity enables productive punishment and protective defection [1.4323566945483497]
We analyze an evolutionary game model that integrates upstream and downstream reciprocity with costly punishment.<n>We demonstrate that ISR admits a stable mixed equilibrium of ISR and unconditional defection.<n>At the same time, the mixed equilibrium of ISR and ALLD remains robust under modest complexity.
arXiv Detail & Related papers (2026-01-07T08:03:49Z) - Decentralized Dynamic Cooperation of Personalized Models for Federated Continual Learning [50.56947843548702]
We propose a decentralized dynamic cooperation framework for Federated continual learning.<n>Clients establish dynamic cooperative learning coalitions to balance the acquisition of new knowledge and the retention of prior learning.<n>We also propose a merge-blocking algorithm and a dynamic cooperative evolution algorithm to achieve cooperative and dynamic equilibrium.
arXiv Detail & Related papers (2025-09-28T06:53:23Z) - Learning to Balance Altruism and Self-interest Based on Empathy in Mixed-Motive Games [47.8980880888222]
Multi-agent scenarios often involve mixed motives, demanding altruistic agents capable of self-protection against potential exploitation.<n>We propose LASE Learning to balance Altruism and Self-interest based on Empathy.<n>LASE allocates a portion of its rewards to co-players as gifts, with this allocation adapting dynamically based on the social relationship.
arXiv Detail & Related papers (2024-10-10T12:30:56Z) - On Tractable $Φ$-Equilibria in Non-Concave Games [53.212133025684224]
We study tractable $Phi$-equilibria in non-concave games.<n>We show that when $Phi$ is finite, there exists an efficient uncoupled learning algorithm that converges to the corresponding $Phi$-equilibria.
arXiv Detail & Related papers (2024-03-13T01:51:30Z) - The evolution of cooperation and diversity by integrated indirect
reciprocity [1.6481854696778462]
Indirect reciprocity is one of the major mechanisms for the evolution of cooperation in human societies.
We propose a new model that integrates upstream and downstream reciprocity.
We show that the model can result in the stable coexistence of altruistic reciprocators and free riders in well-mixed populations.
arXiv Detail & Related papers (2023-03-08T09:37:16Z) - Tackling Asymmetric and Circular Sequential Social Dilemmas with
Reinforcement Learning and Graph-based Tit-for-Tat [0.0]
Social dilemmas offer situations where multiple actors should all cooperate to achieve the best outcome but greed and fear lead to a worst self-interested issue.
Recently, the emergence of Deep Reinforcement Learning has generated revived interest in social dilemmas with the introduction of Sequential Social Dilemma (SSD)
This paper extends SSD with Circular Sequential Social Dilemma (CSSD), a new kind of Markov games that better generalizes the diversity of cooperation between agents.
arXiv Detail & Related papers (2022-06-26T15:42:48Z) - Learning Collective Action under Risk Diversity [68.88688248278102]
We investigate the consequences of risk diversity in groups of agents learning to play collective risk dilemmas.
We show that risk diversity significantly reduces overall cooperation and hinders collective target achievement.
Our results highlight the need for aligning risk perceptions among agents or develop new learning techniques.
arXiv Detail & Related papers (2022-01-30T18:21:21Z) - Distributed Adaptive Learning Under Communication Constraints [54.22472738551687]
This work examines adaptive distributed learning strategies designed to operate under communication constraints.
We consider a network of agents that must solve an online optimization problem from continual observation of streaming data.
arXiv Detail & Related papers (2021-12-03T19:23:48Z) - Balancing Rational and Other-Regarding Preferences in
Cooperative-Competitive Environments [4.705291741591329]
Mixed environments are notorious for the conflicts of selfish and social interests.
We propose BAROCCO to balance individual and social incentives.
Our meta-algorithm is compatible with both Q-learning and Actor-Critic frameworks.
arXiv Detail & Related papers (2021-02-24T14:35:32Z) - Coordinated Online Learning for Multi-Agent Systems with Coupled
Constraints and Perturbed Utility Observations [91.02019381927236]
We introduce a novel method to steer the agents toward a stable population state, fulfilling the given resource constraints.
The proposed method is a decentralized resource pricing method based on the resource loads resulting from the augmentation of the game's Lagrangian.
arXiv Detail & Related papers (2020-10-21T10:11:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.