SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Game
- URL: http://arxiv.org/abs/2606.27397v1
- Date: Wed, 24 Jun 2026 10:35:31 GMT
- Title: SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Game
- Abstract summary: We introduce SidConArena, a new benchmark framework for evaluating LLM agents in open-ended, positive-sum bargaining.<n>SidConArena formalizes a multi-player economy as a finite-horizon partially observable game with three coupled phases.<n>We show that stronger frontier models achieve higher economic outcomes, yet agents still misvalue resources, bargain passively, and remain limited in long-horizon investment planning.
- Score: 21.27775046269771
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Evaluating LLM agents requires dynamic environments that go beyond static reasoning and zero-sum games. Real-world economic interaction is often open-ended and mixed-motive: agents must negotiate, create positive-sum surplus, compete for scarce assets, and plan under delayed returns. We introduce SidConArena, a new benchmark framework for evaluating LLM agents in open-ended, positive-sum bargaining. SidConArena formalizes a multi-player economy as a finite-horizon partially observable stochastic game with three coupled phases: natural-language negotiation with binding trades, deterministic converter-based production, and sealed-bid auctions for long-term assets. The framework combines structured observations, phase-aware agent dispatching, a neural-symbolic action interface, and asynchronous execution, enabling free-form interaction while preserving rule-grounded evaluation. Across homogeneous and heterogeneous tournaments, stronger frontier models achieve higher economic outcomes, yet agents still misvalue resources, bargain passively, and remain limited in long-horizon investment planning.
Related papers
- FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agents [39.00852136756911]
Large Language Models (LLMs) are increasingly deployed as autonomous financial agents with explicit behavioral mandates.<n>As market context accumulates over long horizons, these mandates gradually lose their behavioral influence.<n>In crash scenarios, the behavioral gap between static agents and those receiving periodic mandate re-grounding grows 4.4x from the first to the final quarter of the simulation.<n>These findings suggest that reliable long-horizon deployment requires selective, mandate-aware re-grounding based on agent profile and market regime.
arXiv Detail & Related papers (2026-06-30T11:33:29Z) - Cattle Trade: A Multi-Agent Benchmark for LLM Bluffing, Bidding, and Bargaining [0.5691230599672109]
We introduce textscCattle Trade, a benchmark for evaluating large language models (LLMs) as agents in strategic reasoning.<n>The benchmark combines auctions, hidden-offer trade challenges (TCs), bargaining, bluffing, opponent modeling, and resource allocation within a single long-horizon game.<n>We evaluate seven cost-efficient language models and three deterministic code agents across 242 games.
arXiv Detail & Related papers (2026-05-14T08:20:03Z) - TERMS-Bench: Diagnosing LLM Negotiation Agents Beyond Deal Rate [34.67393151003599]
Negotiation is a canonical testbed for agentic language models.<n>Unlike math or code, it has no intrinsic verifier.<n>We introduce Terms-Bench, a Bayesian-game framework that makes the environment itself the verifier.
arXiv Detail & Related papers (2026-05-13T06:22:50Z) - Bridging Values and Behavior: A Hierarchical Framework for Proactive Embodied Agents [26.613956143957548]
textitValuePlanner is a hierarchical cognitive architecture that decouples high-level value scheduling from low-level action execution.<n>Our work offers a structured approach to bridging intrinsic values and grounded behavior for autonomous agents.
arXiv Detail & Related papers (2026-04-30T10:43:55Z) - Training Language Models for Bilateral Trade with Private Information [47.25254982913256]
Bilateral trade demands individual, strategic surplus rationality, and cooperation to realize gains from trade.<n>We develop a structured bargaining environment where large language models negotiate via tool calls within an event-driven simulator.<n>The environment serves two purposes: a benchmark for frontier models and as a training environment for open-weight models via reinforcement learning.
arXiv Detail & Related papers (2026-04-10T03:04:20Z) - Market-Bench: Benchmarking Large Language Models on Economic and Trade Competition [102.73682784993169]
This paper introduces textbfMarket-Bench, a benchmark that evaluates the capabilities of large language models (LLMs) in economically-relevant tasks.<n>We construct a multi-agent supply chain economic model where LLMs act as retailer agents responsible for procuring and retailing merchandise.<n>Market-Bench logs complete trajectories of bids, prices, slogans, sales, and balance-sheet states, enabling automatic evaluation with economic, operational, and semantic metrics.
arXiv Detail & Related papers (2026-04-07T07:23:51Z) - A Benchmark for Multi-Party Negotiation Games from Real Negotiation Data [13.621543549302466]
Multi-party negotiations often unfold as sequences of binding, action-level commitments rather than a single final outcome.<n>We introduce a benchmark for this under-studied regime featuring a game generator that sweeps key structural properties such as incentive alignment, goal complexity, and payoff distribution.<n>We test three value-function approximations - myopic reward, an optimistic upper bound, and a pessimistic lower bound - that act as biased lenses on deal evaluation.
arXiv Detail & Related papers (2026-03-14T18:12:06Z) - Breaking User-Centric Agency: A Tri-Party Framework for Agent-Based Recommendation [59.362016745945375]
We propose the first Tri-party LLM-agent Recommendation framework (TriRec)<n>TriRec explicitly coordinates user utility, item exposure, and platform-level fairness.<n>We show consistent gains in accuracy, fairness, and item-level utility.
arXiv Detail & Related papers (2026-03-11T11:40:13Z) - Socially-Weighted Alignment: A Game-Theoretic Framework for Multi-Agent LLM Systems [17.658093330392052]
We propose a game-theoretic framework that modifies inference-time decision making by interpolating between an agent's private objective and an estimate of group welfare.<n>We show that SWA induces a critical threshold $*=(n-)/(n-1)$ above which agents no longer have marginal incentive to increase demand under overload.
arXiv Detail & Related papers (2026-02-16T05:17:58Z) - EcoGym: Evaluating LLMs for Long-Horizon Plan-and-Execute in Interactive Economies [61.267836443398124]
We introduce EcoGym, a benchmark for continuous plan-and-execute decision making in interactive economies.<n>EcoGym is released as an open, testbed for transparent long-horizonity agent evaluation and for studying controllability-utility trade-offs in realistic economic settings.
arXiv Detail & Related papers (2026-02-10T08:12:23Z) - EQ-Negotiator: Dynamic Emotional Personas Empower Small Language Models for Edge-Deployable Credit Negotiation [66.09161596959771]
Small language models (SLMs) offer a practical alternative, but suffer from a significant performance gap compared to large language models (LLMs)<n>This paper introduces EQ-Negotiator, a novel framework that bridges this capability gap using emotional personas.<n>We show that a 7B parameter language model with EQ-Negotiator achieves better debt recovery and negotiation efficiency than baseline LLMs more than 10 times its size.
arXiv Detail & Related papers (2025-11-05T11:25:07Z) - EmoDebt: Bayesian-Optimized Emotional Intelligence for Strategic Agent-to-Agent Debt Recovery [65.30120701878582]
Large Language Model (LLM) agents are vulnerable to exploitation in emotion-sensitive domains like debt collection.<n>EmoDebt is an emotional intelligence engine that reframes a model's ability to express emotion in negotiation as a sequential decision-making problem.<n>EmoDebt achieves significant strategic robustness, substantially outperforming non-adaptive and emotion-agnostic baselines.
arXiv Detail & Related papers (2025-03-27T01:41:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.