Evaluating Rational Contracting in Natural Language

• URL: http://arxiv.org/abs/2608.10475v1
• Date: Tue, 11 Aug 2026 04:44:50 GMT
• Title: Evaluating Rational Contracting in Natural Language
• Abstract summary: We develop a rational framework for how agents should negotiate and perform natural language contracts in uncertain multi-step environments.<n>We instantiate our framework in ContractSim, an evaluation suite where two players negotiate and execute a multi-turn supplier contract.<n>We find that current LLM-based agents reach agreement reliably, and negotiate efficient contracts when environmental uncertainty is low.<n>They are also frequently uncooperative when executing contracts, violating contract terms for additional profit even when contracts are easy to satisfy.
• Score: 21.96106614313801
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The emergence of language-based AI agents promises to transform the scope of machine economic activity. Instead of just proposing bids or following hard-coded protocols, such agents can be used to negotiate and execute agreements in open-ended natural language. However, most evaluations of these abilities have focused on one-off exchanges or simple economic games, leaving open the rich space of time-extended, contingent, and incomplete contracts made expressible by language; they also focus on raw profit, without measuring the qualities required for trustworthy contracting. We address this by formulating a rational framework for how agents should negotiate and perform natural language contracts in uncertain multi-step environments. Within this framework, we develop metrics and baselines for quantifying rational and cooperative play. To evaluate how agents perform at such contracting, we instantiate our framework in ContractSim, an evaluation suite where two players negotiate and execute a multi-turn supplier contract under environmental and inter-player uncertainty. Across six environments and three supplier settings (catering, hotel cleaning, and AI hosting) we find that current LLM-based agents reach agreement reliably, and negotiate efficient contracts when environmental uncertainty is low. However, under high uncertainty, they often fail to negotiate satisfiable, efficient, or mutually beneficial contracts. They are also frequently uncooperative when executing contracts, violating contract terms for additional profit even when contracts are easy to satisfy. These findings highlight room for improvement in the design of language agents that can negotiate, interpret, and execute contracts both rationally and cooperatively.

Related papers

• Commitment To Cooperation With Self-Negotiated Contracts [3.585764648520447]
  We study the role of contract-based cooperation using LLM-based agents in CT, a spatial-temporal game that combines bargaining with navigation towards a goal.<n>We find that self-negotiated contracts can improve cooperative outcomes beyond what is possible with regular trading.
  arXiv  Detail & Related papers  (2026-07-23T11:04:58Z)
• AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactions [49.49718899185783]
  Large language model (LLM)-based agents are increasingly expected to negotiate, coordinate, and transact autonomously.<n>We introduce AgenticPay, a benchmark and simulation framework for multi-agent buyer-seller negotiation driven by natural language.
  arXiv  Detail & Related papers  (2026-02-05T18:50:36Z)
• EQ-Negotiator: Dynamic Emotional Personas Empower Small Language Models for Edge-Deployable Credit Negotiation [66.09161596959771]
  Small language models (SLMs) offer a practical alternative, but suffer from a significant performance gap compared to large language models (LLMs)<n>This paper introduces EQ-Negotiator, a novel framework that bridges this capability gap using emotional personas.<n>We show that a 7B parameter language model with EQ-Negotiator achieves better debt recovery and negotiation efficiency than baseline LLMs more than 10 times its size.
  arXiv  Detail & Related papers  (2025-11-05T11:25:07Z)
• EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiation [61.627248012799704]
  Existing Large Language Models (LLMs) agents largely overlook the functional role of emotions in such negotiations.<n>We present EvoEmo, an evolutionary reinforcement learning framework that optimize dynamic emotional expression in negotiations.
  arXiv  Detail & Related papers  (2025-09-04T15:23:58Z)
• Resource Rational Contractualism Should Guide AI Alignment [69.07915246220985]
  Contractualist alignment proposes grounding decisions in agreements that diverse stakeholders would endorse.<n>We propose Resource-Rationalism: a framework where AI systems approximate the agreements rational parties would form.<n>An RRC-aligned agent would not only operate efficiently, but also be equipped to dynamically adapt to and interpret the ever-changing human social world.
  arXiv  Detail & Related papers  (2025-06-20T18:57:13Z)
• Validation Framework for E-Contract and Smart Contract [0.6312266245317322]
  We propose and develop a framework for validating smart contracts derived from e-contracts.<n>The proposed framework will systematically compare and validate the terms and clauses of the e-contracts with the logic of the smart contracts.<n>This validation confirms that the agreement is accurately translated into executable code.
  arXiv  Detail & Related papers  (2025-04-27T07:23:46Z)
• SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints [59.645885492637845]
  SOPBench is an evaluation pipeline that transforms each service-specific SOP code program into a directed graph of executable functions.<n>Our approach transforms each service-specific SOP code program into a directed graph of executable functions and requires agents to call these functions based on natural language SOP descriptions.<n>We evaluate 18 leading models, and results show the task is challenging even for top-tier models.
  arXiv  Detail & Related papers  (2025-03-11T17:53:02Z)
• Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues [47.977032883078664]
  We develop assistive agents based on Large Language Models (LLMs) that aid interlocutors in business negotiations.<n>A third LLM acts as a remediator agent to rewrite utterances violating norms for improving negotiation outcomes.<n>We provide rich empirical evidence to demonstrate its effectiveness in negotiations across three different negotiation topics.
  arXiv  Detail & Related papers  (2024-01-29T09:07:40Z)
• Gradual Verification for Smart Contracts [0.4543820534430522]
  Algos facilitate secure resource transactions through smart contracts, yet these digital agreements are prone to vulnerabilities. Traditional verification techniques fall short in providing comprehensive security assurances. This paper introduces an incremental approach: gradual verification.
  arXiv  Detail & Related papers  (2023-11-22T12:42:26Z)
• Detecting Logical Relation In Contract Clauses [94.85352502638081]
  We develop an approach to automate the extraction of logical relations between clauses in a contract. The resulting approach should help contract authors detecting potential logical conflicts between clauses.
  arXiv  Detail & Related papers  (2021-11-02T19:26:32Z)
• ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts [39.75232199445175]
  We propose "document-level natural language inference (NLI) for contracts" A system is given a set of hypotheses and a contract, and it is asked to classify whether each hypothesis is "entailed by", "contradicting to" or "not mentioned by" (neutral to) the contract. We release the largest corpus to date consisting of 607 annotated contracts.
  arXiv  Detail & Related papers  (2021-10-05T03:22:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.