ACCORD: Action-Conditioned Contextual Grounding for Language Agents
- URL: http://arxiv.org/abs/2606.16432v1
- Date: Mon, 15 Jun 2026 09:05:55 GMT
- Title: ACCORD: Action-Conditioned Contextual Grounding for Language Agents
- Abstract summary: ACCORD (Action-Conditioned Contextual Grounding) is an agent framework for adaptive grounding.<n>We show that current agents often fail to do so. They act from assumed rather than observed specifics, overlook information they could have gathered, and fail to incorporate evidence that has already been returned.
- Score: 69.73525608707764
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: User instructions are often underspecified because humans rely on implicit assumptions about the surrounding environment. For large language model (LLM) agents operating in information-rich digital and physical environments, these assumptions cannot be inferred from the instruction alone; they must be recovered from the current state of tools, data, interfaces, and observations. Effective execution therefore requires agents to identify missing context, ground it in observed evidence, and carry it forward into subsequent actions. We show that current agents often fail to do so. They act from assumed rather than observed specifics, overlook information they could have gathered, and fail to incorporate evidence that has already been returned. Building on this insight, we propose ACCORD (Action-Conditioned Contextual Grounding), a simple and effective agent framework for adaptive grounding. Before each action, ACCORD actively probes the environment for missing information and integrates relevant context from the agent's trajectory that would otherwise be overlooked. Requiring no additional training or task-success signals, ACCORD improves task-goal completion on AppWorld by up to +20.6 points with GPT-5-mini, from 42.0% to 62.6%, compared to strong baselines. These gains persist with a substantially stronger base model (+10.8 with Claude-4.5-sonnet), an open-weight model (+10.1 with Qwen3.5-27B-FP8), and on the embodied AlfWorld benchmark (+7.4 success rate with GPT-5-mini).
Related papers
- Closing the Consistency Gap: Self-Evolving Agents That Learn to Stay on Course [5.9756241643216255]
Large language model (LLM)-powered agents can be accurate on average yet unreliable in production.<n>We present a self-evolving framework that reduces this gap by identifying unstable, low-consistency steps in agent trajectories.<n>On AppWorld with ReAct/GPT-4.1, our framework raises the fraction of tasks that succeed in all five runs by +16 points on same-task evaluation and +13 points on similar-task generalization.
arXiv Detail & Related papers (2026-09-08T14:53:43Z) - DeltaML-Bench: Evaluating Machine Learning Agents on Real-World Research Repositories [0.5097809301149342]
We introduce DeltaML-Bench, a benchmark comprising 48 tasks sourced from research papers.<n>We evaluate GPT-5 and Claude Sonnet 4 with a standard Modular agent and a search-based ARG scaffolding.<n>In the 4 x 6h allocation, ARG raises GPT-5's per-run success rate from 9.4% to 33.9%; in the 2 x 12h allocation, GPT-5 ARG reaches 49.0%.
arXiv Detail & Related papers (2026-08-20T05:42:39Z) - SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks [73.92333717662558]
SpatialWorld is a benchmark for evaluating the interactive spatial understanding of multimodal agents in complex real-world tasks.<n>It features 760 human-annotated tasks across diverse domains (e.g., household routines, travel, social collaboration)<n>For reliable evaluation, each task includes a human-validated initial state, a reference trajectory, and a terminal-state verifier.
arXiv Detail & Related papers (2026-06-08T15:51:51Z) - PerspectiveGap: A Benchmark for Multi-Agent Orchestration Prompting [6.877973774604102]
PerspectiveGap is a benchmark for evaluating LLMs' ability to compose orchestration prompts for multi-agent systems.<n>In experiments with 27 commercial models from 10 companies, GPT-5.5 substantially outperforms all competitors.
arXiv Detail & Related papers (2026-06-07T23:26:12Z) - Verifier-First Evaluation of Agentic LLMs for Infrastructure-as-Code Generation [0.0]
Infrastructure-as-Code (IaC) generation from natural language requires satisfying provider schemas, dependency planning, and organizational policy constraints.<n>We present a verifier-first empirical study of seven agentic strategies for Terraform generation evaluated on IaC-Eval v2, a modernized 186-task AWS/Terraform benchmark with Rego v1 policies.
arXiv Detail & Related papers (2026-05-29T12:43:27Z) - Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis [68.28714988482703]
Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs)<n>We present a study revealing that general-domain PRMs struggle to supervise data analysis agents.<n>We introduce DataPRM, a novel environment-aware generative process reward model.
arXiv Detail & Related papers (2026-04-27T09:00:30Z) - OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language Environment Simulation [57.505743202759646]
OccuBench is a benchmark covering 100 real-world professional task scenarios across 10 industry categories and 65 specialized domains.<n>Our multi-agent synthesis pipeline automatically produces evaluation instances with guaranteed solvability, calibrated difficulty, and document-grounded diversity.
arXiv Detail & Related papers (2026-04-13T00:27:32Z) - TRACE: Capability-Targeted Agentic Training [11.088296897059157]
We introduce TRACE, an end-to-end system for environment-specific agent self-improvement.<n>TRACE contrasts successful and failed trajectories to identify lacking capabilities.<n>It synthesizes a targeted training environment for each that rewards whether the capability was exercised.<n>It trains a LoRA adapter via RL on each synthetic environment, routing to the relevant adapter at inference.
arXiv Detail & Related papers (2026-04-07T02:22:44Z) - AgentHER: Hindsight Experience Replay for LLM Agent Trajectory Relabeling [12.42698406379544]
AgentHER recovers lost training signal by adapting the Hindsight Experience principle to natural-language agent trajectories.<n>It converts discarded failures into high-quality SFT, DPO, and ShareGPT training data.<n>On WebArena Replay (Zhou et al., 2024) and ToolBench (Qin et al., 2024), AgentHER improves over success-only SFT by +7.1-11.7 pp across four model families.
arXiv Detail & Related papers (2026-03-22T18:36:58Z) - Shoot First, Ask Questions Later? Building Rational Agents that Explore and Act Like People [81.63702981397408]
Given limited resources, to what extent do agents based on language models (LMs) act rationally?<n>We develop methods to benchmark and enhance agentic information-seeking, drawing on insights from human behavior.<n>For Spotter agents, our approach boosts accuracy by up to 14.7% absolute over LM-only baselines; for Captain agents, it raises expected information gain (EIG) by up to 0.227 bits (94.2% of the achievable noise ceiling)
arXiv Detail & Related papers (2025-10-23T17:57:28Z) - OmniEAR: Benchmarking Agent Reasoning in Embodied Tasks [52.87238755666243]
We present OmniEAR, a framework for evaluating how language models reason about physical interactions, tool usage, and multi-agent coordination in embodied tasks.<n>We model continuous physical properties and complex spatial relationships across 1,500 scenarios spanning household and industrial domains.<n>Our systematic evaluation reveals severe performance degradation when models must reason from constraints.
arXiv Detail & Related papers (2025-08-07T17:54:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.