The Conversations Beneath the Code: Triadic Data for Long-Horizon Software Engineering Agents

• URL: http://arxiv.org/abs/2605.02244v1
• Date: Mon, 04 May 2026 05:37:36 GMT
• Title: The Conversations Beneath the Code: Triadic Data for Long-Horizon Software Engineering Agents
• Abstract summary: We argue that the canonical instantiation of triadic data is two complementary products: long-horizon expert trajectories captured under stimulated-recall protocols, and simulated cross-functional companies.<n>We argue that this data is capturable in 12-18 months with methods already mature in adjacent fields.
• Score: 1.9097591729497536
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Frontier software engineering agents have saturated short-horizon benchmarks while regressing on the work that constitutes senior engineering: long-horizon, multi-engineer, ambiguous-specification deliverables. This paper takes a position on what training data is needed to close the gap. The substrate for the next generation of SWE agents is neither larger GitHub scrapes nor more solo-agent trajectories nor -- sufficient by itself -- open human-AI dialogue logs. It is triadic data: synchronized capture of the human-human conversations where engineering context is formed, the human-AI sessions where that context is partially consumed, and the multi-week cross-functional work that surrounds both. We argue that the canonical instantiation of triadic data is two complementary products: long-horizon expert trajectories captured under stimulated-recall protocols, and simulated cross-functional companies -- instrumented teams of senior engineers, product managers, designers, and data scientists working through ambiguous deliverables on shared infrastructure. We further specify a four-tier evidence framework through which any such corpus -- triadic or otherwise -- must justify its quality to a fine-tuning researcher: mechanical verification, statistical corpus characterization, probe experiments, and pre-registered blind evaluation. We argue that this data is capturable in 12-18 months with methods already mature in adjacent fields, that it is the empirical key to four open questions in agent training, and that the field's near-term research agenda should include it explicitly.

Related papers

• SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery [48.99744520105086]
  SciForge is a multimodal research-native AI workbench.<n>It reserves the graphical interface for human judgment while search, parsing, model routing, workflow execution, plotting, writing, and presentation generation run as modular agent-accessible services.
  arXiv  Detail & Related papers  (2026-07-17T15:13:03Z)
• An Agentic AI Framework to Accelerate Scientific Discovery in Plant Phenotyping [0.0]
  We present an end-to-end agentic AI framework that turns a data factory into an interactive discovery platform.<n>A conversational Co-Scientist Agent translates a scientist's natural-language question into a structured analysis plan.<n>A headless Compute Agent dispatches Vision Transformer segmentation and trait extraction on the Frontier exascale supercomputer.
  arXiv  Detail & Related papers  (2026-06-30T15:37:02Z)
• DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning [58.09293442211248]
  Deep Research (DR) has emerged as a new agentic paradigm to tackle complex, open-ended research tasks.<n>This report presents DuMate-DeepResearch, a multi-agent DR framework built on the Qianfan Agent Foundry.
  arXiv  Detail & Related papers  (2026-06-05T14:10:48Z)
• GENESIS: Harnessing AI Agents for Autonomous 6G RAN Synthesis, Research, and Testing [13.436656977622691]
  Large Language Models (LLMs) have compressed comparable R&D work in general software engineering from days to minutes.<n>We present GENESIS, an agentic Artificial Intelligence (AI) framework that converts intents into solutions validated with over-the-air experiments.
  arXiv  Detail & Related papers  (2026-05-26T17:58:43Z)
• QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks [38.454776684977496]
  QUEST is a family of open models designed to handle a wide range of long-horizon search tasks.<n>We propose an effective training recipe combining mid-training, supervised fine-tuning, and reinforcement learning.<n>QUEST incorporates a built-in context management mechanism that enables effective long-horizon reasoning and knowledge synthesis.
  arXiv  Detail & Related papers  (2026-05-22T20:59:20Z)
• BiCoord: A Bimanual Manipulation Benchmark towards Long-Horizon Spatial-Temporal Coordination [20.953323366922266]
  BiCoord is a benchmark for long-horizon and tightly coordinated bimanual manipulation.<n>Specifically, BiCoord comprises diverse tasks that require continuous inter-arm dependency and dynamic role exchange.<n>Results show that representative manipulation policies struggle with long-duration and highly coupled tasks.
  arXiv  Detail & Related papers  (2026-04-07T13:02:17Z)
• MITRA: An AI Assistant for Knowledge Retrieval in Physics Collaborations [0.0]
  Large-scale scientific collaborations produce a vast and ever-growing corpus of internal documentation.<n>We present a prototype of MITRA, a Retrieval-Augmented Generation (RAG) based system, designed to answer specific, context-aware questions about physics analyses.<n>MITRA employs a novel, automated pipeline using Selenium for document retrieval from internal databases and Optical Character Recognition (OCR) with layout parsing for high-fidelity text extraction.
  arXiv  Detail & Related papers  (2026-03-10T15:28:35Z)
• AgentIR: Reasoning-Aware Retrieval for Deep Research Agents [76.29382561831105]
  Deep Research agents generate explicit natural language reasoning before each search call.<n> Reasoning-Aware Retrieval embeds the agent's reasoning trace alongside its query.<n>DR- Synth generates Deep Research retriever training data from standard QA datasets.<n>AgentIR-4B achieves 68% accuracy with the open-weight agent Tongyi-DeepResearch.
  arXiv  Detail & Related papers  (2026-03-04T18:47:26Z)
• What's the next frontier for Data-centric AI? Data Savvy Agents [71.76058707995398]
  We argue that data-savvy capabilities should be a top priority in the design of agentic systems.<n>We propose four key capabilities to realize this vision: Proactive data acquisition, Sophisticated data processing, Interactive test data synthesis, and Continual adaptation.
  arXiv  Detail & Related papers  (2025-11-02T17:09:29Z)
• Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents [85.02904078131682]
  We introduce the agent data protocol (ADP), a light-weight representation language that serves as an "interlingua" between agent datasets.<n> ADP is expressive enough to capture a large variety of tasks, including API/tool use, browsing, coding, software engineering, and general agentic.<n>All code and data are released publicly, in the hope that ADP could help lower the barrier to standardized, scalable, and reproducible agent training.
  arXiv  Detail & Related papers  (2025-10-28T17:53:13Z)
• UltraHorizon: Benchmarking Agent Capabilities in Ultra Long-Horizon Scenarios [63.67884284105684]
  We introduce textbfUltraHorizon, a novel benchmark that measures the foundational capabilities essential for complex real-world challenges.<n>Agents are designed in long-horizon discovery tasks where they must iteratively uncover hidden rules.<n>Our experiments reveal that LLM-agents consistently underperform in these settings, whereas human participants achieve higher scores.
  arXiv  Detail & Related papers  (2025-09-26T02:04:00Z)
• COVERED, CollabOratiVE Robot Environment Dataset for 3D Semantic segmentation [39.64058995273062]
  This work develops a new dataset specifically designed for this use case, named "COVERED" We provide a benchmark of current state-of-the-art (SOTA) algorithm performance on the dataset and demonstrate a real-time semantic segmentation of a collaborative robot workspace using a multi-LiDAR system. Our perception pipeline achieves 20Hz throughput with a prediction point accuracy of $>$96% and $>$92% mean intersection over union (mIOU) while maintaining an 8Hz throughput.
  arXiv  Detail & Related papers  (2023-02-24T14:24:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.