DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines

• URL: http://arxiv.org/abs/2607.16617v2
• Date: Fri, 24 Jul 2026 08:50:49 GMT
• Title: DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines
• Abstract summary: We introduce textscDataFlow-Harness, a platform that guides an LLM agent to construct platform-native directed acyclic graphs.<n>On a 12-task data-engineering benchmark, textscDataFlow-Harness achieves a 93.3% observed end-to-end pass rate.
• Score: 9.38656029481013
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language models (LLMs) are increasingly used to automate data-processing workflows, yet coding agents typically produce scripts that are not automatically materialized as persistent, editable platform artifacts. We call this disconnect the \textit{NL2Pipeline gap}. To bridge it, we introduce \textsc{DataFlow-Harness}, a platform that guides an LLM agent to construct platform-native directed acyclic graphs (DAGs) through typed, incremental mutations rather than free-form scripts. The platform combines \textsc{DataFlow-Skills} for procedural guidance, a Model Context Protocol (MCP) layer that exposes the live operator registry and current pipeline state, and \textsc{DataFlow-WebUI}, which synchronizes conversational authoring with a visual DAG editor. On a 12-task data-engineering benchmark, \textsc{DataFlow-Harness} achieves a 93.3\% observed end-to-end pass rate. Relative to Vanilla Claude Code, it reduces measured monetary cost by 72.5\% and generation latency by 49.9\%; its observed pass rate is within 0.9 percentage points of the Context-Aware Claude Code baseline while its cost is 42.8\% lower. Per-task analysis indicates that Skills are most useful when construction depends on implicit procedural knowledge. These results show that live platform grounding can produce persistent, editable workflow artifacts with an observed reliability close to script-generation baselines and with lower measured construction cost and latency.

Related papers

• TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference [47.62941623025392]
  We present TELLER, a non-intrusive and Log-aware LLM inference Root-cause analysis framework.<n>TELLER collects NVTX/CUPTI traces and service logs without modifying model binaries.<n>It reconstructs per-request call-chain trees and aligns log lines with corresponding execution steps.<n>On top of these representations, TELLER combines numeric candidate localization with a multimodal root-cause model.
  arXiv  Detail & Related papers  (2026-08-03T09:39:11Z)
• AiFlow: Token-Native Reactive Orchestration with Bounded Backpressure for Streaming LLM Applications [0.0]
  This paper presents AiFlow, a tokennative reactive orchestration model that normalizes provider deltas into typed ContextT> events.<n>AiFlow does not alter provider-side TTFT but reduces Application TTFPT by 70.9-94.7% versus aggregation and keeps runtime-owned queue depth within declared bounds.
  arXiv  Detail & Related papers  (2026-08-01T09:33:29Z)
• FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction [43.791981476558384]
  Data preparation pipelines improve data quality in machine learning by transforming raw tables into learning-ready data.<n>Existing state-of-the-art (SOTA) Multi-DQN methods face three key limitations.<n>We propose FlowPipe, a unified framework that formulates pipeline synthesis as conditional probabilistic flow generation over a directed acyclic graph.
  arXiv  Detail & Related papers  (2026-06-23T15:10:00Z)
• DataClaw0: Agentic Tailoring Multimodal Data from Raw Streams [48.434767119224375]
  We propose a paradigm shift towards Agentic Data Tailoring.<n>To overcome the data scarcity bottleneck in training such high-order capabilities, we design a two-stage pipeline.<n>$textDataClaw_0$-9B model synergizes Supervised Fine-Tuning with Group Relative Policy Optimization.
  arXiv  Detail & Related papers  (2026-06-19T11:31:43Z)
• ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation [55.947962672433675]
  ChipMATE is the first self-trained multi-agent framework for RTL generation.<n>Inspired by industrial practice, ChipMATE pairs a Verilog agent with a Python reference-model agent that mutually verify each other's outputs.<n>ChipMATE achieves 75.0% and 80.1% pass@1 on VerilogEval V2 with 4B and 9B base models.
  arXiv  Detail & Related papers  (2026-05-13T01:04:21Z)
• ARISE: A Repository-level Graph Representation and Toolset for Agentic Fault Localization and Program Repair [0.0]
  We present ARISE (Agentic Repository-level Issue Solving Engine), which augments an LLM-based agent with a multi-granularity program graph.<n>ARISE exposes this graph through a three-tier tool API, which brings data-flow slicing as a first-class, queryable agent primitive.<n>We evaluate on SWE-bench Lite (300 real GitHub issues, 11 Python repositories) using Qwen2.5-Coder-32B-Instruct as the backbone.
  arXiv  Detail & Related papers  (2026-05-04T19:59:23Z)
• Claw-Eval-Live: A Live Agent Benchmark for Evolving Real-World Workflows [67.92316850084575]
  We introduce Claw-Eval-Live, a live benchmark for workflow agents.<n>Each release is constructed from public workflow-demand signals.<n>Claw-Eval-Live records execution traces, audit logs, service state, and post-run workspace artifacts.
  arXiv  Detail & Related papers  (2026-04-30T17:23:19Z)
• LeJOT-AutoML: LLM-Driven Feature Engineering for Job Execution Time Prediction in Databricks Cost Optimization [27.72622904072875]
  Databricks job orchestration systems (e.g., LeJOT) reduce cloud costs by selecting low-priced compute while meeting latency and dependency constraints.<n>Existing pipelines rely on static, manually engineered features that under-capture runtime effects.<n>We present LeJOT-AutoML, an agent-driven AutoML framework embeds large language model agents throughout the ML lifecycle.
  arXiv  Detail & Related papers  (2026-03-09T02:31:50Z)
• From Ad-Hoc Scripts to Orchestrated Pipelines: Architecting a Resilient ELT Framework for Developer Productivity Metrics [0.0]
  This paper reports on our experience migrating from legacy scheduling to a robust Extract-Load-Transform pipeline.<n>Treating the metrics pipeline as a production-grade distributed system is a prerequisite for sustainable engineering analytics.
  arXiv  Detail & Related papers  (2026-02-25T04:46:08Z)
• Causify DataFlow: A Framework For High-performance Machine Learning Stream Computing [0.0]
  We present DataFlow, a computational framework for building, testing, and deploying machine learning systems on unbounded time-series data.<n>Traditional data science assume finite datasets and require substantial reimplementation when moving from batch prototypes to streaming production systems.<n>DataFlow resolves these issues through a unified execution model based on acyclic graphs with point-in-time idempotency.
  arXiv  Detail & Related papers  (2025-12-30T04:24:04Z)
• SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner [53.54568352375669]
  We introduce **SWE-Flow**, a novel data synthesis framework grounded in Test-Driven Development (TDD)<n>Unlike existing software engineering data that rely on human-submitted issues, **SWE-Flow** automatically infers incremental development steps directly from unit tests.<n>We generated 16,061 training instances and 2,020 test instances from real-world GitHub projects, creating the **SWE-Flow-Eval** benchmark.
  arXiv  Detail & Related papers  (2025-06-10T17:23:33Z)
• ToolACE: Winning the Points of LLM Function Calling [139.07157814653638]
  ToolACE is an automatic agentic pipeline designed to generate accurate, complex, and diverse tool-learning data.<n>We demonstrate that models trained on our synthesized data, even with only 8B parameters, achieve state-of-the-art performance on the Berkeley Function-Calling Leaderboard.
  arXiv  Detail & Related papers  (2024-09-02T03:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.