SETA: Scaling Environments for Terminal Agents

• URL: http://arxiv.org/abs/2607.10891v1
• Date: Sun, 12 Jul 2026 19:40:27 GMT
• Title: SETA: Scaling Environments for Terminal Agents
• Abstract summary: We propose SETA, a scalable framework for generating verifiable terminal environments for reinforcement learning.<n>We release SETA-Env, the largest open-source verifiable terminal RL dataset to date, containing over 4,500 environments.
• Score: 49.686781072283814
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language models (LLMs) are rapidly shifting toward agents that solve tasks through diverse interfaces, including web and graphical user interfaces (GUIs). Among these, the terminal command line provides a text-based, general-purpose interface, covering tasks from system operations to data science and machine learning. However, scaling terminal-agent training remains challenging, as it requires diverse and coherent task instructions, executable environments, and reliable verification, while lacking naturally grounded supervision data. In this work, we propose SETA, a scalable framework for generating verifiable terminal environments for reinforcement learning (RL). The framework consists of two pipelines sharing a unified verification mechanism: SETA-Synth converts diverse sources into standardized RL environments, and SETA-Evol further expands from existing environments with adaptive control of difficulty and diversity. Together, we construct and release SETA-Env, the largest open-source verifiable terminal RL dataset to date, containing over 4,500 environments. We evaluate our dataset by training Qwen3-8B with GRPO on SETA-Env, achieving 12% pass rate on Terminal-Bench 2.0, the best reported result for an RL-trained model at the 8B scale. We further observe gains on DeepSeek-V4-Flash under the same terminal agent harness, with pass@1 on Terminal-Bench 2.0 improving from 40% to 43% and pass@5 improving from 54% to 58%. These results demonstrate that SETA- Env provides high-quality training environments for terminal agents and serves as a valuable resource for advancing research on terminal-based agent learning.

Related papers

• LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents [74.07551833809536]
  We introduce LiteCoder-Terminal-Gen, a zero-dependency pipeline that generates terminal training environments directly from domain specifications.<n>Using this framework, we construct two large-scale resources: LiteCoder-Terminal-SFT, comprising 11,255 expert trajectories across 10 domains, and LiteCoder-Terminal-RL, featuring 602 verifiable environments for trajectory-level preference optimization.
  arXiv  Detail & Related papers  (2026-05-28T08:11:57Z)
• Terminal-World: Scaling Terminal-Agent Environments via Agent Skills [52.39713754337834]
  We introduce Terminal-World, a fully automated pipeline that uses agent skills as the central synthesis primitive.<n>We construct 5,723 training environments and train Terminal-World-8B/14B/32B, evaluated across 6 benchmarks.<n>Terminal-World-32B surpasses Nemotron-Terminal-32B on Terminal-Bench 2.0 by +4.5 Pass@1 (31.5) and achieves 43.8 Pass@3.
  arXiv  Detail & Related papers  (2026-05-20T08:14:51Z)
• On Data Engineering for Scaling LLM Terminal Capabilities [62.14352406328365]
  Training data strategies behind state-of-the-art terminal agents remain largely undisclosed.<n>We address this gap through a systematic study of data engineering practices for terminal agents.<n>Our pipeline yields Terminal-Corpus, a large-scale open-source dataset for terminal tasks.
  arXiv  Detail & Related papers  (2026-02-24T18:51:04Z)
• Endless Terminals: Scaling RL Environments for Terminal Agents [39.60665149203152]
  Endless Terminals is a fully autonomous pipeline that procedurally generates terminal-use tasks without human annotation.<n>We train agents using vanilla PPO with binary episode level rewards and a minimal interaction loop.<n>These improvements transfer to human-curated benchmarks.
  arXiv  Detail & Related papers  (2026-01-23T04:39:55Z)
• Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation [65.3648667980258]
  Vision-language model (VLM) based GUI agents show promise for automating complex tasks, but face significant challenges in applying reinforcement learning (RL)<n>We propose DART, a Decoupled Agentic RL Training framework for GUI agents, which coordinates heterogeneous modules in a highly decoupled manner.<n>On the OSWorld benchmark, DART-GUI-7B achieves a 42.13% task success rate, a 14.61% absolute gain over the base model, and 7.34% higher than open-source SOTA.
  arXiv  Detail & Related papers  (2025-09-28T13:19:20Z)
• UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning [155.51875080423883]
  The development of autonomous agents for graphical user interfaces presents major challenges in artificial intelligence.<n>We present UI-TARS-2, a native GUI-centered agent model that addresses these challenges through a systematic training methodology.<n> Empirical evaluation demonstrates that UI-TARS-2 achieves significant improvements over its predecessor UI-TARS-1.5.
  arXiv  Detail & Related papers  (2025-09-02T17:44:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.