LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents
- URL: http://arxiv.org/abs/2605.29559v1
- Date: Thu, 28 May 2026 08:11:57 GMT
- Title: LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents
- Abstract summary: We introduce LiteCoder-Terminal-Gen, a zero-dependency pipeline that generates terminal training environments directly from domain specifications.<n>Using this framework, we construct two large-scale resources: LiteCoder-Terminal-SFT, comprising 11,255 expert trajectories across 10 domains, and LiteCoder-Terminal-RL, featuring 602 verifiable environments for trajectory-level preference optimization.
- Score: 74.07551833809536
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Mastering terminal environments requires language agents capable of multi-step planning, feedback-grounded execution, and dynamic state adaptation. However, training such agents is currently bottlenecked by a reliance on scraped external repositories, which limits domain diversity, environment controllability, and the targeting of specific capability deficits. We introduce LiteCoder-Terminal-Gen, a zero-dependency synthesis pipeline that autonomously generates executable and verifiable terminal training environments directly from domain specifications. Using this framework, we construct two large-scale resources: LiteCoder-Terminal-SFT, comprising 11,255 expert trajectories across 10 domains, and LiteCoder-Terminal-RL, featuring 602 verifiable environments for trajectory-level preference optimization. Supervised fine-tuning of Qwen-family models on our SFT dataset yields agents that significantly outperform their base counterparts. Notably, our 32B variant achieves 29.06%, 18.54%, and 34.00% pass@1 on Terminal Bench 1.0, 2.0, and Pro, respectively. Furthermore, applying Direct Multi-turn Preference Optimization (DMPO) on our RL environments yields additional performance gains. These results systematically demonstrate that fully synthetic, executable environments offer a scalable and verifiable supervision signal for mastering complex, real-world command-line workflows.
Related papers
- EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent [21.572853994120806]
EnvCraft is an automated framework for synthesizing executable environments and scalable training data.<n>We synthesize 139 interactive environments comprising approximately 20K complex tasks for Agentic RL training.
arXiv Detail & Related papers (2026-09-04T10:13:41Z) - SETA: Scaling Environments for Terminal Agents [49.686781072283814]
We propose SETA, a scalable framework for generating verifiable terminal environments for reinforcement learning.<n>We release SETA-Env, the largest open-source verifiable terminal RL dataset to date, containing over 4,500 environments.
arXiv Detail & Related papers (2026-07-12T19:40:27Z) - Terminal-World: Scaling Terminal-Agent Environments via Agent Skills [52.39713754337834]
We introduce Terminal-World, a fully automated pipeline that uses agent skills as the central synthesis primitive.<n>We construct 5,723 training environments and train Terminal-World-8B/14B/32B, evaluated across 6 benchmarks.<n>Terminal-World-32B surpasses Nemotron-Terminal-32B on Terminal-Bench 2.0 by +4.5 Pass@1 (31.5) and achieves 43.8 Pass@3.
arXiv Detail & Related papers (2026-05-20T08:14:51Z) - EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL [54.09410318521061]
We introduce EnvFactory, a fully automated framework for Agentic Reinforcement Learning (Agentic RL) training.<n>EnvFactory autonomously explores and stateful, executable tool environments from authentic resources.<n>It synthesizes natural multi-turn trajectories through topology-aware sampling and calibrated refinement.<n>It achieves superior training efficiency and downstream performance, improving Qwen3-series models by up to +15% on BFCLv3, +8.6% on MCP-Atlas, and +6% on conversational benchmarks including $2$-Bench and VitaBench.
arXiv Detail & Related papers (2026-05-18T17:37:40Z) - CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversion [26.52253286270211]
Agentic coding requires agents to interact with runtime environments, e.g., command line interfaces (CLI)<n>We propose to employ agents to simulate and explore environment histories, guided by execution feedback.<n>With our method, named CLI-Gym, a total of 1,655 environment-intensive tasks are derived, being the largest collection of its kind.
arXiv Detail & Related papers (2026-02-11T16:22:18Z) - TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents [70.68963723787424]
TermiGen is an end-to-end pipeline for synthesizing verifiable environments and resilient expert trajectories.<n>Our TermiGen-Qwen2.5-Coder-32B achieves a 31.3% pass rate on TerminalBench.
arXiv Detail & Related papers (2026-02-06T23:56:50Z) - Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environments [36.81059045059001]
Training agentic models for terminal-based tasks depend on high-quality terminal trajectories that capture realistic long-horizon interactions.<n>We propose textbfTerminalTraj, a scalable pipeline that generates Docker-aligned task instances and synthesizes agent trajectories with executable validation code.<n>Using TerminalTraj, we curate 32K Docker images and generate 50,733 verified terminal trajectories across eight domains.
arXiv Detail & Related papers (2026-02-01T14:09:23Z) - Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem [90.17610617854247]
We introduce the Agentic Learning Ecosystem (ALE), a foundational infrastructure that optimize the production pipeline for agentic model.<n>ALE consists of three components: ROLL, a post-training framework for weight optimization; ROCK, a sandbox environment manager for trajectory generation; and iFlow CLI, an agent framework for efficient context engineering.<n>We release ROME, an open-source agent grounded by ALE and trained on over one million trajectories.
arXiv Detail & Related papers (2025-12-31T14:03:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.