Agent-Driven Autonomous Reinforcement Learning Research: Iterative Policy Improvement for Quadruped Locomotion

• URL: http://arxiv.org/abs/2603.27416v1
• Date: Sat, 28 Mar 2026 21:30:04 GMT
• Title: Agent-Driven Autonomous Reinforcement Learning Research: Iterative Policy Improvement for Quadruped Locomotion
• Abstract summary: This paper documents a case study in agent-driven autonomous reinforcement learning research for quadruped locomotion.<n>A human provided high-level directives through an agentic coding environment, while an agent carried out most of the execution loop.<n>Across more than 70 experiments organized into fourteen waves on a DHAV1 12-DoF quadruped in Isaac Lab, the agent progressed from early rough-terrain runs with mean reward around 7 to a best logged Wave 12 run, exp063, with velocity error 0.263 and 97% timeout over 2000 iterations.
• Score: 14.484745002483258
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper documents a case study in agent-driven autonomous reinforcement learning research for quadruped locomotion. The setting was not a fully self-starting research system. A human provided high-level directives through an agentic coding environment, while an agent carried out most of the execution loop: reading code, diagnosing failures, editing reward and terrain configurations, launching and monitoring jobs, analyzing intermediate metrics, and proposing the next wave of experiments. Across more than 70 experiments organized into fourteen waves on a DHAV1 12-DoF quadruped in Isaac Lab, the agent progressed from early rough-terrain runs with mean reward around 7 to a best logged Wave 12 run, exp063, with velocity error 0.263 and 97\% timeout over 2000 iterations, independently reproduced five times across different GPUs. The archive also records several concrete autonomous research decisions: isolating PhysX deadlocks to terrain sets containing boxes and stair-like primitives, porting four reward terms from openly available reference implementations \cite{deeprobotics, rlsar}, correcting Isaac Sim import and bootstrapping issues, reducing environment count for diagnosis, terminating hung runs, and pivoting effort away from HIM after repeated terrain=0.0 outcomes. Relative to the AutoResearch paradigm \cite{autoresearch}, this case study operates in a more failure-prone robotics RL setting with multi-GPU experiment management and simulator-specific engineering constraints. The contribution is empirical and documentary: it shows that an agent can materially execute the iterative RL research loop in this domain with limited human intervention, while also making clear where human direction still shaped the agenda.

Related papers

• OpenAI4S: Code as Action, Science as Sessions [57.428071188574]
  We present OpenAI4S, an open-source scientific research agent built around the principle of emphCode as Action, Science as Sessions.<n>OpenAI4S combines a persistent computing runtime with research-session management orchestration is handled through structured tool calls.<n>We evaluate OpenAI4S on 36 research scenarios spanning retrosynthesis, molecular protein binder design, protein mutation, catalyst screening, and mineral spectroscopy.
  arXiv  Detail & Related papers  (2026-09-14T06:16:59Z)
• Accelerated Genetic Programming Hyper-Heuristics for Simulation-Based Scheduling via Agentic AI [42.44812101223683]
  This paper presents a systematic approach using Claude agentic AI on real-world project-scheduling workloads in a high-performance computing environment.<n>Testing runtime reduced from 1,298 seconds to under 200 seconds without changing outputs, saving four million core-hours (NZ$320,000) annually.
  arXiv  Detail & Related papers  (2026-08-19T22:48:46Z)
• One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution [85.65263343588026]
  We propose SAGE, a Self-correcting, Autonomous, Grounded Experimenter.<n>Its core mechanism, Multi-Hypothesis Failure Attribution (MHFA), treats recovery as a structured causal diagnosis.<n>On a 12-topic, 5-domain benchmark, SAGE increases metrics-bearing outputs from 42% to 92% over a baseline reflection.
  arXiv  Detail & Related papers  (2026-06-30T10:54:16Z)
• Toward Generalist Autonomous Research via Hypothesis-Tree Refinement [150.99641031769633]
  We introduce Arbor, a framework for autonomous research that combines a long-lived coordinator, short-lived executors, and Hypothesis Tree Refinement (HTR)<n>As results return, Arbor updates the tree, propagates reusable lessons, refines the search frontier, and admits verified improvements.
  arXiv  Detail & Related papers  (2026-06-10T10:57:05Z)
• AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation [28.790523063833376]
  AutoScientists is a decentralized team of AI agents for long-running computational scientific experimentation.<n>Agents interpret a shared experimental state, self-organize into teams around promising hypotheses, critique proposals before using experimental compute.<n>Under matched experimental budgets, AutoScientists improves over prior AI agents across biomedical machine learning, language-model training optimization, and protein fitness prediction.
  arXiv  Detail & Related papers  (2026-05-27T15:56:12Z)
• Claw AI Lab: An Autonomous Multi-Agent Research Team [73.07229229907435]
  We present Claw AI Lab, a lab-native autonomous research platform.<n>Rather than centering the system around a single agent or a fixed serial workflow, we allow users to instantiate a full research team from one prompt.<n>Claw-Code Harness connects locals, datasets, and checkpoints to runnable experiments and feeds execution artifacts back into the research loop.
  arXiv  Detail & Related papers  (2026-05-21T16:02:53Z)
• AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration [175.74514061083195]
  We present AutoResearchClaw, a multi-agent autonomous research pipeline built on five mechanisms.<n>On ARC-Bench, a 25-topic experiment-stage benchmark, AutoResearchClaw outperforms AI Scientist v2 by 54.7%.
  arXiv  Detail & Related papers  (2026-05-19T15:49:51Z)
• Deep Researcher Agent: An Autonomous Framework for 24/7 Deep Learning Experimentation with Zero-Cost Monitoring [2.4112990554464235]
  We present textbfDeep Researcher Agent, an open-source framework that enables large language model (LLM) agents to autonomously conduct deep learning experiments around the clock.<n>Unlike existing AI research assistants that focus on paper writing or code generation, our system addresses the full experiment lifecycle: hypothesis formation, code implementation, training execution, result analysis, and iterative refinement.
  arXiv  Detail & Related papers  (2026-04-07T13:16:31Z)
• OR-Agent: Bridging Evolutionary Search and Structured Research for Automated Algorithm Discovery [10.217363774023033]
  OR-Agent is a multi-agent research framework designed for automated exploration in rich experimental environments.<n>We introduce an evolutionary-systematic mechanism that unifies evolutionary selection of research starting points, comprehensive research plan generation, and coordinated exploration within a research tree.<n>We conduct experiments across classical optimization benchmarks-including traveling salesman, capacitated vehicle routing, bin packing, orienteering, and multiple knapsack problems-as well as a simulation-based cooperative driving scenarios.
  arXiv  Detail & Related papers  (2026-02-14T13:32:03Z)
• Towards an AI Fluid Scientist: LLM-Powered Scientific Discovery in Experimental Fluid Mechanics [4.399894932539609]
  This work proposes an AI Fluid Scientist framework that autonomously executes the complete experimental workflow.<n>We validate this through investigation of vortex-induced vibration (VIV) and wake-induced vibration (WIV) in tandem cylinders.
  arXiv  Detail & Related papers  (2025-12-04T12:02:35Z)
• Adaptive Monitoring and Real-World Evaluation of Agentic AI Systems [3.215065407261898]
  Multi-agent systems that combine large language models with external tools are rapidly transitioning from research laboratories into high-stakes domains.<n>This "Advanced" sequel fills that gap by providing an algorithmic instantiation or empirical evidence.<n>AMDM cuts anomaly-detection latency from 12.3 s to 5.6 s on simulated goal drift and reduces false-positive rates from 4.5% to 0.9%.
  arXiv  Detail & Related papers  (2025-08-28T15:52:49Z)
• From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking [48.90371827091671]
  AutoExperiment is a benchmark that evaluates AI agents' ability to implement and run machine learning experiments.<n>We evaluate state-of-the-art agents and find that performance degrades rapidly as $n$ increases.<n>Our findings highlight critical challenges in long-horizon code generation, context retrieval, and autonomous experiment execution.
  arXiv  Detail & Related papers  (2025-06-24T15:39:20Z)
• Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [57.278726604424556]
  We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.<n>Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.<n>We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
  arXiv  Detail & Related papers  (2024-09-12T11:50:06Z)
• Latent Exploration for Reinforcement Learning [87.42776741119653]
  In Reinforcement Learning, agents learn policies by exploring and interacting with the environment. We propose LATent TIme-Correlated Exploration (Lattice), a method to inject temporally-correlated noise into the latent state of the policy network.
  arXiv  Detail & Related papers  (2023-05-31T17:40:43Z)
• PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics [89.81550748680245]
  We introduce a new differentiable physics benchmark called PasticineLab. In each task, the agent uses manipulators to deform the plasticine into the desired configuration. We evaluate several existing reinforcement learning (RL) methods and gradient-based methods on this benchmark.
  arXiv  Detail & Related papers  (2021-04-07T17:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.