dm_control: Software and Tasks for Continuous Control

• URL: http://arxiv.org/abs/2006.12983v2
• Date: Mon, 7 Sep 2020 14:28:10 GMT
• Title: dm_control: Software and Tasks for Continuous Control
• Abstract summary: The dm_control software package is a collection of Python libraries and task suites for reinforcement learning agents in an articulated-body simulation. A MuJoCo wrapper provides convenient bindings to functions and data structures. The Control Suite is a fixed set of tasks with standardised structure, intended to serve as performance benchmarks.
• Score: 24.588523489116326
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The dm_control software package is a collection of Python libraries and task suites for reinforcement learning agents in an articulated-body simulation. A MuJoCo wrapper provides convenient bindings to functions and data structures. The PyMJCF and Composer libraries enable procedural model manipulation and task authoring. The Control Suite is a fixed set of tasks with standardised structure, intended to serve as performance benchmarks. The Locomotion framework provides high-level abstractions and examples of locomotion tasks. A set of configurable manipulation tasks with a robot arm and snap-together bricks is also included. dm_control is publicly available at https://www.github.com/deepmind/dm_control

Related papers

• FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production [55.71860113185132]
  We introduce FRAMEWORKERS, a task-centric and workspace-grounded multi-agent framework for open-ended video production.<n>A central Director formulates video creation as dynamic task management, continuously editing a Task Stack to determine which subtask to execute next and which sub-agent to invoke.<n>An Assistant serves as the execution layer, grounding each selected task in a shared Workspace, retrieving the required assets and context, invoking the assigned sub-agent, and persisting the resulting artifacts.<n>Experiments show that FRAMEWORKERS outperforms strong planners in routing accuracy, recovers reliably from runtime failures, generalizes to unseen sub
  arXiv  Detail & Related papers  (2026-08-30T14:28:50Z)
• CoStream: Composing Simple Behaviors for Generalizable Complex Manipulation [61.25264898597319]
  We show that complex manipulation capabilities can emerge naturally from the composition of simple, independent behaviors.<n>We propose CoStream, a framework orchestrating foundation models and diverse sensing modalities into multiple composable core behaviors.<n>We demonstrate CoStream on 8 real-world tasks spanning everyday manipulation and precision assembly, with the strongest gains in contact-rich assembly and object transfer.
  arXiv  Detail & Related papers  (2026-06-24T22:25:19Z)
• Agent libOS: A Library-OS-Inspired Runtime for Long-Running, Capability-Controlled LLM Agents [0.6345523830122165]
  Large language model (LLM) agents are evolving from request-response assistants into long-running software actors.<n>This paper presents Agent libOS, a library-OS-inspired runtime substrate for LLM agents.
  arXiv  Detail & Related papers  (2026-06-02T16:53:24Z)
• ColPackAgent: Agent-Skill-Guided Hard-Particle Monte Carlo Workflows for Colloidal Packing [0.0]
  ColPackAgent is an agent framework that autonomously runs Monte Carlo simulations of colloidal packing.<n>By harnessing the Model Context Protocol tool server and an agent skill, ColPackAgent executes a structured workflow for colloidal packing simulations.
  arXiv  Detail & Related papers  (2026-05-15T05:17:40Z)
• AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse [14.413401094877122]
  Recent works on LLM-based agent self-evolution primarily record successful experiences as textual prompts or reflections.<n>We propose AgentFactory, a new self-evolution paradigm that preserves successful task solutions as executable subagent code.<n>Saved subagents are pure Python code with standardized documentation, enabling portability across any Python-capable system.
  arXiv  Detail & Related papers  (2026-03-18T17:58:25Z)
• AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration [36.04766562662082]
  AOrchestra is a framework-agnostic agent abstraction that models any agent as a Instruction, Context Tools, Model.<n>It curates task-relevant context, tools and models, and delegates execution via on-the-fly automatic agent creation.<n>AOrchestra achieves 16.28% relative improvement against the strongest baseline when paired with Gemini.
  arXiv  Detail & Related papers  (2026-02-03T17:46:16Z)
• VibeTensor: System Software for Deep Learning, Fully Generated by AI Agents [42.56489784841984]
  "fully generated" refers to code provenance: implementation changes were produced and applied as agent-proposed diffs.<n>We describe the architecture, summarize the workflow used to produce and validate the system, and evaluate the artifact.
  arXiv  Detail & Related papers  (2026-01-21T19:29:00Z)
• MimicKit: A Reinforcement Learning Framework for Motion Imitation and Control [11.381250963626735]
  MimicKit is an open-source framework for training motion controllers using motion imitation and reinforcement learning.<n>It provides implementations of commonly-used motion-imitation techniques and RL algorithms.
  arXiv  Detail & Related papers  (2025-10-15T17:51:42Z)
• Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models [49.4824734958566]
  Chain-of-Modality (CoM) enables Vision Language Models to reason about multimodal human demonstration data. CoM refines a task plan and generates detailed control parameters, enabling robots to perform manipulation tasks based on a single multimodal human video prompt.
  arXiv  Detail & Related papers  (2025-04-17T21:31:23Z)
• KerasCV and KerasNLP: Vision and Language Power-Ups [9.395199188271254]
  KerasCV and KerasNLP are extensions of the Keras API for Computer Vision and Natural Language Processing. These domain packages are designed to enable fast experimentation, with a focus on ease-of-use and performance. The libraries are fully open-source (Apache 2.0 license) and available on GitHub.
  arXiv  Detail & Related papers  (2024-05-30T16:58:34Z)
• MeMo: Meaningful, Modular Controllers via Noise Injection [25.541496793132183]
  We show that when a new robot is built from the same parts, its control can be quickly learned by reusing the modular controllers. We achieve this with a framework called MeMo which learns (Me)aningful, (Mo)dular controllers. We benchmark our framework in locomotion and grasping environments on simple to complex robot morphology transfer.
  arXiv  Detail & Related papers  (2024-05-24T18:39:20Z)
• AgentKit: Structured LLM Reasoning with Dynamic Graphs [91.09525140733987]
  We propose an intuitive LLM prompting framework (AgentKit) for multifunctional agents. AgentKit offers a unified framework for explicitly constructing a complex "thought process" from simple natural language prompts.
  arXiv  Detail & Related papers  (2024-04-17T15:40:45Z)
• pyvene: A Library for Understanding and Improving PyTorch Models via Interventions [79.72930339711478]
  $textbfpyvene$ is an open-source library that supports customizable interventions on a range of different PyTorch modules. We show how $textbfpyvene$ provides a unified framework for performing interventions on neural models and sharing the intervened upon models with others.
  arXiv  Detail & Related papers  (2024-03-12T16:46:54Z)
• Executable Code Actions Elicit Better LLM Agents [76.95566120678787]
  This work proposes to use Python code to consolidate Large Language Model (LLM) agents' actions into a unified action space (CodeAct) integrated with a Python interpreter, CodeAct can execute code actions and dynamically revise prior actions or emit new actions upon new observations through multi-turn interactions. The encouraging performance of CodeAct motivates us to build an open-source LLM agent that interacts with environments by executing interpretable code and collaborates with users using natural language.
  arXiv  Detail & Related papers  (2024-02-01T21:38:58Z)
• An LLM Compiler for Parallel Function Calling [68.04566807806071]
  We introduce LLMCompiler, which executes functions in parallel to efficiently orchestrate multiple function calls. We observe consistent latency speedup of up to 3.7x, cost savings of up to 6.7x, and accuracy improvement of up to 9% compared to ReAct.
  arXiv  Detail & Related papers  (2023-12-07T18:32:04Z)
• ControlLLM: Augment Language Models with Tools by Searching on Graphs [97.62758830255002]
  We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving real-world tasks. Our framework comprises three key components: (1) a textittask decomposer that breaks down a complex task into clear subtasks with well-defined inputs and outputs; (2) a textitThoughts-on-Graph (ToG) paradigm that searches the optimal solution path on a pre-built tool graph; and (3) an textitexecution engine with a rich toolbox that interprets the solution path and runs the
  arXiv  Detail & Related papers  (2023-10-26T21:57:21Z)
• Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents [99.17668730578586]
  Pre-trained large language models (LLMs) capture procedural knowledge about the world. Plan, Eliminate, and Track (PET) framework translates a task description into a list of high-level sub-tasks. PET framework leads to a significant 15% improvement over SOTA for generalization to human goal specifications.
  arXiv  Detail & Related papers  (2023-05-03T20:11:22Z)
• Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion [25.35885216505385]
  An attached arm can significantly increase the applicability of legged robots to mobile manipulation tasks. Standard hierarchical control pipeline for such legged manipulators is to decouple the controller into that of manipulation and locomotion. We learn a unified policy for whole-body control of a legged manipulator using reinforcement learning.
  arXiv  Detail & Related papers  (2022-10-18T17:59:30Z)
• Learning to Compose Hierarchical Object-Centric Controllers for Robotic Manipulation [26.24940293693809]
  We propose using reinforcement learning to compose hierarchical object-centric controllers for manipulation tasks. Experiments in both simulation and real world show how the proposed approach leads to improved sample efficiency, zero-shot generalization, and simulation-to-reality transfer without fine-tuning.
  arXiv  Detail & Related papers  (2020-11-09T18:38:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.