Dual-Process Atomic Skill Learning: Decoupling Semantic Reasoning and Real-Time Control

• URL: http://arxiv.org/abs/2607.10625v1
• Date: Sun, 12 Jul 2026 07:38:53 GMT
• Title: Dual-Process Atomic Skill Learning: Decoupling Semantic Reasoning and Real-Time Control
• Abstract summary: Language-conditioned Imitation Learning (IL) is essential for enabling robots to perform complex tasks following natural language instructions.<n>We propose Dual-Process Atomic Skill Learning (DASL), a novel hierarchical imitation learning framework that decouples slow semantic reasoning from real-time motion control.<n>DASL significantly outperforms state-of-the-art baselines, excelling in skill acquisition and compositional generalization to unseen instructions.
• Score: 21.97625864571452
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Language-conditioned Imitation Learning (IL) is essential for enabling robots to perform complex tasks following natural language instructions. However, generalizing to multi-step compositional tasks remains a significant challenge. While hierarchical approaches attempt to address this by decomposing tasks into atomic skills, existing methods often suffer from training instability and codebook collapse due to the tight coupling between high-level skill reasoning and low-level action generation in joint training paradigms. Inspired by the Dual-Process Theory of cognition, we propose Dual-Process Atomic Skill Learning (DASL), a novel asynchronous hierarchical imitation learning framework that decouples slow semantic reasoning from fast, real-time motion control. DASL comprises a Slow-Frequency Policy that predicts interpretable, discrete skills via Vector Quantization, and a High-Frequency Policy that leverages a latent diffusion model and a Decision Transformer to generate precise actions conditioned on these latent skills. By asynchronously coordinating these modules and utilizing diffusion to structure the latent space, our framework mitigates the skill codebook interference problem common in joint training paradigms. Evaluations across simulation benchmarks and experiment demonstrate that DASL significantly outperforms state-of-the-art baselines, excelling in skill acquisition and compositional generalization to unseen instructions. GitHub page: https://github.com/Hatakekaka/DASL

Related papers

• Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills [53.15216425100295]
  We introduce Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a skill controller.<n>The proposer generates challenging tasks conditioned on dynamically sampled skills; the solver explores candidate solutions to push its capability boundaries; and the skill controller collects execution feedback to update and expand the skill library.<n>This interactive co-evolution effectively bridges the gap between structured verification and open-ended exploration.
  arXiv  Detail & Related papers  (2026-07-24T17:59:22Z)
• Task-Differentiated Atomic Skill Expansion and Routing for Continual Learning Across Highly Heterogeneous Tasks [15.331986169435893]
  Continual learning (CL) is commonly studied under the assumption that sequential tasks are semantically related or structurally similar.<n>textttTASER is a framework that determines how many new atomic skills to introduce for each task and which skills to activate.<n>Experiments on textttHeteroCLBench show that textttTASER consistently outperforms strong baselines by improving plasticity and reducing catastrophic forgetting.
  arXiv  Detail & Related papers  (2026-06-19T10:41:30Z)
• Tree Learning: A Multi-Skill Continual Learning Framework for Humanoid Robots [1.282675419968047]
  We propose Tree Learning, a multi-skill continual learning framework for humanoid robots.<n>The framework adopts a root-branch hierarchical parameter inheritance mechanism, providing motion priors for branch skills.<n>A task-level reward shaping strategy is also proposed to accelerate skill convergence.
  arXiv  Detail & Related papers  (2026-04-14T15:57:27Z)
• Language-Grounded Decoupled Action Representation for Robotic Manipulation [78.42228162226839]
  We propose the Language-Grounded Decoupled Action Representation (LaDA) framework to connect perception and control.<n>LaDA introduces a fine-grained intermediate layer of three interpretable action primitives--translation, rotation, and gripper control--providing explicit semantic structure for low-level actions.<n>It further employs a semantic-guided soft-label contrastive learning objective to align similar action primitives across tasks, enhancing generalization and motion consistency.
  arXiv  Detail & Related papers  (2026-03-13T13:08:26Z)
• BiKC+: Bimanual Hierarchical Imitation with Keypose-Conditioned Coordination-Aware Consistency Policies [25.25845809170421]
  We propose a novel keypose-conditioned coordination-aware consistency policy tailored for bimanual manipulation.<n>Our framework instantiates hierarchical imitation learning with a high-level keypose predictor and a low-level trajectory generator.<n>In particular, we devise an innovative approach for identifying bimanual keyposes, considering both robot-centric action features and task-centric operation styles.
  arXiv  Detail & Related papers  (2026-01-17T17:33:18Z)
• Learning Semantic Atomic Skills for Multi-Task Robotic Manipulation [34.73582639920571]
  AtomSkill is a novel multi-task imitation learning framework.<n>It learns and leverages a structured Atomic Skill Space for composable robot manipulation.<n>It consistently outperforms state-of-the-art methods across diverse manipulation tasks.
  arXiv  Detail & Related papers  (2025-12-20T13:46:08Z)
• Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skills [5.745006056037742]
  We introduce a hierarchical framework that frames this challenge as an integrated skill planning & scheduling problem.<n>Our approach is built upon a library of single-arm and bimanual primitive skills, each trained using Reinforcement Learning (RL) in GPU-accelerated simulation.<n>We demonstrate that our method achieves higher success rates on complex, contact-rich tasks than end-to-end RL approaches.
  arXiv  Detail & Related papers  (2025-10-29T15:39:53Z)
• STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantization [87.77475595961154]
  We present textbfSkill textbfTraining with textbfAugmented textbfRotation (textbfSTAR), a framework that advances both skill learning and composition to complete complex behaviors.
  arXiv  Detail & Related papers  (2025-06-04T11:54:42Z)
• SPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation [3.1997825444285457]
  Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks.<n>Traditional imitation learning relies on static training paradigms, which are ill-suited for lifelong adaptation.<n>We propose Skill Prompts-based HiErarchical Continual Imitation Learning (SPECI), a novel end-to-end hierarchical CIL policy architecture for robot manipulation.
  arXiv  Detail & Related papers  (2025-04-22T03:30:38Z)
• Entropy-Regularized Token-Level Policy Optimization for Language Agent Reinforcement [67.1393112206885]
  Large Language Models (LLMs) have shown promise as intelligent agents in interactive decision-making tasks. We introduce Entropy-Regularized Token-level Policy Optimization (ETPO), an entropy-augmented RL method tailored for optimizing LLMs at the token level. We assess the effectiveness of ETPO within a simulated environment that models data science code generation as a series of multi-step interactive tasks.
  arXiv  Detail & Related papers  (2024-02-09T07:45:26Z)
• SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution [75.2573501625811]
  Diffusion models have demonstrated strong potential for robotic trajectory planning. generating coherent trajectories from high-level instructions remains challenging. We propose SkillDiffuser, an end-to-end hierarchical planning framework.
  arXiv  Detail & Related papers  (2023-12-18T18:16:52Z)
• Bridging the Imitation Gap by Adaptive Insubordination [88.35564081175642]
  We show that when the teaching agent makes decisions with access to privileged information, this information is marginalized during imitation learning. We propose 'Adaptive Insubordination' (ADVISOR) to address this gap. ADVISOR dynamically weights imitation and reward-based reinforcement learning losses during training, enabling on-the-fly switching between imitation and exploration.
  arXiv  Detail & Related papers  (2020-07-23T17:59:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.