CABTO: Context-Aware Behavior Tree Grounding for Robot Manipulation

• URL: http://arxiv.org/abs/2603.16809v1
• Date: Tue, 17 Mar 2026 17:12:46 GMT
• Title: CABTO: Context-Aware Behavior Tree Grounding for Robot Manipulation
• Abstract summary: Behavior Trees (BTs) offer a powerful paradigm for designing modular and reactive robot controllers.<n>BT planning provides theoretical guarantees for the automated generation of reliable BTs.<n>We introduce CABTO, the first framework to efficiently solve the BT Grounding problem.
• Score: 36.70100723410325
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Behavior Trees (BTs) offer a powerful paradigm for designing modular and reactive robot controllers. BT planning, an emerging field, provides theoretical guarantees for the automated generation of reliable BTs. However, BT planning typically assumes that a well-designed BT system is already grounded -- comprising high-level action models and low-level control policies -- which often requires extensive expert knowledge and manual effort. In this paper, we formalize the BT Grounding problem: the automated construction of a complete and consistent BT system. We analyze its complexity and introduce CABTO (Context-Aware Behavior Tree grOunding), the first framework to efficiently solve this challenge. CABTO leverages pre-trained Large Models (LMs) to heuristically search the space of action models and control policies, guided by contextual feedback from BT planners and environmental observations. Experiments spanning seven task sets across three distinct robotic manipulation scenarios demonstrate CABTO's effectiveness and efficiency in generating complete and consistent behavior tree systems.

Related papers

• A Decade of Bayesian Optimization for Controller Tuning and Robot Learning: Tutorial, Review, and Future Prospects [49.6839288052673]
  In the past decade, Bayesian optimization has emerged as a powerful framework for automatic controller tuning and robot learning.<n>This article offers a comprehensive overview of the state-of-the-art in BO, designed to support both researchers and practitioners in understanding recent advancements.
  arXiv  Detail & Related papers  (2026-09-08T19:59:54Z)
• Simulation-Informed Diffusion for Decentralized Multi-robot Motion Planning [56.240199425429445]
  Multi-robot motion planning requires each robot to generate collision-free trajectories from local observations.<n>Most existing planners generate trajectories from a static snapshot of the local observation.<n>This paper introduces Simulation-Informed Diffusion (SID), a decentralized framework built on constraint-aware diffusion models.
  arXiv  Detail & Related papers  (2026-05-26T21:17:53Z)
• From Prompts to Pavement: LMMs-based Agentic Behavior-Tree Generation Framework for Autonomous Vehicles [1.3707825707652799]
  Traditional behavior trees (BTs) offer structured decision logic but are inherently static and demand labor-intensive manual tuning.<n>This paper presents an agentic framework that leverages large language models (LLMs) and multi-modal vision models (LVMs) to generate and adapt BTs on the fly.
  arXiv  Detail & Related papers  (2026-01-18T11:32:29Z)
• Behavior Trees vs Executable Ontologies: a Comparative Analysis of Robot Control Paradigms [51.56484100374058]
  We compare two approaches to modeling robotic behavior: imperative Behavior Trees (BTs) and declarative Executable Ontologies (EO)<n>BTs structure behavior hierarchically using control-flow, whereas EO represents the domain as a temporal, event-based semantic graph driven by dataflow rules.
  arXiv  Detail & Related papers  (2025-11-19T09:38:01Z)
• Robotic Control via Embodied Chain-of-Thought Reasoning [86.6680905262442]
  Key limitation of learned robot control policies is their inability to generalize outside their training data.<n>Recent works on vision-language-action models (VLAs) have shown that the use of large, internet pre-trained vision-language models can substantially improve their robustness and generalization ability.<n>We introduce Embodied Chain-of-Thought Reasoning (ECoT) for VLAs, in which we train VLAs to perform multiple steps of reasoning about plans, sub-tasks, motions, and visually grounded features before predicting the robot action.
  arXiv  Detail & Related papers  (2024-07-11T17:31:01Z)
• HBTP: Heuristic Behavior Tree Planning with Large Language Model Reasoning [6.2560501421348]
  Heuristic Behavior Tree Planning (HBTP) is a reliable and efficient framework for BT generation.<n>This paper introduces the BT expansion process, along with two variants designed for optimal planning and satising planning.<n>Experiments demonstrate the theoretical bounds of HBTP, and results from four datasets confirm its practical effectiveness in everyday service robot applications.
  arXiv  Detail & Related papers  (2024-06-03T03:38:56Z)
• Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions [5.31484618181979]
  Behavior Tree (BT) is an appropriate control architecture for robots executing tasks following human instructions. This paper proposes a two-stage framework for BT generation, which first employs large language models to interpret goals from high-level instructions. We represent goals as well-formed formulas in first-order logic, effectively bridging intent understanding and optimal behavior planning.
  arXiv  Detail & Related papers  (2024-05-13T05:23:48Z)
• An Extended Convergence Result for Behaviour Tree Controllers [0.0]
  Behavior trees (BTs) are an optimally modular framework to assemble hierarchical hybrid control policies. We study the convergence of BTs, in the sense of reaching a desired part of the state space.
  arXiv  Detail & Related papers  (2023-08-17T14:05:45Z)
• EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought [95.37585041654535]
  Embodied AI is capable of planning and executing action sequences for robots to accomplish long-horizon tasks in physical environments. In this work, we introduce EmbodiedGPT, an end-to-end multi-modal foundation model for embodied AI. Experiments show the effectiveness of EmbodiedGPT on embodied tasks, including embodied planning, embodied control, visual captioning, and visual question answering.
  arXiv  Detail & Related papers  (2023-05-24T11:04:30Z)
• A principled analysis of Behavior Trees and their generalisations [0.0]
  We analyse the principles behind Behavior Trees (BTs), an increasingly popular tree-structured control architecture. We show that reasoning via these principles leads to compatible solutions. We introduce a new class of control architectures we call generalised BTs or $k$-BTs.
  arXiv  Detail & Related papers  (2020-08-27T04:09:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.