An Ontology for Unified Modeling of Tasks, Actions, Environments, and Capabilities in Personal Service Robotics

• URL: http://arxiv.org/abs/2509.22434v1
• Date: Fri, 26 Sep 2025 14:53:08 GMT
• Title: An Ontology for Unified Modeling of Tasks, Actions, Environments, and Capabilities in Personal Service Robotics
• Abstract summary: We propose the Ontology for roBOts and acTions (OntoBOT), which extends existing to provide a unified representation of tasks, actions, environments, and capabilities.<n>Our contributions are twofold: (1) we unify these aspects into a cohesive to support formal reasoning about execution, actions, environments, and capabilities.
• Score: 3.884856136722028
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Personal service robots are increasingly used in domestic settings to assist older adults and people requiring support. Effective operation involves not only physical interaction but also the ability to interpret dynamic environments, understand tasks, and choose appropriate actions based on context. This requires integrating both hardware components (e.g. sensors, actuators) and software systems capable of reasoning about tasks, environments, and robot capabilities. Frameworks such as the Robot Operating System (ROS) provide open-source tools that help connect low-level hardware with higher-level functionalities. However, real-world deployments remain tightly coupled to specific platforms. As a result, solutions are often isolated and hard-coded, limiting interoperability, reusability, and knowledge sharing. Ontologies and knowledge graphs offer a structured way to represent tasks, environments, and robot capabilities. Existing ontologies, such as the Socio-physical Model of Activities (SOMA) and the Descriptive Ontology for Linguistic and Cognitive Engineering (DOLCE), provide models for activities, spatial relationships, and reasoning structures. However, they often focus on specific domains and do not fully capture the connection between environment, action, robot capabilities, and system-level integration. In this work, we propose the Ontology for roBOts and acTions (OntoBOT), which extends existing ontologies to provide a unified representation of tasks, actions, environments, and capabilities. Our contributions are twofold: (1) we unify these aspects into a cohesive ontology to support formal reasoning about task execution, and (2) we demonstrate its generalizability by evaluating competency questions across four embodied agents - TIAGo, HSR, UR3, and Stretch - showing how OntoBOT enables context-aware reasoning, task-oriented execution, and knowledge sharing in service robotics.

Related papers

• Using profiles of cognitive capability to assess AI suitability for workplace tasks [5.826026042207654]
  We introduce a pipeline that profiles agents and tasks using a shared set of core cognitive capabilities.<n>As both use a common set of cognitive dimensions, they can be updated independently as models and roles change.<n>We validate capability recovery on synthetic agents, profile six AI systems, and elicit task requirements from 410 employees.
  arXiv  Detail & Related papers  (2026-08-26T10:48:09Z)
• Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning [128.76135832773102]
  Physically grounded robot intelligence requires robots to perceive, reason about, and regulate their interactions with the physical world.<n>Recent robot learning methods have made substantial progress by integrating force, tactile, vision, language, and proprioceptive sensing into learned manipulation policies.<n>Despite these advances, existing surveys have not explicitly reviewed force- and tactile-aware robot learning from a unified perspective.
  arXiv  Detail & Related papers  (2026-08-02T14:22:01Z)
• D-VLC: Decentralized Vision-Language Collaboration for Heterogeneous Embodied Multi-Robot Systems in Unknown Environments [10.393866368123946]
  Multi-robot systems can improve the efficiency of complex task execution through parallel collaboration and complementary capabilities.<n>We propose a framework that combines decentralized asynchronous reasoning, lightweight information sharing, capability aware collaboration, and a unified action interface.<n>Experiments across diverse scenarios and multiple VLMs show success rates above 70%, with completion time reduced by up to 55.8% relative to the geometric greedy baseline.
  arXiv  Detail & Related papers  (2026-07-31T04:20:32Z)
• Formalisms for Robotic Mission Specification and Execution: A Comparative Analysis [5.064309411456074]
  There is no standard or widely accepted formalism for specifying missions in single- or multi-robot systems.<n>A variety of formalisms, such as Behavior Trees, State Machines, Hierarchical Task Networks, and Business Process Model and Notation, have been adopted in robotics.<n>This paper presents a systematic analysis of these four formalisms with respect to their suitability for robot mission specification.
  arXiv  Detail & Related papers  (2026-03-16T15:34:48Z)
• Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations [76.79742393097358]
  Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics.<n>Existing fine-tuning methods lack specificity, adapting the same set of parameters regardless of a task's visual, linguistic, and physical characteristics.<n>Inspired by functional specificity in neuroscience, we hypothesize that it is more effective to finetune sparse model representations specific to a given task.
  arXiv  Detail & Related papers  (2025-11-27T18:50:21Z)
• Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulation [70.8381970762877]
  Vision-Language Models (VLMs) have demonstrated remarkable capabilities in semantic reasoning and task planning.<n>We introduce GRACE, a novel framework that grounds VLM-based reasoning through executable analytic concepts.<n>G GRACE provides a unified and interpretable interface between high-level instruction understanding and low-level robot control.
  arXiv  Detail & Related papers  (2025-10-09T09:08:33Z)
• Towards General Agentic Intelligence via Environment Scaling [78.66355092082253]
  Advanced agentic intelligence is a prerequisite for deploying Large Language Models in real-world applications.<n>We design a scalable framework that automatically constructs heterogeneous environments that are fully simulated.<n>Experiments on agentic benchmarks, tau-bench, tau2-Bench, and ACEBench, demonstrate that our trained model, AgentScaler, significantly enhances the function-calling capability of models.
  arXiv  Detail & Related papers  (2025-09-16T17:57:20Z)
• Bridging Bots: from Perception to Action via Multimodal-LMs and Knowledge Graphs [1.4624458429745086]
  Service robots are deployed to support daily living in domestic environments.<n>Current systems rely on proprietary, hard-coded solutions tied to specific hardware and software.<n>Ontologies and Knowledge Graphs (KGs) offer a solution to enable interoperability across systems.
  arXiv  Detail & Related papers  (2025-07-13T12:52:00Z)
• ROS-related Robotic Systems Development with V-model-based Application of MeROS Metamodel [0.49259062564301753]
  Systems built on the Robot Operating System (ROS) are increasingly easy to assemble, yet hard to govern and reliably coordinate.<n>In this paper, we use a compact heterogeneous robotic system (HeROS), combining mobile and manipulation capabilities, as a demonstration vehicle.<n>We propose a structured methodology based on MeROS - a SysML metamodel created specifically to put the ROS-based systems into the focus of the Model-Based Systems Engineering (MBSE) workflow.
  arXiv  Detail & Related papers  (2025-06-10T11:44:00Z)
• Internet of Agents: Fundamentals, Applications, and Challenges [66.44234034282421]
  We introduce the Internet of Agents (IoA) as a foundational framework that enables seamless interconnection, dynamic discovery, and collaborative orchestration among heterogeneous agents at scale.<n>We analyze the key operational enablers of IoA, including capability notification and discovery, adaptive communication protocols, dynamic task matching, consensus and conflict-resolution mechanisms, and incentive models.
  arXiv  Detail & Related papers  (2025-05-12T02:04:37Z)
• Geometrically-Aware One-Shot Skill Transfer of Category-Level Objects [18.978751760636563]
  We propose a new skill transfer framework, which enables a robot to transfer complex object manipulation skills and constraints from a single human demonstration.<n>Our approach addresses the challenge of skill acquisition and task execution by deriving geometric representations from demonstrations focusing on object-centric interactions.<n>We validate the effectiveness and adaptability of our approach through extensive experiments, demonstrating successful skill transfer and task execution in diverse real-world environments without requiring additional training.
  arXiv  Detail & Related papers  (2025-03-19T16:10:17Z)
• EMOS: Embodiment-aware Heterogeneous Multi-robot Operating System with LLM Agents [33.77674812074215]
  We introduce a novel multi-agent framework designed to enable effective collaboration among heterogeneous robots.<n>We propose a self-prompted approach, where agents comprehend robot URDF files and call robot kinematics tools to generate descriptions of their physics capabilities.<n>The Habitat-MAS benchmark is designed to assess how a multi-agent framework handles tasks that require embodiment-aware reasoning.
  arXiv  Detail & Related papers  (2024-10-30T03:20:01Z)
• HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams [2.6627293764668902]
  This paper describes a cognitive-robotic architecture that integrates the OntoAgent cognitive framework with general-purpose robot control systems applied to human-robot teaming (HRT)<n>HarMONIC incorporates metacognition, meaningful natural language communication, and explainability capabilities required for developing mutual trust in HRT.
  arXiv  Detail & Related papers  (2024-09-26T16:48:21Z)
• RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation [21.387160107315797]
  We introduce the novel task of interactive scene exploration, wherein robots autonomously explore environments and produce an action-conditioned scene graph (ACSG) The ACSG accounts for both low-level information (geometry and semantics) and high-level information (action-conditioned relationships between different entities) in the scene. We present the Robotic Exploration (RoboEXP) system, which incorporates the Large Multimodal Model (LMM) and an explicit memory design to enhance our system's capabilities.
  arXiv  Detail & Related papers  (2024-02-23T18:27:17Z)
• Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis [82.59451639072073]
  General-purpose robots operate seamlessly in any environment, with any object, and utilize various skills to complete diverse tasks. As a community, we have been constraining most robotic systems by designing them for specific tasks, training them on specific datasets, and deploying them within specific environments. Motivated by the impressive open-set performance and content generation capabilities of web-scale, large-capacity pre-trained models, we devote this survey to exploring how foundation models can be applied to general-purpose robotics.
  arXiv  Detail & Related papers  (2023-12-14T10:02:55Z)
• Enhancing Graph Representation of the Environment through Local and Cloud Computation [2.9465623430708905]
  We propose a graph-based representation that provides a semantic representation of robot environments from multiple sources. To acquire information from the environment, the framework combines classical computer vision tools with modern computer vision cloud services. The proposed approach allows us to handle also small objects and integrate them into the semantic representation of the environment.
  arXiv  Detail & Related papers  (2023-09-22T08:05:32Z)
• Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependencies [64.0476282000118]
  Intrinsic motivations have proven to generate a task-agnostic signal to properly allocate the training time amongst goals. While the majority of works in the field of intrinsically motivated open-ended learning focus on scenarios where goals are independent from each other, only few of them studied the autonomous acquisition of interdependent tasks. In particular, we first deepen the analysis of a previous system, showing the importance of incorporating information about the relationships between tasks at a higher level of the architecture. Then we introduce H-GRAIL, a new system that extends the previous one by adding a new learning layer to store the autonomously acquired sequences
  arXiv  Detail & Related papers  (2022-05-16T10:43:01Z)
• SAPIEN: A SimulAted Part-based Interactive ENvironment [77.4739790629284]
  SAPIEN is a realistic and physics-rich simulated environment that hosts a large-scale set for articulated objects. We evaluate state-of-the-art vision algorithms for part detection and motion attribute recognition as well as demonstrate robotic interaction tasks.
  arXiv  Detail & Related papers  (2020-03-19T00:11:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.