A Cognitive Architecture for Shared Autonomy in AUV Operations

• URL: http://arxiv.org/abs/2608.29347v1
• Date: Sat, 29 Aug 2026 16:06:32 GMT
• Title: A Cognitive Architecture for Shared Autonomy in AUV Operations
• Abstract summary: This paper presents a cognitive architecture consisting of an ontology and multiple Large Language Models (LLMs) to assist the operator at all stages of the mission.<n>We find that GPT-OSS performs best for feasibility assessment, planning, and execution, while Qwen2.5 is best suited to identifying mission types from natural language input.
• Score: 4.416336455040627
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Operators remain essential to Remotely Operated Vehicle (ROV) operation, yet often suffer from low situational awareness and high workload, both of which negatively affect safety. This paper presents a cognitive architecture consisting of an ontology and multiple Large Language Models (LLMs) to assist the operator at all stages of the mission. Each LLM is grounded with domain-specific information from the ontology and given a simple role to create a system that can support the operator at all stages of an operation. We are aiming to prove that using the two together will allow decisions to be grounded in the relevant domain knowledge, but also benefit from the reasoning capabilities of the LLM. Our framework determines if a mission is possible for a given Unmanned Underwater Vehicle (UUV), performs mission planning, and executes a given mission in simulation. The operator can be involved in planning and execution, ensuring the resulting plan is valid and that the vehicle behaves safely during execution. We compare different LLMs, Llama3, GPT-OSS, and Qwen2.5, to determine which are best suited to the different roles within our framework. We find that GPT-OSS performs best for feasibility assessment, planning, and execution, while Qwen2.5 is best suited to identifying mission types from natural language input.

Related papers

• Autonomous Adversary: Red-Teaming in the age of LLM [1.4302803674538154]
  Language Model Agents (LMAs) are emerging as a powerful primitive for augmenting red-team operations.<n>We analyze where these agents intersect with core offensive functions and assess current strengths and limitations.<n>We benchmark LMAs across two lateral-movement scenarios in a controlled adversary-emulation environment.
  arXiv  Detail & Related papers  (2026-05-07T16:07:41Z)
• Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones [0.8492672431361252]
  This paper presents a mission-agnostic, agent-enhanced LLM framework for UAV swarm control.<n>The proposed architecture combines an LLM-based Agent Core with a Model Context Protocol gateway and a Web-of-Drones abstraction.<n>We evaluate the framework using ArduPilot-based simulation across four swarm missions and six state-of-the-art LLMs.
  arXiv  Detail & Related papers  (2026-05-05T14:14:57Z)
• From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition? [1.4016147623265656]
  Large language models (LLMs) have been shown to demonstrate emergent cognitive aspects, such as reasoning and language understanding.<n>We propose a cognitive architecture in which an agentic LLM serves as the core component for planning and reasoning.<n>We evaluate our proposed system on two household tasks, which evaluate the agent's reasoning, planning, and memory utilisation.
  arXiv  Detail & Related papers  (2026-03-03T16:36:06Z)
• HELP: Hierarchical Embodied Language Planner for Household Tasks [75.38606213726906]
  Embodied agents tasked with complex scenarios rely heavily on robust planning capabilities.<n>Large language models equipped with extensive linguistic knowledge can play this role.<n>We propose a Hierarchical Embodied Language Planner, called HELP, consisting of a set of LLM-based agents.
  arXiv  Detail & Related papers  (2025-12-25T15:54:08Z)
• Heterogeneous Robot Collaboration in Unstructured Environments with Grounded Generative Intelligence [54.91177026001217]
  Large language model (LLM)-enabled teaming methods typically assume well-structured and known environments.<n>We present SPINE-HT, a framework that addresses these limitations by grounding the reasoning abilities of LLMs in the context of a heterogeneous robot team.<n>Our framework achieves nearly twice the success rate compared to prior LLM-enabled heterogeneous teaming approaches.
  arXiv  Detail & Related papers  (2025-10-30T18:24:38Z)
• Plan-and-Act using Large Language Models for Interactive Agreement [8.07285448283823]
  Recent large language models (LLMs) are capable of planning robot actions.<n>Key problem of applying LLMs in situational HRI is balancing between "respecting the current human's activity" and "prioritizing the robot's task"
  arXiv  Detail & Related papers  (2025-04-01T23:41:05Z)
• Scaling Autonomous Agents via Automatic Reward Modeling And Planning [52.39395405893965]
  Large language models (LLMs) have demonstrated remarkable capabilities across a range of tasks.<n>However, they still struggle with problems requiring multi-step decision-making and environmental feedback.<n>We propose a framework that can automatically learn a reward model from the environment without human annotations.
  arXiv  Detail & Related papers  (2025-02-17T18:49:25Z)
• Spatial Reasoning and Planning for Deep Embodied Agents [2.7195102129095003]
  This thesis explores the development of data-driven techniques for spatial reasoning and planning tasks. It focuses on enhancing learning efficiency, interpretability, and transferability across novel scenarios.
  arXiv  Detail & Related papers  (2024-09-28T23:05:56Z)
• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks [85.95607119635102]
  Large language models (LLMs) can mimic human-like intelligence.<n>WorkArena++ is designed to evaluate the planning, problem-solving, logical/arithmetic reasoning, retrieval, and contextual understanding abilities of web agents.
  arXiv  Detail & Related papers  (2024-07-07T07:15:49Z)
• Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning [79.38140606606126]
  We propose an algorithmic framework that fine-tunes vision-language models (VLMs) with reinforcement learning (RL) Our framework provides a task description and then prompts the VLM to generate chain-of-thought (CoT) reasoning. We demonstrate that our proposed framework enhances the decision-making capabilities of VLM agents across various tasks.
  arXiv  Detail & Related papers  (2024-05-16T17:50:19Z)
• LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving [84.31119464141631]
  This work employs Large Language Models (LLMs) as a decision-making component for complex autonomous driving scenarios.<n>Extensive experiments demonstrate that our proposed method not only consistently surpasses baseline approaches in single-vehicle tasks, but also helps handle complex driving behaviors even multi-vehicle coordination.
  arXiv  Detail & Related papers  (2023-10-04T17:59:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.