Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing

• URL: http://arxiv.org/abs/2603.24221v1
• Date: Wed, 25 Mar 2026 11:50:08 GMT
• Title: Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing
• Abstract summary: This paper explores the use of large language models for automated penetration testing in robotic environments.<n>We propose an environment-grounded multi-agent architecture tailored to Robotics-based systems.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The increasing complexity and interconnectivity of digital infrastructures make scalable and reliable security assessment methods essential. Robotic systems represent a particularly important class of operational technology, as modern robots are highly networked cyber-physical systems deployed in domains such as industrial automation, logistics, and autonomous services. This paper explores the use of large language models for automated penetration testing in robotic environments. We propose an environment-grounded multi-agent architecture tailored to Robotics-based systems. The approach dynamically constructs a shared graph-based memory during execution that captures the observable system state, including network topology, communication channels, vulnerabilities, and attempted exploits. This enables structured automation while maintaining traceability and effective context management throughout the testing process. Evaluated across multiple iterations within a specialized robotics Capture-the-Flag scenario (ROS/ROS2), the system demonstrated high reliability, successfully completing the challenge in 100\% of test runs (n=5). This performance significantly exceeds literature benchmarks while maintaining the traceability and human oversight required by frameworks like the EU AI Act.

Related papers

• Bridging Language and Physics: Automated Design of Continuum Robots with Large Language Models [44.55124556245543]
  We propose a multi-layered framework, AID-SR, that establishes a closed loop by translating simulator-observed physical states into structured feedback for the LLM designer.<n>We evaluate our approach on tendon-driven continuum robots across a benchmark of 14 tasks spanning reaching, grasping, locomotion, and manipulation.<n>We fabricate three designed robots of AID-SR that successfully complete the task in real-world.
  arXiv  Detail & Related papers  (2026-09-08T04:02:59Z)
• ROSClaw: A Hierarchical Semantic-Physical Framework for Heterogeneous Multi-Agent Collaboration [9.434833852972353]
  ROSClaw is an agent framework for heterogeneous robots that integrates policy learning and task execution within a unified vision-language model (VLM) controller.<n>By establishing an autonomous closedloop framework, ROSClaw minimizes the reliance on robot-specific development.
  arXiv  Detail & Related papers  (2026-04-06T13:16:24Z)
• End-to-End O-RAN Testbed for Edge-AI-Enabled 5G/6G Connected Industrial Robotics [1.2179379138011863]
  We present a 5G/6G O-RAN-based end-to-end testbed that integrates E-AI for connected industrial robotic applications.<n>The testbed is used to investigate trade-offs among different data acquisition, edge processing, and real-time streaming approaches for robotic perception.
  arXiv  Detail & Related papers  (2026-03-13T20:14:32Z)
• RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation [68.7948300643741]
  We propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention.<n>RC-NF decouples the processing of task-aware robot and object states within the normalizing flow.<n>It achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks.
  arXiv  Detail & Related papers  (2026-03-11T10:14:37Z)
• ManipulationNet: An Infrastructure for Benchmarking Real-World Robot Manipulation with Physical Skill Challenges and Embodied Multimodal Reasoning [61.35327888597012]
  Dexterous manipulation enables robots to purposefully alter the physical world, transforming them from passive observers into active agents in unstructured environments.<n>Despite decades of advances in hardware, perception, control, and learning, progress toward general manipulation systems remains fragmented.<n>We introduce ManipulationNet, a global infrastructure that hosts real-world benchmark tasks for robotic manipulation.
  arXiv  Detail & Related papers  (2026-03-04T18:29:28Z)
• A Unified AI, Embedded, Simulation, and Mechanical Design Approach to an Autonomous Delivery Robot [0.0]
  This paper presents the development of a fully autonomous delivery robot integrating mechanical engineering, embedded systems, and artificial intelligence.<n>The platform employs a heterogeneous computing architecture, with RPi 5 and ROS 2 handling AI-based perception and path planning.<n>The mechanical design was optimized for payload capacity and mobility through precise motor selection and material engineering.
  arXiv  Detail & Related papers  (2025-12-26T23:39:54Z)
• Procedimiento de auditoría de ciberseguridad para sistemas autónomos: metodología, amenazas y mitigaciones [0.1759008116536278]
  This article presents a specific security auditing procedure for autonomous systems.<n>It is based on a layer-structured methodology, a threat taxonomy adapted to the robotic context, and concrete mitigation measures.
  arXiv  Detail & Related papers  (2025-11-07T12:06:21Z)
• Keeping it Local, Tiny and Real: Automated Report Generation on Edge Computing Devices for Mechatronic-Based Cognitive Systems [0.0]
  We propose a pipeline for generating automated reports in natural language utilizing various multi-modal sensors.<n>In particular, we evaluate our implementation on a diverse dataset spanning multiple domains including indoor, outdoor and urban environments.
  arXiv  Detail & Related papers  (2025-11-04T11:49:41Z)
• Real-Time Multimodal Signal Processing for HRI in RoboCup: Understanding a Human Referee [1.7456666582626115]
  This study implements a two-stage pipeline for gesture recognition through keypoint extraction and classification, alongside continuous convolutional neural networks (CCNNs) for efficient whistle detection. The proposed approach enhances real-time human-robot interaction in a competitive setting like RoboCup, offering some tools to advance the development of autonomous systems capable of cooperating with humans.
  arXiv  Detail & Related papers  (2024-11-26T11:39:43Z)
• Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics [68.36528819227641]
  This paper systematically evaluates the robustness of Vision-Language-Action (VLA) models.<n>We introduce two untargeted attack objectives that leverage spatial foundations to destabilize robotic actions, and a targeted attack objective that manipulates the robotic trajectory.<n>We design an adversarial patch generation approach that places a small, colorful patch within the camera's view, effectively executing the attack in both digital and physical environments.
  arXiv  Detail & Related papers  (2024-11-18T01:52:20Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy [68.7563053122698]
  We propose a reliable object detection and segmentation system with MultiModal Redundancy (MMRNet) This is the first system that introduces the concept of multimodal redundancy to address sensor failure issues during deployment. We present a new label-free multi-modal consistency (MC) score that utilizes the output from all modalities to measure the overall system output reliability and uncertainty.
  arXiv  Detail & Related papers  (2022-10-19T19:15:07Z)
• Integrated Benchmarking and Design for Reproducible and Accessible Evaluation of Robotic Agents [61.36681529571202]
  We describe a new concept for reproducible robotics research that integrates development and benchmarking. One of the central components of this setup is the Duckietown Autolab, a standardized setup that is itself relatively low-cost and reproducible. We validate the system by analyzing the repeatability of experiments conducted using the infrastructure and show that there is low variance across different robot hardware and across different remote labs.
  arXiv  Detail & Related papers  (2020-09-09T15:31:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.