HPRM: High-Performance Robotic Middleware for Intelligent Autonomous Systems

• URL: http://arxiv.org/abs/2412.01799v1
• Date: Mon, 02 Dec 2024 18:46:29 GMT
• Title: HPRM: High-Performance Robotic Middleware for Intelligent Autonomous Systems
• Abstract summary: We present High-Performance Robotic Middleware (HPRM), built on top of the deterministic coordination language Lingua Franca (LF)<n>HPRM employs optimizations including an in-memory object store for efficient zero-copy transfer of large payloads, adaptive serialization to minimize serialization overhead, and an eager protocol with real-time sockets to reduce handshake latency.<n>We demonstrate the benefits of HPRM by integrating it with the CARLA simulator and running reinforcement learning agents along with object detection workloads.
• Score: 1.7838625117601146
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rise of intelligent autonomous systems, especially in robotics and autonomous agents, has created a critical need for robust communication middleware that can ensure real-time processing of extensive sensor data. Current robotics middleware like Robot Operating System (ROS) 2 faces challenges with nondeterminism and high communication latency when dealing with large data across multiple subscribers on a multi-core compute platform. To address these issues, we present High-Performance Robotic Middleware (HPRM), built on top of the deterministic coordination language Lingua Franca (LF). HPRM employs optimizations including an in-memory object store for efficient zero-copy transfer of large payloads, adaptive serialization to minimize serialization overhead, and an eager protocol with real-time sockets to reduce handshake latency. Benchmarks show HPRM achieves up to 173x lower latency than ROS2 when broadcasting large messages to multiple nodes. We then demonstrate the benefits of HPRM by integrating it with the CARLA simulator and running reinforcement learning agents along with object detection workloads. In the CARLA autonomous driving application, HPRM attains 91.1% lower latency than ROS2. The deterministic coordination semantics of HPRM, combined with its optimized IPC mechanisms, enable efficient and predictable real-time communication for intelligent autonomous systems.

Related papers

• SOAR: Real-Time Joint Optimization of Order Allocation and Robot Scheduling in Robotic Mobile Fulfillment Systems [15.939564928564588]
  We propose a unified Deep Reinforcement Learning framework for real-time joint optimization.<n>SOAR transforms order allocation and robot scheduling into a unified process by utilizing soft order allocations as observations.<n>We formulate this as an Event-Driven Markov Decision Process, enabling the agent to perform simultaneous scheduling in response to asynchronous system events.
  arXiv  Detail & Related papers  (2026-05-05T15:09:32Z)
• MARS: Efficient, Adaptive Co-Scheduling for Heterogeneous Agentic Systems [22.470203759341004]
  Large language models (LLMs) are increasingly deployed as the execution core of autonomous agents.<n> coordinating heterogeneous resource demands of agentic execution has emerged as a critical system challenge.<n>We design and implement MARS, an efficient and adaptive co-scheduling system.<n>Our evaluations show that MARS reduces end-to-end latency by up to 5.94x while maintaining nearly maximal system throughput.
  arXiv  Detail & Related papers  (2026-04-14T05:15:28Z)
• Bringing Network Coding into Multi-Robot Systems: Interplay Study for Autonomous Systems over Wireless Communications [48.38270830044451]
  Communication is a core enabler for multi-robot systems.<n>We show how transport-layer reliability mechanisms that mitigate communication losses and delays shape the autonomy-communication loop.<n>We present two case studies: cooperative localization under delayed and lossy inter-robot communication, and a safety-critical overtaking maneuver.
  arXiv  Detail & Related papers  (2026-03-18T08:26:17Z)
• Bridging the Sim-to-Real Gap with multipanda ros2: A Real-Time ROS2 Framework for Multimanual Systems [22.26675117934127]
  We present $multipanda_ros2$, a novel open-source ROS2 architecture for multi-robot control of Franka Robotics robots.<n>Our core contributions address key challenges in real-time torque control, including interaction control and robot-environment modeling.
  arXiv  Detail & Related papers  (2026-02-02T16:11:12Z)
• ComAgent: Multi-LLM based Agentic AI Empowered Intelligent Wireless Networks [62.031889234230725]
  6G networks rely on complex cross-layer optimization.<n> manually translating high-level intents into mathematical formulations remains a bottleneck.<n>We present ComAgent, a multi-LLM agentic AI framework.
  arXiv  Detail & Related papers  (2026-01-27T13:43:59Z)
• A Unified AI, Embedded, Simulation, and Mechanical Design Approach to an Autonomous Delivery Robot [0.0]
  This paper presents the development of a fully autonomous delivery robot integrating mechanical engineering, embedded systems, and artificial intelligence.<n>The platform employs a heterogeneous computing architecture, with RPi 5 and ROS 2 handling AI-based perception and path planning.<n>The mechanical design was optimized for payload capacity and mobility through precise motor selection and material engineering.
  arXiv  Detail & Related papers  (2025-12-26T23:39:54Z)
• Reducing Latency in LLM-Based Natural Language Commands Processing for Robot Navigation [0.2516577526761521]
  This study explores the integration of the ChatGPT natural language model with the Robot Operating System 2 (ROS 2) to mitigate interaction latency.<n>We present an architecture that integrates these technologies without requiring a transport platform.<n> Experimental results demonstrate that this integration improves execution speed, usability, and accessibility of the human-robot interaction.
  arXiv  Detail & Related papers  (2025-05-29T21:16:14Z)
• KAITIAN: A Unified Communication Framework for Enabling Efficient Collaboration Across Heterogeneous Accelerators in Embodied AI Systems [5.241889216655924]
  KAITIAN is a novel distributed communication framework for AI workloads.<n>It integrates vendor-optimized communication libraries for intra-group efficiency with general-purpose communication protocols for inter-group interoperability.<n>It can accelerate training time by up to 42% compared to baseline homogeneous systems.
  arXiv  Detail & Related papers  (2025-05-15T11:29:43Z)
• DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution [114.61347672265076]
  Development of MLLMs for real-world robots is challenging due to the typically limited computation and memory capacities available on robotic platforms. We propose a Dynamic Early-Exit Framework for Robotic Vision-Language-Action Model (DeeR) that automatically adjusts the size of the activated MLLM. DeeR demonstrates significant reductions in computational costs of LLM by 5.2-6.5x and GPU memory of LLM by 2-6x without compromising performance.
  arXiv  Detail & Related papers  (2024-11-04T18:26:08Z)
• Communication- and Computation-Efficient Distributed Decision-Making in Multi-Robot Networks [2.8936428431504164]
  We provide a distributed coordination paradigm that enables scalable and near-optimal joint motion planning among multiple robots. Our algorithm is up to two orders faster than competitive near-optimal algorithms. In simulations of surveillance tasks with up to 45 robots, it enables real-time planning at the order of 1 Hz with superior coverage performance.
  arXiv  Detail & Related papers  (2024-07-15T01:25:39Z)
• Intelligent Trajectory Design for RIS-NOMA aided Multi-robot Communications [59.34642007625687]
  The goal is to maximize the sum-rate of whole trajectories for multi-robot system by jointly optimizing trajectories and NOMA decoding orders of robots. An integrated machine learning (ML) scheme is proposed, which combines long short-term memory (LSTM)-autoregressive integrated moving average (ARIMA) model and dueling double deep Q-network (D$3$QN) algorithm.
  arXiv  Detail & Related papers  (2022-05-03T17:14:47Z)
• Collaborative Intelligent Reflecting Surface Networks with Multi-Agent Reinforcement Learning [63.83425382922157]
  Intelligent reflecting surface (IRS) is envisioned to be widely applied in future wireless networks. In this paper, we investigate a multi-user communication system assisted by cooperative IRS devices with the capability of energy harvesting.
  arXiv  Detail & Related papers  (2022-03-26T20:37:14Z)
• Time-Correlated Sparsification for Efficient Over-the-Air Model Aggregation in Wireless Federated Learning [23.05003652536773]
  Federated edge learning (FEEL) is a promising distributed machine learning (ML) framework to drive edge intelligence applications. We propose time-correlated sparsification with hybrid aggregation (TCS-H) for communication-efficient FEEL.
  arXiv  Detail & Related papers  (2022-02-17T02:48:07Z)
• A Robot Web for Distributed Many-Device Localisation [18.417301483203996]
  We show that a distributed network of robots can collaborate to globally localise via efficient ad-hoc peer to peer communication. We show in simulations with up to 1000 robots interacting in arbitrary patterns that our solution convergently achieves global accuracy as accurate as a non-linear factor graph solver.
  arXiv  Detail & Related papers  (2022-02-07T16:00:25Z)
• Asynchronous Parallel Incremental Block-Coordinate Descent for Decentralized Machine Learning [55.198301429316125]
  Machine learning (ML) is a key technique for big-data-driven modelling and analysis of massive Internet of Things (IoT) based intelligent and ubiquitous computing. For fast-increasing applications and data amounts, distributed learning is a promising emerging paradigm since it is often impractical or inefficient to share/aggregate data. This paper studies the problem of training an ML model over decentralized systems, where data are distributed over many user devices.
  arXiv  Detail & Related papers  (2022-02-07T15:04:15Z)
• Communication-Computation Efficient Device-Edge Co-Inference via AutoML [4.06604174802643]
  Device-edge co-inference partitions a deep neural network between a resource-constrained mobile device and an edge server. On-device model sparsity level and intermediate feature compression ratio have direct impacts on workload and communication overhead. We propose a novel automated machine learning (AutoML) framework based on deep reinforcement learning (DRL)
  arXiv  Detail & Related papers  (2021-08-30T06:36:30Z)
• SABER: Data-Driven Motion Planner for Autonomously Navigating Heterogeneous Robots [112.2491765424719]
  We present an end-to-end online motion planning framework that uses a data-driven approach to navigate a heterogeneous robot team towards a global goal. We use model predictive control (SMPC) to calculate control inputs that satisfy robot dynamics, and consider uncertainty during obstacle avoidance with chance constraints. recurrent neural networks are used to provide a quick estimate of future state uncertainty considered in the SMPC finite-time horizon solution. A Deep Q-learning agent is employed to serve as a high-level path planner, providing the SMPC with target positions that move the robots towards a desired global goal.
  arXiv  Detail & Related papers  (2021-08-03T02:56:21Z)
• EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference [82.1584439276834]
  Transformer-based language models such as BERT provide significant accuracy improvement for a multitude of natural language processing (NLP) tasks. We present EdgeBERT, an in-depth algorithm- hardware co-design for latency-aware energy optimization for multi-task NLP.
  arXiv  Detail & Related papers  (2020-11-28T19:21:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.