HeteroHub: An Applicable Data Management Framework for Heterogeneous Multi-Embodied Agent System

• URL: http://arxiv.org/abs/2603.28010v1
• Date: Mon, 30 Mar 2026 04:01:05 GMT
• Title: HeteroHub: An Applicable Data Management Framework for Heterogeneous Multi-Embodied Agent System
• Abstract summary: Heterogeneous Multi-Embodied Agent Systems involve coordinating multiple embodied agents with diverse capabilities to accomplish tasks in dynamic environments.<n>Existing frameworks lack a unified data management infrastructure to support the real-world deployment of such systems.<n>We present textbfHeteroHub, a data-centric framework that integrates static metadata, task-aligned training corpora, and real-time data streams.
• Score: 10.1098903025112
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Heterogeneous Multi-Embodied Agent Systems involve coordinating multiple embodied agents with diverse capabilities to accomplish tasks in dynamic environments. This process requires the collection, generation, and consumption of massive, heterogeneous data, which primarily falls into three categories: static knowledge regarding the agents, tasks, and environments; multimodal training datasets tailored for various AI models; and high-frequency sensor streams. However, existing frameworks lack a unified data management infrastructure to support the real-world deployment of such systems. To address this gap, we present \textbf{HeteroHub}, a data-centric framework that integrates static metadata, task-aligned training corpora, and real-time data streams. The framework supports task-aware model training, context-sensitive execution, and closed-loop control driven by real-world feedback. In our demonstration, HeteroHub successfully coordinates multiple embodied AI agents to execute complex tasks, illustrating how a robust data management framework can enable scalable, maintainable, and evolvable embodied AI systems.

Related papers

• What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents [81.23160457293714]
  LLM agents increasingly rely on generated interaction data to learn how to interact with external environments.<n>Existing work spans many agent domains, but domain-centered organization and heterogeneous evaluation often obscure common generation mechanisms.<n>This work develops a two-level framework for the field.
  arXiv  Detail & Related papers  (2026-08-27T15:43:50Z)
• Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence [115.91847478507736]
  LLMs have evolved from language generators to autonomous agents capable of complex, long-horizon tasks.<n>Many tasks require heterogeneous expertise, interdependent subtasks, parallel execution, independent verification, and persistent state.<n>We call this System Intelligence: an agent system's ability to organize and coordinate multiple intelligent components into a coherent, adaptive whole.
  arXiv  Detail & Related papers  (2026-08-21T14:27:57Z)
• HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents [57.53434680014667]
  HyMobileAgent is a vision-native foundation model built on Hy3.0-VL-A3B.<n>We develop a joint data and environment centric scaling framework to address the key bottlenecks of mobile interaction.
  arXiv  Detail & Related papers  (2026-07-16T04:12:42Z)
• Scaling Datasets for Multi-Sensor, Multi-Agent, and Multi-Domain Learning in Autonomous Systems [10.89128750728767]
  We present a modular dataset generation pipeline that creates terabyte-scale, ground-truth-labeled data for ground, aerial, and infrastructure-based systems.<n>We show how generated data can support application-specific training and collaborative autonomy.
  arXiv  Detail & Related papers  (2026-06-03T04:46:44Z)
• A Hierarchical Multi-Agent System for Autonomous Discovery in Geoscientific Data Archives [0.0]
  PANGAEA-GPT is a hierarchical multi-agent framework designed for autonomous data discovery and analysis.<n>Unlike standard Large Language Model (LLM) wrappers, our architecture implements a centralized Supervisor-Worker topology.<n>We demonstrate the system's capacity to execute complex, multi-step deterministic runtime with minimal human intervention.
  arXiv  Detail & Related papers  (2026-02-24T20:37:38Z)
• MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Era [74.42509044145417]
  MegaFlow is a large-scale distributed orchestration system that enables efficient scheduling, resource allocation, and fine-grained task management for agent-environment workloads.<n>In our agent training deployments, MegaFlow successfully orchestrates tens of thousands of concurrent agent tasks while maintaining high system stability and achieving efficient resource utilization.
  arXiv  Detail & Related papers  (2026-01-12T13:25:33Z)
• Matrix: Peer-to-Peer Multi-Agent Synthetic Data Generation Framework [32.3041485160475]
  We present textbf Matrix, a decentralized framework for multi-agent synthesis.<n> Matrix represents both control and data flow as serialized messages pass through distributed queues.<n>We evaluate Matrix across diverse synthesis scenarios, such as multi-agent collaborative dialogue, web-based reasoning data extraction, and tool-use trajectory generation in customer service environments.
  arXiv  Detail & Related papers  (2025-11-26T18:59:28Z)
• Efficient and Scalable Agentic AI with Heterogeneous Systems [1.8921715645847679]
  AI agents are emerging as a dominant workload in a wide range of applications, promising to be the vehicle that delivers the promised benefits of AI to enterprises and consumers.<n>To scale AI agent usage, we need efficient and scalable deployment and agent-serving infrastructure.<n>We present a system design for dynamic orchestration of AI agent workloads on heterogeneous compute infrastructure.
  arXiv  Detail & Related papers  (2025-07-25T19:02:42Z)
• Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence [79.5316642687565]
  Existing multi-agent frameworks often struggle with integrating diverse capable third-party agents. We propose the Internet of Agents (IoA), a novel framework that addresses these limitations. IoA introduces an agent integration protocol, an instant-messaging-like architecture design, and dynamic mechanisms for agent teaming and conversation flow control.
  arXiv  Detail & Related papers  (2024-07-09T17:33:24Z)
• AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning [98.26836657967162]
  textbfAgentOhana aggregates agent trajectories from distinct environments, spanning a wide array of scenarios. textbfxLAM-v0.1, a large action model tailored for AI agents, demonstrates exceptional performance across various benchmarks.
  arXiv  Detail & Related papers  (2024-02-23T18:56:26Z)
• An Interactive Agent Foundation Model [49.77861810045509]
  We propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents. Our training paradigm unifies diverse pre-training strategies, including visual masked auto-encoders, language modeling, and next-action prediction. We demonstrate the performance of our framework across three separate domains -- Robotics, Gaming AI, and Healthcare.
  arXiv  Detail & Related papers  (2024-02-08T18:58:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.