When Does Hierarchy Help? Benchmarking Agent Coordination in Event-Driven Industrial Scheduling

• URL: http://arxiv.org/abs/2605.13172v1
• Date: Wed, 13 May 2026 08:33:28 GMT
• Title: When Does Hierarchy Help? Benchmarking Agent Coordination in Event-Driven Industrial Scheduling
• Abstract summary: DESBench is a benchmark for evaluating agent coordination in hierarchical event-driven scheduling.<n>We focus on four representative coordination paradigms: centralized, hierarchical, heterarchical, and holonic.
• Score: 7.912877527497326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in agent and multi-agent systems have shown strong performance on tool use, reasoning, and collaborative tasks. However, existing benchmarks mostly evaluate task completion in weakly coupled environments, and provide limited support for studying coordination in shared, dynamically evolving systems with hierarchy and coupled constraints. This leaves an important question underexplored: when do different coordination paradigms succeed or fail? We introduce Distributed Event-driven Scheduling Benchmark (DESBench), a benchmark for evaluating agent coordination in hierarchical event-driven scheduling. Built on a shared discrete-event driven environment in industrial scheduling, our benchmark captures multi-timescale decision making, partial observability, and dynamically coupled constraints. We define tasks and metrics that evaluate effectiveness, constraint alignment, coordination efficiency, and robustness, and focus on four representative coordination paradigms: centralized, hierarchical, heterarchical, and holonic. These paradigms correspond to distinct mechanisms of information flow, decision authority, and conflict resolution. Our controlled evaluations reveal clear coordination trade-offs: centralized coordination is robust and communication-efficient but scales poorly with difficulty; hierarchical coordination improves efficiency through decomposition but suffers from cross-level misalignment; heterarchical coordination is flexible but communication-heavy; and holonic coordination satisfies constraints well but loses global robustness. These findings demonstrate that coordination design fundamentally shapes agent system behavior in complex environments, revealing structural trade-offs that cannot be captured by outcome metrics alone and underscoring the imperative for more adaptive, principled, and dynamic coordination mechanisms in future MAS research.

Related papers

• CoCoBench: A Cooperative Coordination Benchmark for Embodied Multi-Agent Task Planning [26.72126160106256]
  CoCoBench is a construct-level benchmark for evaluating multi-agent embodied coordination in executable household tasks.<n>We evaluate 11 leading MLLMs across different coordination modes, observation inputs, and numbers of agents.
  arXiv  Detail & Related papers  (2026-08-28T12:29:23Z)
• Communication-Efficient Digital-Twin Coordination for Heterogeneous LLM Embodied Agents over Computing Power Networks [48.90302419915548]
  Embodied agent teams powered by heterogeneous large language models (LLMs) are being widely deployed in smart factories, warehouses, and service robotics.<n>We propose LDT-Coord, a networked coordination framework built upon a lightweight digital twin (DT)<n>Specifically, each agent independently selects its intended action and reports both the action decision and a structured temporal constraint over shared resources to the DT server.
  arXiv  Detail & Related papers  (2026-07-10T12:10:31Z)
• Multi-Agent Coordination Adaptation via Structure-Guided Orchestration [5.230083115652549]
  We introduce MACA, an automated coordination framework that learns a task- and budget-conditioned structural prior over agent participation and interactions.<n>Across benchmarks, MACA outperforms adaptive multi-agent baselines by an average of 8.42% while using 43.19% fewer tokens.<n>Further investigation reveals that joint adaptation of structure and orchestrations suppresses redundant interactions, converging coordination toward task-effective execution.
  arXiv  Detail & Related papers  (2026-05-25T11:59:58Z)
• HCLM: A Hierarchical Framework for Cooperative Loco-Manipulation with Dual Quadrupeds [24.47863400717969]
  We introduce HCLM, a hierarchical framework for general-purpose cooperative loco-manipulation with dual quadrupedal systems.<n>Our architecture systematically decouples high-level collaborative reasoning from low-level robust motion execution.<n>Results demonstrate reliable task execution, strict configurationism, and exceptional resilience against severe physical perturbations.
  arXiv  Detail & Related papers  (2026-05-17T07:23:03Z)
• Coordination Matters: Evaluation of Cooperative Multi-Agent Reinforcement Learning [1.9806597528054068]
  We propose a coordination-aware evaluation perspective that supplements return with process-level diagnostics.<n>We instantiate this perspective using STAT, a controlled commitment-constrained spatial task-allocation testbed.<n>Our results show that similar return trends can reflect distinct coordination mechanisms, including differences in redundant assignment, assignment diversity, and task-completion efficiency.
  arXiv  Detail & Related papers  (2026-05-07T16:50:53Z)
• Improving the Efficiency of Language Agent Teams with Adaptive Task Graphs [52.26652574704317]
  Large language models (LLMs) are increasingly deployed in teams, yet existing coordination approaches often occupy two extremes.<n>We introduce Language Agent Teams for Task Evolution (LATTE), a framework for coordinating LLM teams inspired by distributed systems.
  arXiv  Detail & Related papers  (2026-05-07T14:19:17Z)
• DR. WELL: Dynamic Reasoning and Learning with Symbolic World Model for Embodied LLM-Based Multi-Agent Collaboration [18.250351934101463]
  DR. WELL is a decentralized neurosymbolic framework for cooperative multi-agent planning.<n>Agents propose candidate roles and commit to a joint allocation under consensus and environment constraints.<n>Each agent independently generates and executes a symbolic plan for its role without revealing detailed trajectories.
  arXiv  Detail & Related papers  (2025-11-06T18:37:18Z)
• Joint Optimization of Cooperation Efficiency and Communication Covertness for Target Detection with AUVs [105.81167650318054]
  This paper investigates underwater cooperative target detection using autonomous underwater vehicles (AUVs)<n>We first formulate a joint trajectory and power control optimization problem, and then present an innovative hierarchical action management framework to solve it.<n>Under the centralized training and decentralized execution paradigm, our target detection framework enables adaptive covert cooperation while satisfying both energy and mobility constraints.
  arXiv  Detail & Related papers  (2025-10-21T02:14:11Z)
• Deep Reinforcement Learning for Multi-Agent Coordination [8.250169938213558]
  We propose a Stigmergic Multi-Agent Deep Reinforcement Learning (S-MADRL) framework that leverages virtual pheromones to model local and social interactions.<n>We show that our framework achieves the most effective coordination of up to eight agents, where robots self-organize into asymmetric workload distributions.<n>This emergent behavior, analogous to strategies observed in nature, demonstrates a scalable solution for decentralized multi-agent coordination in crowded environments.
  arXiv  Detail & Related papers  (2025-10-04T00:47:20Z)
• Diagnose, Localize, Align: A Full-Stack Framework for Reliable LLM Multi-Agent Systems under Instruction Conflicts [75.20929587906228]
  Large Language Model (LLM)-powered multi-agent systems (MAS) have rapidly advanced collaborative reasoning, tool use, and role-specialized coordination in complex tasks.<n>However, reliability-critical deployment remains hindered by a systemic failure mode: hierarchical compliance under instruction conflicts.
  arXiv  Detail & Related papers  (2025-09-27T08:43:34Z)
• A Taxonomy of Hierarchical Multi-Agent Systems: Design Patterns, Coordination Mechanisms, and Industrial Applications [0.0]
  Hierarchical multi-agent systems (HMAS) organize collections of agents into layered structures that help manage complexity and scale.<n>This paper proposes a multi-dimensional taxonomy for HMAS along five axes: control hierarchy, information flow, role and task delegation, temporal layering, and communication structure.
  arXiv  Detail & Related papers  (2025-08-18T07:36:33Z)
• MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents [59.825725526176655]
  Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents.<n>Existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination and competition.<n>We introduce MultiAgentBench, a benchmark designed to evaluate LLM-based multi-agent systems across diverse, interactive scenarios.
  arXiv  Detail & Related papers  (2025-03-03T05:18:50Z)
• Communication Learning in Multi-Agent Systems from Graph Modeling Perspective [62.13508281188895]
  We introduce a novel approach wherein we conceptualize the communication architecture among agents as a learnable graph. We introduce a temporal gating mechanism for each agent, enabling dynamic decisions on whether to receive shared information at a given time.
  arXiv  Detail & Related papers  (2024-11-01T05:56:51Z)
• Bottom-up mechanism and improved contract net protocol for the dynamic task planning of heterogeneous Earth observation resources [61.75759893720484]
  Earth observation resources are becoming increasingly indispensable in disaster relief, damage assessment and related domains. Many unpredicted factors, such as the change of observation task requirements, to the occurring of bad weather and resource failures, may cause the scheduled observation scheme to become infeasible. A bottom-up distributed coordinated framework together with an improved contract net are proposed to facilitate the dynamic task replanning for heterogeneous Earth observation resources.
  arXiv  Detail & Related papers  (2020-07-13T03:51:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.