Differentiable Environment-Trajectory Co-Optimization for Safe Multi-Agent Navigation

• URL: http://arxiv.org/abs/2604.06972v1
• Date: Wed, 08 Apr 2026 11:43:38 GMT
• Title: Differentiable Environment-Trajectory Co-Optimization for Safe Multi-Agent Navigation
• Abstract summary: The environment plays a critical role in multi-agent navigation by imposing spatial constraints, rules, and limitations that agents must navigate around.<n>This work considers environment configurations as decision variables, alongside agent actions, to jointly achieve safe navigation.
• Score: 27.7147161884966
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The environment plays a critical role in multi-agent navigation by imposing spatial constraints, rules, and limitations that agents must navigate around. Traditional approaches treat the environment as fixed, without exploring its impact on agents' performance. This work considers environment configurations as decision variables, alongside agent actions, to jointly achieve safe navigation. We formulate a bi-level problem, where the lower-level sub-problem optimizes agent trajectories that minimize navigation cost and the upper-level sub-problem optimizes environment configurations that maximize navigation safety. We develop a differentiable optimization method that iteratively solves the lower-level sub-problem with interior point methods and the upper-level sub-problem with gradient ascent. A key challenge lies in analytically coupling these two levels. We address this by leveraging KKT conditions and the Implicit Function Theorem to compute gradients of agent trajectories w.r.t. environment parameters, enabling differentiation throughout the bi-level structure. Moreover, we propose a novel metric that quantifies navigation safety as a criterion for the upper-level environment optimization, and prove its validity through measure theory. Our experiments validate the effectiveness of the proposed framework in a variety of safety-critical navigation scenarios, inspired from warehouse logistics to urban transportation. The results demonstrate that optimized environments provide navigation guidance, improving both agents' safety and efficiency.

Related papers

• Agentic AI for Bilevel Long-Term Optimization of Policy-Driven Physical Layer Systems [56.931625543734306]
  Agentic-O is a nested bilevel optimization framework that can be applied to adaptive physical layer problem configuration.<n>Agentic-O exhibits strong adaptability to dynamic operator policies and effectively enhances the system's long-term performance by 57.2% compared to traditional methods.
  arXiv  Detail & Related papers  (2026-06-23T10:53:12Z)
• Move What Matters: Parameter-Efficient Domain Adaptation via Optimal Transport Flow for Collaborative Perception [8.774658029766988]
  FlowAdapt is a parameter-efficient framework grounded in optimal transport theory.<n>We introduce a Wasserstein Greedy Sampling strategy to selectively filter redundant samples.<n> Progressive Knowledge Transfer module is designed to inject compressed early-stage representations into later stages.
  arXiv  Detail & Related papers  (2026-02-12T04:36:50Z)
• STRIDER: Navigation via Instruction-Aligned Structural Decision Space Optimization [73.98141357780032]
  VLN-CE task requires agents to navigate 3D environments using natural language instructions, without any scene-specific training.<n>Existing methods often fail to achieve robust navigation due to a lack of structured decision-making and insufficient integration of feedback from previous actions.<n>We propose STRIDER, a novel framework that systematically optimize the agent's decision space by integrating spatial layout priors and dynamic task feedback.<n>Our approach introduces two key innovations: 1) a Structured Waypoint Generator that constrains the action space through spatial structure, and 2) a Task-Alignment Regulator that adjusts behavior based on task progress, ensuring semantic alignment throughout navigation.
  arXiv  Detail & Related papers  (2025-10-27T04:37:21Z)
• DAgger Diffusion Navigation: DAgger Boosted Diffusion Policy for Vision-Language Navigation [73.80968452950854]
  Vision-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural language instructions through free-form 3D spaces.<n>Existing VLN-CE approaches typically use a two-stage waypoint planning framework.<n>We propose DAgger Diffusion Navigation (DifNav) as an end-to-end optimized VLN-CE policy.
  arXiv  Detail & Related papers  (2025-08-13T02:51:43Z)
• An Optimisation Framework for Unsupervised Environment Design [88.29733214939544]
  unsupervised environment design (UED) aims to maximise agent's general robustness.<n>We provide a provably convergent algorithm in the zero-sum setting.<n>We empirically verify the efficacy of our method.
  arXiv  Detail & Related papers  (2025-05-27T03:07:26Z)
• Safe Gradient Flow for Bilevel Optimization [6.3963012138521975]
  Bilevel optimization is a key framework in hierarchical decision-making.<n>We propose a control-theoretic approach to solving bilevel optimization problems.
  arXiv  Detail & Related papers  (2025-01-27T21:39:25Z)
• Co-Optimizing Reconfigurable Environments and Policies for Decentralized Multi-Agent Navigation [14.533605727697775]
  This work views the multi-agent system and its surrounding environment as a co-evolving system, where the behavior of one affects the other.<n>By introducing two sub-objectives -- multi-agent navigation and environment optimization -- we propose an agent co-optimization problem.
  arXiv  Detail & Related papers  (2024-03-21T17:37:43Z)
• TAS: A Transit-Aware Strategy for Embodied Navigation with Non-Stationary Targets [55.09248760290918]
  We present a novel algorithm for navigation in dynamic scenarios with non-stationary targets.<n>Our novel Transit-Aware Strategy (TAS) enriches embodied navigation policies with object path information.<n> TAS improves performance in non-stationary environments by rewarding agents for synchronizing their routes with target routes.
  arXiv  Detail & Related papers  (2024-03-14T22:33:22Z)
• Constrained Environment Optimization for Prioritized Multi-Agent Navigation [11.473177123332281]
  This paper aims to consider the environment as a decision variable in a system-level optimization problem. We propose novel problems of unprioritized and prioritized environment optimization. We show, through formal proofs, under which conditions the environment can change while guaranteeing completeness.
  arXiv  Detail & Related papers  (2023-05-18T18:55:06Z)
• Environment Optimization for Multi-Agent Navigation [11.473177123332281]
  The goal of this paper is to consider the environment as a decision variable in a system-level optimization problem. We show, through formal proofs, under which conditions the environment can change while guaranteeing completeness. In order to accommodate a broad range of implementation scenarios, we include both online and offline optimization, and both discrete and continuous environment representations.
  arXiv  Detail & Related papers  (2022-09-22T19:22:16Z)
• The multi-objective optimisation of breakwaters using evolutionary approach [62.997667081978825]
  In engineering practice, it is often necessary to increase the effectiveness of existing protective constructions for ports and coasts. In the paper, the multi-objective evolutionary approach for the breakwaters optimisation is proposed.
  arXiv  Detail & Related papers  (2020-04-06T21:48:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.