Formation-Aware Adaptive Conformalized Perception for Safe Leader-Follower Multi-Robot Systems
- URL: http://arxiv.org/abs/2603.08958v1
- Date: Mon, 09 Mar 2026 21:44:20 GMT
- Title: Formation-Aware Adaptive Conformalized Perception for Safe Leader-Follower Multi-Robot Systems
- Abstract summary: Safety is challenging due to heteroscedastic perception errors and the coupling between formation maneuvers and visibility constraints.<n>We propose a distributed, formation-aware adaptive conformal prediction method based on Risk-Aware Mondrian CP to produce formation-conditioned uncertainty quantiles.
- Score: 3.2334188372270654
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper considers the perception safety problem in distributed vision-based leader-follower formations, where each robot uses onboard perception to estimate relative states, track desired setpoints, and keep the leader within its camera field of view (FOV). Safety is challenging due to heteroscedastic perception errors and the coupling between formation maneuvers and visibility constraints. We propose a distributed, formation-aware adaptive conformal prediction method based on Risk-Aware Mondrian CP to produce formation-conditioned uncertainty quantiles. The resulting bounds tighten in high-risk configurations (near FOV limits) and relax in safer regions. We integrate these bounds into a Formation-Aware Conformal CBF-QP with a smooth margin to enforce visibility while maintaining feasibility and tracking performance. Gazebo simulations show improved formation success rates and tracking accuracy over non-adaptive (global) CP baselines that ignore formation-dependent visibility risk, while preserving finite-sample probabilistic safety guarantees. The experimental videos are available on the \href{https://nail-uh.github.io/iros2026.github.io/}{project website}\footnote{Project Website: https://nail-uh.github.io/iros2026.github.io/}.
Related papers
- CoCoNav: Conformal Control for Safe Robot Navigation in Crowds [12.172167017799502]
We propose textitCoNav, a crowd-navigation framework that combines online conformal calibration with runtime-certified planning.<n>A horizon-specific conformal proportional--integral controller adapts trajectory-error bounds to regulate long-run empirical coverage.<n>A textitrelax-then-verify planner preserves solver feasibility by generating nominal trajectories with soft-constrained MPC.
arXiv Detail & Related papers (2026-08-07T20:34:52Z) - From Prediction Uncertainty to Conformalized Distance Fields for Safe Motion Planning [9.50741434664352]
Existing conformal approaches conformalize a scalar score that aggregates per-obstacle prediction errors.<n>We instead conformalize the entire predicted distance field at once.<n>This functional conformal prediction framework yields a distribution-free, field-level lower bound.
arXiv Detail & Related papers (2026-07-01T11:02:51Z) - From Attacks to Curricula: Learnability-Guided Adversarial Training for Safe Autonomous Driving [56.30087557121323]
AlignADV is a learnability-guided closed-loop adversarial training framework.<n>It converts adversarial scenarios into resolvable and capability-aligned curricula.<n> Experiments show it reduces training steps by up to 40.6 percent.
arXiv Detail & Related papers (2026-06-12T02:13:55Z) - Conflict-Aware Active Perception and Control in 3D Gaussian Splatting Fields via Control Barrier Functions [0.0]
We develop a conflict-aware active perception and control framework for robotic systems.<n>Safety is enforced using a Control Barrier Function (CBF) derived from an Average Value-at-Risk AV@R collision-risk metric.<n>To improve perception, we propose perception barrier functions that align the camera orientation with the local information-ascent direction.
arXiv Detail & Related papers (2026-05-19T23:51:23Z) - Safety-Guaranteed Imitation Learning from Nonlinear Model Predictive Control for Spacecraft Close Proximity Operations [39.146761527401424]
This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control.<n>We leverage Control Barrier Functions (CBFs) for safety certificates and Control Lyapunov Functions (CLFs) for stability as unified design principles across data generation, training, and deployment.<n>A runtime analysis demonstrates real-time feasibility on a commercial off-the-shelf processor, supporting onboard deployment for safety-critical on-orbit servicing.
arXiv Detail & Related papers (2026-03-19T13:47:18Z) - NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
arXiv Detail & Related papers (2025-06-23T14:28:30Z) - Learning Vision-Based Neural Network Controllers with Semi-Probabilistic Safety Guarantees [24.650302053973142]
We introduce a novel semi-probabilistic verification framework that integrates reachability analysis with conditional generative adversarial networks.<n>Next, we develop a gradient-based training approach that employs a novel safety loss function, safety-aware data-sampling strategy, and curriculum learning.<n> Empirical evaluations in X-Plane 11 airplane landing simulation, CARLA-simulated autonomous lane following, and F1Tenth lane following in a visually-rich miniature environment demonstrate the effectiveness of our method in achieving formal safety guarantees.
arXiv Detail & Related papers (2025-02-28T21:16:42Z) - ASMA: An Adaptive Safety Margin Algorithm for Vision-Language Drone Navigation via Scene-Aware Control Barrier Functions [9.645098673995317]
We consider a VLN-operated drone platform and enhance its safety by formulating a novel scene-aware CBF.<n>A CBF-less baseline system uses a Vision-Language with cross-modal attention to convert commands into an ordered sequence of landmarks.<n>ASMA tracks moving objects and performs scene-aware CBF evaluation on-the-fly, which serves as an additional constraint.
arXiv Detail & Related papers (2024-09-16T13:44:50Z) - Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations [50.37808220291108]
This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations.
We first propose robust output control barrier functions (ROCBFs) as a means to guarantee safety.
We then formulate an optimization problem to learn ROCBFs from expert demonstrations that exhibit safe system behavior.
arXiv Detail & Related papers (2021-11-18T23:21:00Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z) - Chance-Constrained Trajectory Optimization for Safe Exploration and
Learning of Nonlinear Systems [81.7983463275447]
Learning-based control algorithms require data collection with abundant supervision for training.
We present a new approach for optimal motion planning with safe exploration that integrates chance-constrained optimal control with dynamics learning and feedback control.
arXiv Detail & Related papers (2020-05-09T05:57:43Z) - Learning Control Barrier Functions from Expert Demonstrations [69.23675822701357]
We propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs)
We analyze an optimization-based approach to learning a CBF that enjoys provable safety guarantees under suitable Lipschitz assumptions on the underlying dynamical system.
To the best of our knowledge, these are the first results that learn provably safe control barrier functions from data.
arXiv Detail & Related papers (2020-04-07T12:29:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.