Riding the Shifting Potential: When Reactive Control Suffices for Multi-Goal Behavior
- URL: http://arxiv.org/abs/2605.27314v1
- Date: Tue, 26 May 2026 17:24:46 GMT
- Title: Riding the Shifting Potential: When Reactive Control Suffices for Multi-Goal Behavior
- Abstract summary: We exploit encodings that fail to reflect how objectives currently are.<n>We demonstrate this in two domains where conflicts interact by extending the nullspace.<n>The same formulation transfers directly to a real robot with additional control.
- Score: 7.648784748888186
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Reactive control is often considered insufficient for multi-objective tasks because conflicting objectives give rise to local minima. We argue this limitation is not inherent but arises from static encodings that fail to reflect how objectives currently interact. We exploit the interaction structure encoded in a graph-based world model by extending it with nullspace projections: conflicts are resolved where they arise by projecting lower-priority gradients into the nullspace of higher-priority ones, with priorities determined continuously from the current state. We demonstrate this in two domains where conflicts between objectives are central: navigation around non-convex obstacles, where static potential fields fundamentally fail, and planar pushing of non-convex objects, where our method achieves $100\%$ success across one-hundred configurations versus $0\%$ for the steepest-descent baseline and ${\sim}55\%$ for diffusion policy, without demonstrations or retraining. The same formulation transfers directly to a real robot with additional perceptual and kinematic constraints, accommodating them through the same mechanism.
Related papers
- VAIC: Vision-Guided Humanoid Agile Object Interaction Control via Decoupled Commands [56.029505206531155]
Vision Guided Agile Interaction Control (VAIC) is a unified framework that bridges the gap between current controllers and humanoid robots.<n>First, a privileged teacher policy masters diverse interaction skills using precise object kinematics and exact environmental states.<n>Second, a deployable student policy distills these capabilities by replacing full body tracking with velocity targets across multiple axes.
arXiv Detail & Related papers (2026-06-08T09:52:55Z) - Beyond Waypoints: Dual-Heatmap Grounding for Cross-Embodiment Semantic Navigation [13.081539889943906]
In this work, we focus on the practical setting of in-FOV semantic navigation.<n>We propose a unified Vision-Language framework that abandons single-point regression in favor of a Dual-Heatmap representation.<n>Our framework achieves state-of-the-art performance among comparable 8B baselines.
arXiv Detail & Related papers (2026-05-19T06:12:59Z) - Learning Reactive Dexterous Grasping via Hierarchical Task-Space RL Planning and Joint-Space QP Control [50.28263951510334]
We propose a hybrid hierarchical control framework for reactive dexterous grasping.<n>The proposed framework explicitly decouples high-level spatial intent from low-level joint execution.<n>We extensively validate the proposed framework through a rigorous simulation-to-reality pipeline.
arXiv Detail & Related papers (2026-05-05T04:49:38Z) - ANCHOR: A Physically Grounded Closed-Loop Framework for Robust Home-Service Mobile Manipulation [10.278758849939917]
We present ANCHOR, a closed-loop framework that aligns symbolic reasoning with verifiable physical state during execution.<n>ANCHOR improves task success from 53.3% to 71.7% and achieves a 71.4% recovery rate under perturbations.
arXiv Detail & Related papers (2026-04-28T07:37:39Z) - ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
arXiv Detail & Related papers (2026-03-03T18:59:29Z) - Position: General Alignment Has Hit a Ceiling; Edge Alignment Must Be Taken Seriously [51.03213216886717]
We take the position that the dominant paradigm of General Alignment reaches a structural ceiling in settings with conflicting values.<n>We introduce Edge Alignment as a distinct approach in which systems preserve multi dimensional value structure.
arXiv Detail & Related papers (2026-02-23T16:51:43Z) - HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model [56.4392302336014]
We present HAIC, a framework for robust interaction across diverse object dynamics without external state estimation.<n>Our key contribution is a dynamics predictor that estimates high-order object states (velocity, acceleration) solely from proprioceptive history.<n> Experiments on a humanoid robot show HAIC achieves high success rates in agile tasks.
arXiv Detail & Related papers (2026-02-12T09:34:35Z) - Domain Expansion: A Latent Space Construction Framework for Multi-Task Learning [26.322513515274764]
Training a single network with multiple objectives often leads to conflicting gradients that degrade shared representations.<n>We introduce Domain Expansion, a framework that prevents these conflicts by restructuring the latent space itself.
arXiv Detail & Related papers (2026-01-27T21:30:21Z) - Mastering Diverse, Unknown, and Cluttered Tracks for Robust Vision-Based Drone Racing [22.63301233637327]
Most reinforcement learning methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed.<n>This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training.<n>We propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance.
arXiv Detail & Related papers (2025-12-10T12:02:48Z) - Null Counterfactual Factor Interactions for Goal-Conditioned Reinforcement Learning [22.778380035995127]
Hindsight relabeling is a powerful tool for overcoming sparsity in goal-conditioned reinforcement learning.<n>We introduce Interactions (HInt), which combines interactions with hindsight relabeling to improve the sample efficiency of downstream RL.
arXiv Detail & Related papers (2025-05-06T04:32:47Z) - On Generating Transferable Targeted Perturbations [102.3506210331038]
We propose a new generative approach for highly transferable targeted perturbations.
Our approach matches the perturbed image distribution' with that of the target class, leading to high targeted transferability rates.
arXiv Detail & Related papers (2021-03-26T17:55:28Z) - Offline Contextual Bandits with Overparameterized Models [52.788628474552276]
We ask whether the same phenomenon occurs for offline contextual bandits.
We show that this discrepancy is due to the emphaction-stability of their objectives.
In experiments with large neural networks, this gap between action-stable value-based objectives and unstable policy-based objectives leads to significant performance differences.
arXiv Detail & Related papers (2020-06-27T13:52:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.