PaCo-VLA: Passivity-Shielded Compliance Prior for Contact-Rich Vision-Language-Action Manipulation
- URL: http://arxiv.org/abs/2606.00515v1
- Date: Sat, 30 May 2026 04:06:39 GMT
- Title: PaCo-VLA: Passivity-Shielded Compliance Prior for Contact-Rich Vision-Language-Action Manipulation
- Abstract summary: Contact-rich manipulation demands both high-level semantic reasoning and the safe regulation of high-frequency contact dynamics.<n>We introduce PaCo-VLA, a passivity-shielded compliance prior that recasts the VLA interface.
- Score: 16.000925198937082
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Contact-rich manipulation demands both high-level semantic reasoning and the safe regulation of high-frequency contact dynamics. While Vision-Language-Action (VLA) models provide unprecedented semantic generalization, their low-rate outputs lack the reliability required for direct plant authority in force-sensitive tasks. To bridge this semantic-to-control gap, we introduce PaCo-VLA, a passivity-shielded compliance prior that recasts the VLA interface. Rather than trusting VLAs with direct motor commands, PaCo-VLA treats network outputs as task-level compliance proposals: semantic bindings, task stages, and admittance schedules. A high-frequency, proposal-independent passivity shield governs these proposals through energy-tank accounting and boundary checks, preventing invalid, stale, or unverified model predictions from bypassing low-level contact physics. This decoupled architecture also enables causal evaluation, isolating semantic contributions from geometric shortcuts. Extensive simulated and real-world connector-insertion experiments demonstrate that PaCo-VLA achieves superior precision over unshielded VLA baselines, sustaining zero passivity violations even under adversarial compliance shifts. This framework establishes a provably sampled-passive runtime contract at the admittance port and provides a runtime interface for deploying foundation models in contact-rich domains.
Related papers
- CR-VLA-Force: Learning Control-aware Compliance VLA Model for Robust Contact-rich Robotic Manipulation [22.8919569384701]
We propose a Control-aware Compliance VLA framework for reactive control.<n>The CC-VLA model employs a multimodal mixture-of-experts (MoE) to encode force signal sequences and vision-language fused feature.<n>We show that CC-VLA significantly improves success rates in challenging force-perception tasks and enhances force-control precision.
arXiv Detail & Related papers (2026-09-05T02:54:51Z) - Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach [60.596944437968524]
PartialVisGraph is a novel framework for robust skeleton-based action recognition under constrained field-of-view.<n>It consistently achieves state-of-the-art accuracy under partial visibility, with gains of up to 68.8% on subsets with severe FoV restrictions.<n>Our approach offers a principled and practical pathway toward deployable skeleton-based action understanding in unconstrained environments.
arXiv Detail & Related papers (2026-07-01T10:03:11Z) - Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models [3.4519796338615225]
We propose a novel Vision-Language-Action (VLA) framework that models reasoning as a sequence of unobservable latent variables.<n>We introduce a Reinforcement Learning-based Denoising mechanism that treats latent state generation as a sequential decision process.<n>Experiments on embodied decision benchmarks demonstrate that AVA-VLA achieves a 6x inference speedup over explicit CoT methods.
arXiv Detail & Related papers (2026-06-13T04:16:18Z) - VLAConf: Calibrated Task-Success Confidence for Vision-Language-Action Models [7.329348634749636]
We propose VLAConf, a one-class discriminative confidence framework for Vision-Language-Action (VLA) models.<n>By leveraging frozen pretrained VLA internal representations, VLAConf directly estimates step-wise anomaly scores in a single forward pass.<n>Experiments on the LIBERO benchmark demonstrate that VLAConf significantly improves the quality of the confidence signal constructed for post-hoc calibration.
arXiv Detail & Related papers (2026-05-28T08:42:12Z) - VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model [54.35791816657227]
We introduce textbfVLA-ATTC', a framework that endows VLA models with adaptive test-time compute.<n>VLA-ATTC employs an uncertainty-based cognitive clutch'' to dynamically transition from reflexive execution to a TTC deliberation phase.<n>On the LIBERO-LONG benchmark, VLA-ATTC reduces the failure rate of the SOTA model PI0.5 by over 50%.
arXiv Detail & Related papers (2026-05-02T02:13:11Z) - AIVV: Neuro-Symbolic LLM Agent-Integrated Verification and Validation for Trustworthy Autonomous Systems [6.586256098975453]
Agent-Integrated Verification and Validation (AIVV) is a hybrid framework that deploys Large Language Models (LLMs) as a deliberative outer loop.<n>The council agents perform collaborative validation by semantically validating nuisance and true failures.<n> Experiments on a time-series simulator for Unmanned Underwater Vehicles (UUVs) demonstrate that AIVV successfully digitizes the HITL V&V process.
arXiv Detail & Related papers (2026-04-02T19:25:18Z) - DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models [50.07453075750711]
Vision-Language-Action (VLA) models map visual observations and language instructions directly to robotic actions.<n>Recent efforts have incorporated Chain-of-Thought (CoT) reasoning to endow VLA models with a thinking before acting'' capability.<n>We propose DualCoT-VLA, a visual-linguistic CoT method for VLA models with a parallel reasoning mechanism.
arXiv Detail & Related papers (2026-03-23T17:59:25Z) - Enabling Dynamic Tracking in Vision-Language-Action Models via Time-Discrete and Time-Continuous Velocity Feedforward [11.066720921275648]
Vision-language-action (VLA) models have shown great promise for robot manipulation.<n>Their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness.<n>This paper shows the importance of integrating velocity feedforward terms into VLA policies to resolve this trade-off.
arXiv Detail & Related papers (2026-03-17T07:50:00Z) - VISA: Value Injection via Shielded Adaptation for Personalized LLM Alignment [24.492954219955788]
We propose a closed-loop framework designed to navigate the trade-off between fine-tuning and Aligning Large Language Models (LLMs)<n> VISA features a high-precision value detector, a semantic-to-value translator, and a core value-rewriter.<n>Our experiments demonstrate that this approach enables precise control over a model's value expression while maintaining its factual consistency and general capabilities.
arXiv Detail & Related papers (2026-03-05T05:12:26Z) - OmniVL-Guard: Towards Unified Vision-Language Forgery Detection and Grounding via Balanced RL [63.388513841293616]
Existing forgery detection methods fail to handle the interleaved text, images, and videos prevalent in real-world misinformation.<n>To bridge this gap, this paper targets to develop a unified framework for omnibus vision-language forgery detection and grounding.<n>We propose textbf OmniVL-Guard, a balanced reinforcement learning framework for omnibus vision-language forgery detection and grounding.
arXiv Detail & Related papers (2026-02-11T09:41:36Z) - Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models [69.58413440457828]
Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead.<n>We propose Latent Reasoning VLA (textbfLaRA-VLA), a unified VLA framework that internalizes multi-modal CoT reasoning into continuous latent representations for embodied action.
arXiv Detail & Related papers (2026-02-01T11:34:37Z) - CompliantVLA-adaptor: VLM-Guided Variable Impedance Action for Safe Contact-Rich Manipulation [35.15898666328117]
We propose a CompliantVLA-adaptor that augments the state-of-the-art Vision-Language-Action (VLA) models with vision-language model (VLM)-informed context-aware variable impedance control (VIC)<n>Existing VLA systems (e.g., RDT, Pi0.5, OpenVLA-oft) typically output position, but lack force-aware adaptation, leading to unsafe or failed interactions in physical tasks involving contact, compliance, or uncertainty.<n>We demonstrate that our method outperforms the VLA baselines on a suite of complex contact-rich tasks, both in
arXiv Detail & Related papers (2026-01-21T23:52:40Z) - IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction [51.130510883952546]
Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control.<n>We propose textbfIntentionVLA, a VLA framework with a curriculum training paradigm and an efficient inference mechanism.<n>Our proposed method first leverages carefully designed reasoning data that combine intention inference, spatial grounding, and compact embodied reasoning.
arXiv Detail & Related papers (2025-10-09T04:49:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.