FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation
- URL: http://arxiv.org/abs/2602.23648v1
- Date: Fri, 27 Feb 2026 03:33:10 GMT
- Title: FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation
- Abstract summary: Force/torque feedback can substantially improve Vision-Language-Action (VLA) models on contact-rich manipulation.<n>Most existing approaches fuse all modalities at a single operating frequency.<n>We propose FAVLA, a force-adaptive fast-slow VLA that decouples slow perception planning from fast contact-aware control.
- Score: 20.067295745725257
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Force/torque feedback can substantially improve Vision-Language-Action (VLA) models on contact-rich manipulation, but most existing approaches fuse all modalities at a single operating frequency. This design ignores the mismatched sampling rates of real robot sensors, forcing downsampling of the high-frequency contact cues needed for reactive correction. Combined with common VLM-action-expert (AE) pipelines that execute action chunks largely open loop between expensive VLM updates, unified-frequency fusion often yields delayed responses to impacts, stick-slip, and force spikes. We propose FAVLA, a force-adaptive fast-slow VLA that decouples slow perception planning from fast contact-aware control. FAVLA runs a slow VLM at a fixed low frequency to encode modalities to produce latent representations and to predict near-future force variation. A fast AE then executes at a variable high frequency, conditioning on the latest force sequence data to generate reactive actions. We further introduce a force adapter that injects high-frequency force features into multiple AE layers, and adaptively schedules the AE's execution frequency based on the VLM's predicted force variation. Extensive experiments on contact-rich tasks demonstrate that FAVLA significantly outperforms baselines, achieving superior reactivity and success rates, especially with a smaller contact force during manipulation.
Related papers
- CR-VLA-Force: Learning Control-aware Compliance VLA Model for Robust Contact-rich Robotic Manipulation [22.8919569384701]
We propose a Control-aware Compliance VLA framework for reactive control.<n>The CC-VLA model employs a multimodal mixture-of-experts (MoE) to encode force signal sequences and vision-language fused feature.<n>We show that CC-VLA significantly improves success rates in challenging force-perception tasks and enhances force-control precision.
arXiv Detail & Related papers (2026-09-05T02:54:51Z) - A Hierarchical Approach to Imitation Learning for Manipulation Tasks Requiring Time Varying Forces [14.372073538832803]
We introduce the Diffusion Policy Augmented by Fast Trajectory Generation (DPA-FTG)<n>Compared to recent visual-tactile approaches that focus on positional correction, DPA-FTG decouples low-frequency planning from high-frequency force regulation.<n>We validate our approach on a bimanual battery disassembly task involving the separation of a compliant sheet.
arXiv Detail & Related papers (2026-08-04T04:21:00Z) - FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation [46.70731586911338]
Action multimodality and reactivity dominate different stages of a single episode.<n>Standard diffusion policies use a fixed inference frequency and sampling steps throughout the episode.<n>We present FA-RDP, a frequency-adaptive reactive diffusion policy.
arXiv Detail & Related papers (2026-07-30T17:47:49Z) - TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies [58.40033352838586]
Existing Vision-Language-Action models (VLAs) only inherit a single fixed speed from training demonstrations.<n>We observe that the magnitude of each predicted action already governs how fast the robot moves.<n>We turn this observation into TempoVLA, a single VLA whose execution speed is controlled by an explicit condition.
arXiv Detail & Related papers (2026-06-04T17:59:40Z) - AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Models [11.558382158969822]
Vision-Language-Action (VLA) models have significantly advanced the capabilities of robotic agents in executing diverse tasks.<n>Recent studies have attempted to incorporate tactile signals during downstream tasks, enabling pretrained VLAs to interpret tactile feedback.<n>We propose Adaptive Tactile Vision-Language-Action (AT-VLA), which introduces a novel Adaptive Tactile Injection mechanism.
arXiv Detail & Related papers (2026-05-08T06:17:08Z) - FASTER: Rethinking Real-Time Flow VLAs [82.58822112377923]
Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world.<n>We show that reaction time follows a uniform distribution determined jointly by the Time to First Action (TTFA) and the execution horizon.<n>We propose Fast Action Sampling for ImmediaTE Reaction (FASTER) to overcome this issue.
arXiv Detail & Related papers (2026-03-19T17:51:37Z) - Enabling Dynamic Tracking in Vision-Language-Action Models via Time-Discrete and Time-Continuous Velocity Feedforward [11.066720921275648]
Vision-language-action (VLA) models have shown great promise for robot manipulation.<n>Their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness.<n>This paper shows the importance of integrating velocity feedforward terms into VLA policies to resolve this trade-off.
arXiv Detail & Related papers (2026-03-17T07:50:00Z) - ImplicitRDP: An End-to-End Visual-Force Diffusion Policy with Structural Slow-Fast Learning [52.86018040861575]
We propose a unified end-to-end visual-force diffusion policy that integrates visual planning and reactive force control within a single network.<n>We introduce Structural Slow-Fast Learning, a mechanism utilizing causal attention to simultaneously process asynchronous visual and force tokens.<n>Experiments on contact-rich tasks demonstrate that ImplicitRDP significantly outperforms both vision-only and hierarchical baselines.
arXiv Detail & Related papers (2025-12-11T18:59:46Z) - SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration [70.72227437717467]
Vision-Language-Action (VLA) models have attracted increasing attention for their strong control capabilities.<n>Their high computational cost and low execution frequency hinder their suitability for real-time tasks such as robotic manipulation and autonomous navigation.<n>We propose SP-VLA, a unified framework that accelerates VLA models by jointly scheduling models and pruning tokens.
arXiv Detail & Related papers (2025-06-15T05:04:17Z) - ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation [62.58034332427291]
ForceVLA is a novel end-to-end manipulation framework.<n>It treats external force sensing as a first-class modality within VLA systems.
arXiv Detail & Related papers (2025-05-28T09:24:25Z) - SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model [52.47816604709358]
Video anomaly detection (VAD) aims to identify unexpected events in videos and has wide applications in safety-critical domains.<n> vision-language models (VLMs) have demonstrated strong multimodal reasoning capabilities, offering new opportunities for anomaly detection.<n>We propose SlowFastVAD, a hybrid framework that integrates a fast anomaly detector with a slow anomaly detector.
arXiv Detail & Related papers (2025-04-14T15:30:03Z) - Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation [58.95799126311524]
Humans can accomplish contact-rich tasks using vision and touch, with highly reactive capabilities such as fast response to external changes and adaptive control of contact forces.<n>Existing visual imitation learning approaches rely on action chunking to model complex behaviors.<n>We introduce TactAR, a low-cost teleoperation system that provides real-time tactile feedback through Augmented Reality.
arXiv Detail & Related papers (2025-03-04T18:58:21Z) - HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers [12.373320641721344]
Large Vision-Language-Action (VLA) models have shown promise in robotic control due to their impressive generalization ability.<n>Their reliance on VLM backends with billions of parameters leads to high computational costs and latency inference.<n>This paper proposes HiRT, a Hierarchical Robot Transformer framework that enables flexible frequency and performance trade-off.
arXiv Detail & Related papers (2024-09-12T09:18:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.