ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics
- URL: http://arxiv.org/abs/2609.07838v1
- Date: Mon, 07 Sep 2026 18:00:14 GMT
- Title: ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics
- Abstract summary: We propose a framework that adapts the Vision-Language-Action token budget to the channel capacity.<n>ComVLA cuts inference compute by 74% and inference latency by 22% versus the original OpenVLA-OFT baseline.<n>Results demonstrate that co-language VLA inference and wireless communication is a practical direction for 6G-connected robotics.
- Score: 39.8807633060402
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Connected robotics is an emerging 6G application where mobile robots follow natural-language instructions to manipulate physical objects. The Vision-Language-Action (VLA) models that enable this are too large to run on the robot; a common trend is to offload inference to the cloud. The wireless link, however, limits how much sensing data the edge can transmit per control step. Two recent lines address this constraint: semantic communication codecs compress sensor data but require channel-specific retraining, and VLA token pruners select tokens from image but ignore the channel. Our insight is that the dense semantic information contained in the language already indicates which visual tokens matter. We propose ComVLA, a framework that uses this language guidance to adapt the VLA token budget to the channel capacity. Transmitting 32 tokens instead of 512 on the LIBERO benchmark, ComVLA cuts inference compute by 74% and inference latency by 22% versus the original OpenVLA-OFT baseline, at a cost of 1.5 pp in average task success (95.4% vs. 96.9%), and it stays within the capacity budget under Rayleigh and Rician fading. These results demonstrate that co-designing VLA inference and wireless communication is a practical direction for 6G-connected robotics.
Related papers
- V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models [19.466602886959866]
We propose V-Link, which explicitly recovers visual representations during the vision-language (VL) to action (A) feature transfer.<n>We show that V-Link improves the average success rate over base model GR00T N1.6 by +1.9%, +31.2%, and +18.8%, respectively.<n>On the AGIBOT A3 Ultra, V-Link further achieves gains of +20% and +24% on two real-world humanoid tasks.
arXiv Detail & Related papers (2026-08-26T02:32:18Z) - TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM [48.08028534478592]
Vision-language-action (VLA) models commonly adopt an LLM-centric $V to L to A$ pathway.<n>We introduce TurboVLA, a new VLA paradigm that reformulates the conventional $V to L to A$ pathway as a direct $V + L to A$ mapping.<n>On LIBERO, TurboVLA achieves 97.7% average success with only 0.2B parameters, 31.2 ms inference latency, and 0.9 GB inference VRAM.
arXiv Detail & Related papers (2026-07-29T17:59:58Z) - Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models? [33.83065196198769]
Vision-Language-Action (VLA) models enable instruction-driven robotic manipulation, but they inherit oversized language backbones from pretrained VLMs.<n>This raises a basic question: how much of a VLA model is actually necessary for closed-loop control?<n>We study architectural redundancy in VLA models by using transformer block removal as a controlled intervention.
arXiv Detail & Related papers (2026-06-26T06:22:17Z) - Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data [93.7685703383343]
Vision-language models (VLMs) are powerful general-purpose reasoners, yet converting them into robot control policies is surprisingly difficult.<n>We argue that this gap can be bridged gradually with the right intermediate data.<n>We show that mixing task-relevant out-of-distribution ETC data with a small amount of action data enables the model to generalize to novel visual-language conditions.
arXiv Detail & Related papers (2026-06-07T08:57:51Z) - Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation [60.07205156194741]
Embodied navigation requires an agent to map language and visual observations to a stream of spatial actions that drive a real robot through environments it has never seen.<n>We present Uni-LaViRA, a unified agentic architecture that extends the same insight to four task families and to four heterogeneous real robots.
arXiv Detail & Related papers (2026-05-26T18:52:04Z) - Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models [2.5338045371474816]
Vision-Language-Action (VLA) models combine perception, language, and motor control in a single architecture.<n>We apply activation injection, sparse autoencoders, and linear probes to six models spanning 80M--7B parameters across 394,000+ rollout episodes on four benchmarks.
arXiv Detail & Related papers (2026-03-19T17:59:55Z) - LLaRA: Supercharging Robot Learning Data for Vision-Language Policy [56.505551117094534]
We introduce LLaRA: Large Language and Robotics Assistant, a framework that formulates robot action policy as visuo-textual conversations.<n>First, we present an automated pipeline to generate conversation-style instruction tuning data for robots from existing behavior cloning datasets.<n>We show that a VLM finetuned with a limited amount of such datasets can produce meaningful action decisions for robotic control.
arXiv Detail & Related papers (2024-06-28T17:59:12Z) - OpenVLA: An Open-Source Vision-Language-Action Model [131.74098076670103]
We introduce OpenVLA, an open-source VLA trained on a diverse collection of 970k real-world robot demonstrations.
OpenVLA shows strong results for generalist manipulation, outperforming closed models such as RT-2-X (55B) by 16.5% in absolute task success rate.
We release model checkpoints, fine-tuning notebooks, and our PyTorch with built-in support for training VLAs at scale on Open X-Embodiment datasets.
arXiv Detail & Related papers (2024-06-13T15:46:55Z) - Implicit Channel Learning for Machine Learning Applications in 6G
Wireless Networks [43.323384292764324]
Machine learning (ML) in 6G is expected to enhance and aid emerging applications such as virtual and augmented reality, vehicular autonomy, and computer vision.
Here, we introduce implicit channel learning to perform the ML tasks without estimating the wireless channel.
Without channel estimation, the proposed approach exhibits approximately 60% improvement in image and speech classification tasks for diverse scenarios.
arXiv Detail & Related papers (2022-06-24T07:45:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.