Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving
- URL: http://arxiv.org/abs/2608.14991v1
- Date: Sat, 15 Aug 2026 02:36:01 GMT
- Title: Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving
- Abstract summary: Cloud-hosted vision-language models (VLMs) offer greater contextual reasoning capabilities than smaller onboard models.<n>We present a risk-adaptive edge-cloud architecture in which onboard traffic assessment determines when cloud reasoning is requested.
- Score: 6.115137181728187
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cloud-hosted vision-language models (VLMs) offer greater contextual reasoning capabilities than smaller onboard models, but frequent visual uploads increase communication overhead and add network and inference latency to tactical decisions. We present a risk-adaptive edge-cloud architecture in which onboard traffic assessment determines when cloud reasoning is requested. An onboard VLM and a lightweight detector capture temporal traffic conditions and path-relative hazards for conservative local response and selective cloud access. The cloud model provides tactical advice, while validation, vehicle control, and automatic emergency braking remain local. In CARLA experiments, our method matched the task success rate of periodic cloud access while reducing cloud requests by 54.1% and recording fewer automatic emergency braking (AEB) activations. In a delayed-roadwork ablation, semantic events triggered requests before the next scheduled audit. Across three emulated network profiles, the method continued to reduce cloud traffic, although lane changes took longer than with periodic access. Onboard traffic assessment therefore served as a practical trigger for selective VLM inference in these experiments.
Related papers
- MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networks [71.01350912967922]
In post-disaster scenarios, unmanned aerial vehicles (UAVs) are critical for establishing emergency communication networks.<n>This paper investigates age of information (AoI) minimization for UAV-assisted emergency communications with heterogeneous emergency services.<n>We develop MA-HEAD-Net, an adaptive rule-guided multi-agent deep reinforcement learning framework.
arXiv Detail & Related papers (2026-08-02T10:05:50Z) - Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization [6.831202558046453]
We introduce CloudEdgeVLA, a cloud-edge policy that treats temporal misalignment as a representation-learning problem.<n>A lightweight edge head combines the latest available cloud feature with current local vision.<n>CloudEdgeVLA retains 63.8--78.0% success with a 40-step uniform-delay window.
arXiv Detail & Related papers (2026-08-01T10:11:59Z) - ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation [48.30643653308979]
Controllable traffic simulation is critical for testing autonomous driving systems.<n>Existing approaches often require retraining large generative models with extensive annotated data.<n>We introduce a lightweight control adaptation framework that enables multi-modal controllability.
arXiv Detail & Related papers (2026-07-01T07:35:29Z) - OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agents [74.20327254615854]
Large language model agents interleave reasoning, action selection, and observation to solve sequential decision-making tasks.<n>Existing inference-time adaptation methods for LLM agents mainly rely on prompting or retrieval.<n>We propose OLIVIA, an inference-time action adaptation framework for ReAct-style agents.
arXiv Detail & Related papers (2026-05-11T19:28:20Z) - Adversarial Robustness Analysis of Cloud-Assisted Autonomous Driving Systems [0.0]
This paper presents a hardware-in-the-loop IoV testbed that integrates real-time perception, control, and communication to evaluate such vulnerabilities in cloud-assisted autonomous driving.<n>A YOLOv8-based object detector deployed on the cloud is subjected to whitebox adversarial attacks using the Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD)<n>Results show that adversarial perturbations significantly degrade perception performance, with PGD reducing detection precision and recall from 0.73 and 0.68 in the clean baseline to 0.22 and 0.15 at epsilon= 0.04.
arXiv Detail & Related papers (2026-04-06T01:54:41Z) - Bridging Large-Model Reasoning and Real-Time Control via Agentic Fast-Slow Planning [42.15812524999639]
Agentic Fast-Slow Planning is a hierarchical framework that decouples perception, reasoning, planning, and control across natural timescales.<n>We show that Agentic Fast-Slow Planning improves robustness under perturbations, reducing lateral deviation by up to 45% and completion time by over 12% compared to pure MPC and an A*-guided MPC baseline.
arXiv Detail & Related papers (2026-04-02T06:34:29Z) - Robust Single-Agent Reinforcement Learning for Regional Traffic Signal Control Under Demand Fluctuations [5.784337914162491]
Traffic congestion, primarily driven by intersection queuing, significantly impacts urban living standards, safety, environmental quality, and economic efficiency.<n>This study introduces a novel single-agent reinforcement learning framework for regional adaptive TSC.<n>The framework exhibits robust anti-fluctuation capability and significantly reduces queue lengths.
arXiv Detail & Related papers (2025-11-01T13:18:50Z) - Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Driving [55.96227460521096]
Vision-Language Models (VLMs) have been integrated into autonomous driving systems to enhance reasoning capabilities.<n>We propose a natural reflection-based backdoor attack targeting VLM systems in autonomous driving scenarios.<n>Our findings uncover a new class of attacks that exploit the stringent real-time requirements of autonomous driving.
arXiv Detail & Related papers (2025-05-09T20:28:17Z) - Edge AI-Powered Real-Time Decision-Making for Autonomous Vehicles in Adverse Weather Conditions [0.0]
Conventional cloud-based AI systems introduce communication delays, making them unsuitable for real-time autonomous navigation.<n>This paper presents a novel Edge AI-driven real-time decision-making framework designed to enhance AV responsiveness under adverse weather conditions.<n>By processing data at the network edge, this system significantly reduces decision latency while improving AV adaptability.
arXiv Detail & Related papers (2025-03-12T02:02:05Z) - Managing Bandwidth: The Key to Cloud-Assisted Autonomous Driving [73.55745551827229]
We argue that we can, and must, rely on the cloud for real-time control systems like self-driving cars.
We identify an opportunity to offload parts of time-sensitive and latency-critical compute to the cloud.
arXiv Detail & Related papers (2024-10-21T17:32:36Z) - Self-Supervised Multi-Frame Neural Scene Flow [46.89574953830576]
We propose a simple and effective method for multi-frame point cloud scene flow estimation, along with a theoretical evaluation of its generalization abilities.
Our analysis confirms that the proposed method maintains a limited generalization error, suggesting that adding multiple frames to the scene flow optimization process does not detract from its generalizability.
arXiv Detail & Related papers (2024-03-24T12:15:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.