RAMS: Resource-Adaptive and Detection-Conditioned Model Switching for Embedded Edge Perception
- URL: http://arxiv.org/abs/2606.14716v1
- Date: Thu, 14 May 2026 13:06:42 GMT
- Title: RAMS: Resource-Adaptive and Detection-Conditioned Model Switching for Embedded Edge Perception
- Abstract summary: Edge object detection on embedded hardware requires balancing inference latency and detection quality under changing resource pressure.<n>We present RAMS, a runtime controller that monitors device pressure, calibrates switching thresholds from idle behavior, and dynamically selects among three resident YOLOv8 tiers.<n>Across Raspberry Pi 5, x86 laptops, and Jetson Orin ONNX/TensorRT deployments, the same controller equations operate over a 37x latency range.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Edge object detection on embedded hardware requires balancing inference latency and detection quality under changing resource pressure. We present RAMS, a lightweight runtime controller that monitors device pressure, calibrates switching thresholds from idle behavior, and dynamically selects among three resident YOLOv8 tiers (NANO/SMALL/MEDIUM at 320/416/640 px) without model-reload latency. RAMS defines five switching policies, including two detection-conditioned variants that prevent aggressive downgrades after recent vulnerable-road-user (VRU) detections. We further introduce the VRU-Weighted Accuracy Score (SWAS), a scalar metric for offline policy comparison without ground-truth annotations, together with an oracle-bounded variant that separates detector circularity from genuine tier-retention benefit. Across Raspberry Pi 5, x86 laptops, and Jetson Orin ONNX/TensorRT deployments, the same controller equations operate over a 37x latency range. On Jetson Orin TensorRT under heavy load, the safety2 policy achieves 3.41 ms mean latency, 5.6x faster than fixed-MEDIUM inference, while retaining 74% of its proxy accuracy through near-NANO operation with selective SMALL and MEDIUM locks during VRU-positive windows. Detection-conditioned switching improves SWAS by 25.4% under oracle scoring and 47.3% under detector-derived scoring relative to threshold-only policies under heavy load. Live KITTI evaluation reports per-tier VRU recall of 24.2%, 41.2%, and 59.0%, showing that reactive overrides are fundamentally limited by baseline detector recall.
Related papers
- SIDE: Sensor Impersonation Detection at the Edge via Sequence Prediction [0.0]
Some low-cost Internet of Things (IoT) sensor deployments lack device-level source authentication.<n>We present a lightweight approach to sensor impersonation detection in a small proof-of-concept study.
arXiv Detail & Related papers (2026-09-05T21:46:07Z) - LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation [53.88286427894783]
Vision Language Models (VLMs) have emerged in the robotic domain as a powerful tool that enables environmental perception with language context.<n>Yet, their computational footprint typically confines them to cloud execution, hindering low-latency inference with local deployment on resource-constrained robots.<n>We present a distillation strategy that transfers complex spatial-semantic reasoning from large frontier models into a lightweight, 4B- parameter local VLM for edge execution on embedded GPU devices.
arXiv Detail & Related papers (2026-06-26T09:11:59Z) - CALIBURN: A Regime-Sensitivity Study of Operationally Calibrated Streaming Intrusion Detection [0.0]
Streaming network intrusion detection systems must process flows continuously while keeping memory bounded.<n>Most current methods leave alerting threshold selection as a post-hoc tuning problem poorly suited to production.<n>This paper presents CALIBURN, a five-component streaming alerting pipeline composed of a truncated Bayesian online change-point detector.
arXiv Detail & Related papers (2026-05-23T18:18:38Z) - Brain-inspired spike-timing plasticity for reliable label-efficient event-camera vision [0.3823356975862005]
Local spike-timing-dependent plasticity (STDP) modules operate on a single CPU thread without GPU support.<n>Dense gradient-trained detectors cannot provide this combination of gradient training, dense matrix multiplication, and local plasticity-free operation by construction.
arXiv Detail & Related papers (2026-05-17T22:56:16Z) - WISV: Wireless-Informed Semantic Verification for Distributed Speculative Decoding in Device-Edge LLM Inference [56.297697169678095]
WISV (Wireless-Informed Semantic Verification) is a novel distributed speculative decoding framework.<n>We show that WISV achieves up to a 60.8% increase in accepted length, a 37.3% reduction in interaction rounds, and a 31.4% improvement in end-to-end latency.<n>We validate WISV on a hardware testbed comprising an NVIDIA Jetson AGX Orin and an A40-equipped server.
arXiv Detail & Related papers (2026-04-20T01:29:56Z) - Sharpness-Aware Surrogate Training for On-Sensor Spiking Neural Networks [0.0]
We introduce Sharpness-Aware Sharpness-Awaremization (SAST) to a surrogate-forward SNN so that the training objective is smooth and the gradient is exact.<n>On two event-camera benchmarks, swap-only hard-spike accuracy improves from 65.7% to 94.7% on N-MNIST and from 31.8% to 63.3% on DVS Gesture.<n>These results suggest that SAST is a promising component in a broader toolbox for on-sensor spiking inference under the tested settings.
arXiv Detail & Related papers (2026-04-06T23:32:17Z) - Belief Dynamics for Detecting Behavioral Shifts in Safe Collaborative Manipulation [3.198214897627444]
We study regime-switch detection under controlled non-stationarity in ManiSkill shared-workspace manipulation tasks.<n>Across ten detection methods and five random seeds, enabling detection reduces post-switch collisions by 52%.<n>We introduce UA-TOM, a lightweight belief-tracking module that augments frozen vision-language-action control backbones.
arXiv Detail & Related papers (2026-04-04T02:41:09Z) - Amped: Adaptive Multi-stage Non-edge Pruning for Edge Detection [53.59823657644554]
We propose an Adaptive Multi-stage non-edge Pruning framework for Edge Detection(Amped)<n>Amped identifies high-confidence non-edge tokens and removes them as early as possible to substantially reduce computation.<n>To mitigate the structural complexity of existing edge detection networks, we introduce a simple yet high-performance Transformer-based model, termed Streamline Edge Detector(SED)
arXiv Detail & Related papers (2026-03-29T12:26:35Z) - LiQSS: Post-Transformer Linear Quantum-Inspired State-Space Tensor Networks for Real-Time 6G [85.58816960936069]
Proactive and agentic control in Sixth-Generation (6G) Open Radio Access Networks (O-RAN) requires control-grade prediction under stringent Near-Time (Near-RT) latency and computational constraints.<n>This paper investigates a post-Transformer paradigm for efficient radio telemetry forecasting.<n>We propose a quantum-inspired state-space tensor network that replaces self-attention with stable structured state-space dynamics kernels.
arXiv Detail & Related papers (2026-01-18T12:08:38Z) - RemoteVAR: Autoregressive Visual Modeling for Remote Sensing Change Detection [52.32112533846212]
Remote sensing change detection is central to applications such as environmental monitoring and disaster assessment.<n>Visual autoregressive models have recently shown impressive image generation capability, but their adoption for pixel-level discriminative tasks remains limited due to weak controllability, suboptimal dense prediction performance and exposure bias.<n>We introduce a new VAR-based change detection framework that addresses these limitations by conditioning autoregressive prediction on multi-resolution fused bi-temporal features via cross-attention, and by employing an autoregressive training strategy designed specifically for change map prediction.
arXiv Detail & Related papers (2026-01-17T03:50:00Z) - Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian
Detection [99.94079901071163]
This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs)
We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm.
Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83%.
arXiv Detail & Related papers (2020-04-03T17:36:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.