Uirapuru: Timely Video Analytics for High-Resolution Steerable Cameras on Edge Devices

• URL: http://arxiv.org/abs/2509.01371v1
• Date: Mon, 01 Sep 2025 11:18:30 GMT
• Title: Uirapuru: Timely Video Analytics for High-Resolution Steerable Cameras on Edge Devices
• Abstract summary: We present Uirapuru, a novel framework for real-time, edge-based video analytics on high-resolution steerable cameras.<n>Uirapuru incorporates a comprehensive understanding of camera actuation into the system design paired with fast adaptive tiling at a per-frame level.<n>Our experimental results show that Uirapuru provides up to 1.45x improvement in accuracy while respecting specified latency budgets or reaches up to 4.53x inference speedup with on-par accuracy compared to state-of-the-art static camera approaches.
• Score: 2.924414944837329
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Real-time video analytics on high-resolution cameras has become a popular technology for various intelligent services like traffic control and crowd monitoring. While extensive work has been done on improving analytics accuracy with timing guarantees, virtually all of them target static viewpoint cameras. In this paper, we present Uirapuru, a novel framework for real-time, edge-based video analytics on high-resolution steerable cameras. The actuation performed by those cameras brings significant dynamism to the scene, presenting a critical challenge to existing popular approaches such as frame tiling. To address this problem, Uirapuru incorporates a comprehensive understanding of camera actuation into the system design paired with fast adaptive tiling at a per-frame level. We evaluate Uirapuru on a high-resolution video dataset, augmented by pan-tilt-zoom (PTZ) movements typical for steerable cameras and on real-world videos collected from an actual PTZ camera. Our experimental results show that Uirapuru provides up to 1.45x improvement in accuracy while respecting specified latency budgets or reaches up to 4.53x inference speedup with on-par accuracy compared to state-of-the-art static camera approaches.

Related papers

• CT-1: Vision-Language-Camera Models Transfer Spatial Reasoning Knowledge to Camera-Controllable Video Generation [84.82778089348285]
  Camera Transformer 1 is a specialized model designed to transfer spatial reasoning knowledge to video generation by accurately estimating camera trajectories.<n>Our framework successfully bridges the gap between spatial reasoning and video synthesis, yielding faithful and high-quality camera-controllable videos.
  arXiv  Detail & Related papers  (2026-04-10T10:43:18Z)
• EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidance [69.40274699401473]
  We introduce EPiC, an efficient and precise camera control learning framework.<n>It constructs high-quality anchor videos without expensive camera trajectory annotations.<n>EPiC achieves SOTA performance on RealEstate10K and MiraData for I2V camera control task.
  arXiv  Detail & Related papers  (2025-05-28T01:45:26Z)
• FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video [52.33896173943054]
  Egocentric motion capture with a head-mounted body-facing stereo camera is crucial for VR and AR applications.<n>Existing methods rely on synthetic pretraining and struggle to generate smooth and accurate predictions in real-world settings.<n>We propose FRAME, a simple yet effective architecture that combines device pose and camera feeds for state-of-the-art body pose prediction.
  arXiv  Detail & Related papers  (2025-03-29T14:26:06Z)
• MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videos [104.1338295060383]
  We present a system that allows for accurate, fast, and robust estimation of camera parameters and depth maps from casual monocular videos of dynamic scenes.<n>Our system is significantly more accurate and robust at camera pose and depth estimation when compared with prior and concurrent work.
  arXiv  Detail & Related papers  (2024-12-05T18:59:42Z)
• AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers [66.29824750770389]
  We analyze camera motion from a first principles perspective, uncovering insights that enable precise 3D camera manipulation.<n>We compound these findings to design the Advanced 3D Camera Control (AC3D) architecture.
  arXiv  Detail & Related papers  (2024-11-27T18:49:13Z)
• Enabling Cross-Camera Collaboration for Video Analytics on Distributed Smart Cameras [7.609628915907225]
  We present Argus, a distributed video analytics system with cross-camera collaboration on smart cameras. We identify multi-camera, multi-target tracking as the primary task multi-camera video analytics and develop a novel technique that avoids redundant, processing-heavy tasks. Argus reduces the number of object identifications and end-to-end latency by up to 7.13x and 2.19x compared to the state-of-the-art.
  arXiv  Detail & Related papers  (2024-01-25T12:27:03Z)
• EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset [55.12137324648253]
  Event cameras are emerging imaging technology that offers advantages over conventional frame-based imaging sensors in dynamic range and sensing speed. This paper focuses on five event-aided image and video enhancement tasks.
  arXiv  Detail & Related papers  (2023-12-13T15:42:04Z)
• Robust Frame-to-Frame Camera Rotation Estimation in Crowded Scenes [8.061773364318313]
  We present an approach to estimating camera rotation in crowded, real-world scenes from handheld monocular video. We provide a new dataset and benchmark, with high-accuracy, rigorously verified ground truth, on 17 video sequences. This represents a strong new performance point for crowded scenes, an important setting for computer vision.
  arXiv  Detail & Related papers  (2023-09-15T17:44:07Z)
• APT: Adaptive Perceptual quality based camera Tuning using reinforcement learning [2.0741583844039915]
  Capturing poor-quality video adversely affects the accuracy of analytics. We propose a novel, reinforcement-learning based system that tunes the camera parameters to ensure a high-quality video capture. As a result, such tuning restores the accuracy of insights when environmental conditions or scene content change.
  arXiv  Detail & Related papers  (2022-11-15T21:02:48Z)
• RADNet: A Deep Neural Network Model for Robust Perception in Moving Autonomous Systems [8.706086688708014]
  We develop a novel ranking method to rank videos based on the degree of global camera motion. For the high ranking camera videos we show that the accuracy of action detection is decreased. We propose an action detection pipeline that is robust to the camera motion effect and verify it empirically.
  arXiv  Detail & Related papers  (2022-04-30T23:14:08Z)
• Scalable and Real-time Multi-Camera Vehicle Detection, Re-Identification, and Tracking [58.95210121654722]
  We propose a real-time city-scale multi-camera vehicle tracking system that handles real-world, low-resolution CCTV instead of idealized and curated video streams. Our method is ranked among the top five performers on the public leaderboard.
  arXiv  Detail & Related papers  (2022-04-15T12:47:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.