Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations

• URL: http://arxiv.org/abs/2308.03276v5
• Date: Mon, 15 Jul 2024 00:05:58 GMT
• Title: Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations
• Authors: Chanwut Kittivorawong, Yongming Ge, Yousef Helal, Alvin Cheung,
• Abstract summary: Spatialyze is a new framework for end-to-end querying of geospatial videos. Our results show that Spatialyze can reduce execution time by up to 5.3x, while maintaining up to 97.1% accuracy compared to unoptimized execution.
• Score: 6.169771522155704
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Videos that are shot using commodity hardware such as phones and surveillance cameras record various metadata such as time and location. We encounter such geospatial videos on a daily basis and such videos have been growing in volume significantly. Yet, we do not have data management systems that allow users to interact with such data effectively. In this paper, we describe Spatialyze, a new framework for end-to-end querying of geospatial videos. Spatialyze comes with a domain-specific language where users can construct geospatial video analytic workflows using a 3-step, declarative, build-filter-observe paradigm. Internally, Spatialyze leverages the declarative nature of such workflows, the temporal-spatial metadata stored with videos, and physical behavior of real-world objects to optimize the execution of workflows. Our results using real-world videos and workflows show that Spatialyze can reduce execution time by up to 5.3x, while maintaining up to 97.1% accuracy compared to unoptimized execution.

Related papers

• HAVANA: Hierarchical stochastic neighbor embedding for Accelerated Video ANnotAtions [59.71751978599567]
  This paper presents a novel annotation pipeline that uses pre-extracted features and dimensionality reduction to accelerate the temporal video annotation process. We demonstrate significant improvements in annotation effort compared to traditional linear methods, achieving more than a 10x reduction in clicks required for annotating over 12 hours of video.
  arXiv  Detail & Related papers  (2024-09-16T18:15:38Z)
• PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking [90.29143475328506]
  We introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. We animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos.
  arXiv  Detail & Related papers  (2023-07-27T17:58:11Z)
• AutoDecoding Latent 3D Diffusion Models [95.7279510847827]
  We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space. We then identify the appropriate intermediate volumetric latent space, and introduce robust normalization and de-normalization operations.
  arXiv  Detail & Related papers  (2023-07-07T17:59:14Z)
• A Survey on Video Moment Localization [61.5323647499912]
  Video moment localization aims to search a target segment within a video described by a given natural language query. We present a review of existing video moment localization techniques, including supervised, weakly supervised, and unsupervised ones. We discuss promising future directions for this field, in particular large-scale datasets and interpretable video moment localization models.
  arXiv  Detail & Related papers  (2023-06-13T02:57:32Z)
• Video 3D Sampling for Self-supervised Representation Learning [13.135859819622855]
  We propose a novel self-supervised method for video representation learning, referred to as Video 3D Sampling (V3S) In our implementation, we combine the sampling of the three dimensions and propose the scale and projection transformations in space and time respectively. The experimental results show that, when applied to action recognition, video retrieval and action similarity labeling, our approach improves the state-of-the-arts with significant margins.
  arXiv  Detail & Related papers  (2021-07-08T03:22:06Z)
• A Survey of Performance Optimization in Neural Network-Based Video Analytics Systems [0.9558392439655014]
  Video analytics systems perform automatic events, movements, and actions recognition in a video. We provide a review of the techniques that focus on optimizing the performance of Neural Network-Based Video Analytics Systems.
  arXiv  Detail & Related papers  (2021-05-10T17:06:44Z)
• Video Exploration via Video-Specific Autoencoders [60.256055890647595]
  We present video-specific autoencoders that enables human-controllable video exploration. We observe that a simple autoencoder trained on multiple frames of a specific video enables one to perform a large variety of video processing and editing tasks.
  arXiv  Detail & Related papers  (2021-03-31T17:56:13Z)
• TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks [79.01176229586855]
  We propose a novel supervised pretraining paradigm for clip features that considers background clips and global video information to improve temporal sensitivity. Extensive experiments show that using features trained with our novel pretraining strategy significantly improves the performance of recent state-of-the-art methods on three tasks.
  arXiv  Detail & Related papers  (2020-11-23T15:40:15Z)
• ApproxDet: Content and Contention-Aware Approximate Object Detection for Mobiles [19.41234144545467]
  We introduce ApproxDet, an adaptive video object detection framework for mobile devices to meet accuracy-latency requirements. We evaluate ApproxDet on a large benchmark video dataset and compare quantitatively to AdaScale and YOLOv3. We find that ApproxDet is able to adapt to a wide variety of contention and content characteristics and outshines all baselines.
  arXiv  Detail & Related papers  (2020-10-21T04:11:05Z)
• Video Monitoring Queries [16.7214343633499]
  We study the problem of interactive declarative query processing on video streams. We introduce a set of approximate filters to speed up queries that involve objects of specific type. The filters are able to assess quickly if the query predicates are true to proceed with further analysis of the frame.
  arXiv  Detail & Related papers  (2020-02-24T20:53:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.