Internet of Things (IoT) Based Video Analytics: a use case of Smart Doorbell

• URL: http://arxiv.org/abs/2105.06508v1
• Date: Thu, 13 May 2021 18:48:48 GMT
• Title: Internet of Things (IoT) Based Video Analytics: a use case of Smart Doorbell
• Authors: Shailesh Arya
• Abstract summary: Video-based smart doorbell system is one such application domain for video analytics. This paper proposes a distributed framework for video analytics with a use case of a smart doorbell system. The proposed framework uses AWS cloud services as a base platform and to meet the price affordability constraint, the system was implemented on affordable Raspberry Pi.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The vision of the internet of things (IoT) is a reality now. IoT devices are getting cheaper, smaller. They are becoming more and more computationally and energy-efficient. The global market of IoT-based video analytics has seen significant growth in recent years and it is expected to be a growing market segment. For any IoT-based video analytics application, few key points required, such as cost-effectiveness, widespread use, flexible design, accurate scene detection, reusability of the framework. Video-based smart doorbell system is one such application domain for video analytics where many commercial offerings are available in the consumer market. However, such existing offerings are costly, monolithic, and proprietary. Also, there will be a trade-off between accuracy and portability. To address the foreseen problems, I'm proposing a distributed framework for video analytics with a use case of a smart doorbell system. The proposed framework uses AWS cloud services as a base platform and to meet the price affordability constraint, the system was implemented on affordable Raspberry Pi. The smart doorbell will be able to recognize the known/unknown person with at most accuracy. The smart doorbell system is also having additional detection functionalities such as harmful weapon detection, noteworthy vehicle detection, animal/pet detection. An iOS application is specifically developed for this implementation which can receive the notification from the smart doorbell in real-time. Finally, the paper also mentions the classical approaches for video analytics, their feasibility in implementing with this use-case, and comparative analysis in terms of accuracy and time required to detect an object in the frame is carried out. Results conclude that AWS cloud-based approach is worthy for this smart doorbell use case.

Related papers

• What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systems [52.499838151272016]
  This paper addresses the "what-if" problem of estimating the values of key performance indicators (KPIs) that would have been obtained if a different app had been implemented by the radio access network (RAN) We propose a conformal-prediction-based counterfactual analysis method for wireless systems that provides reliable "error bars" for the estimated, containing the true with a user-defined probability.
  arXiv  Detail & Related papers  (2024-09-30T18:47:26Z)
• EventTransAct: A video transformer-based framework for Event-camera based action recognition [52.537021302246664]
  Event cameras offer new opportunities compared to standard action recognition in RGB videos. In this study, we employ a computationally efficient model, namely the video transformer network (VTN), which initially acquires spatial embeddings per event-frame. In order to better adopt the VTN for the sparse and fine-grained nature of event data, we design Event-Contrastive Loss ($mathcalL_EC$) and event-specific augmentations.
  arXiv  Detail & Related papers  (2023-08-25T23:51:07Z)
• Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks [4.987581730476023]
  Large-scale Deep Neural Networks (DNNs) are too large to be efficiently run on resource-constrained devices. We propose BiSupervised, where a system attempts to make a prediction on a small-scale local model. We evaluate the cost savings, and the ability to detect incorrectly predicted inputs on four diverse case studies.
  arXiv  Detail & Related papers  (2023-04-05T04:35:23Z)
• MAPLE-X: Latency Prediction with Explicit Microprocessor Prior Knowledge [87.41163540910854]
  Deep neural network (DNN) latency characterization is a time-consuming process. We propose MAPLE-X which extends MAPLE by incorporating explicit prior knowledge of hardware devices and DNN architecture latency.
  arXiv  Detail & Related papers  (2022-05-25T11:08:20Z)
• E^2TAD: An Energy-Efficient Tracking-based Action Detector [78.90585878925545]
  This paper presents a tracking-based solution to accurately and efficiently localize predefined key actions. It won first place in the UAV-Video Track of 2021 Low-Power Computer Vision Challenge (LPCVC)
  arXiv  Detail & Related papers  (2022-04-09T07:52:11Z)
• A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning [57.28467469709369]
  We investigate on designing a compact audio-visual wake word spotting (WWS) system by utilizing visual information. We introduce a neural network pruning strategy via the lottery ticket hypothesis in an iterative fine-tuning manner (LTH-IF) The proposed audio-visual system achieves significant performance improvements over the single-modality (audio-only or video-only) system under different noisy conditions.
  arXiv  Detail & Related papers  (2022-02-17T08:26:25Z)
• JANUS: Benchmarking Commercial and Open-Source Cloud and Edge Platforms for Object and Anomaly Detection Workloads [5.288304164492778]
  Amazon Web Services (AWS) IoT Greengrass delivers at least 2X lower latency and 1.25X lower cost compared to all other cloud platforms for the compute-light outlier detection workload. An opensource solution to object detection running on cloud saves on dollar costs compared to proprietary solutions provided by Amazon, Microsoft, and Google, but loses out on latency (up to 6X) If it runs on a low-powered edge device, the latency is up to 49X lower.
  arXiv  Detail & Related papers  (2020-12-09T06:07:26Z)
• A Demonstration of Smart Doorbell Design Using Federated Deep Learning [0.09786690381850353]
  This paper showcases the ability of an intelligent smart doorbell based on Federated Deep Learning. It can deploy and manage video analytics applications such as a smart doorbell across Edge and Cloud resources.
  arXiv  Detail & Related papers  (2020-10-19T17:22:34Z)
• Demonstration of a Cloud-based Software Framework for Video Analytics Application using Low-Cost IoT Devices [0.09236074230806578]
  We propose a smart doorbell that orchestrates video analytics across Edge and Cloud resources. The proposal uses AWS as a base platform for implementation and leverages COTS affordable devices such as Raspberry Pi in the form of an Edge device.
  arXiv  Detail & Related papers  (2020-09-29T06:05:32Z)
• A Distributed Framework to Orchestrate Video Analytics Applications [0.09236074230806578]
  We propose a distributed framework to orchestrate video analytics across Edge and Cloud resources. This paper evaluates the proposed framework as well as the state-of-the-art models and presents comparative analysis of them on various metrics.
  arXiv  Detail & Related papers  (2020-09-17T07:10:05Z)
• Superiority of Simplicity: A Lightweight Model for Network Device Workload Prediction [58.98112070128482]
  We propose a lightweight solution for series prediction based on historic observations. It consists of a heterogeneous ensemble method composed of two models - a neural network and a mean predictor. It achieves an overall $R2$ score of 0.10 on the available FedCSIS 2020 challenge dataset.
  arXiv  Detail & Related papers  (2020-07-07T15:44:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.