Robust Privacy-Preserving Motion Detection and Object Tracking in Encrypted Streaming Video

• URL: http://arxiv.org/abs/2108.13141v1
• Date: Mon, 30 Aug 2021 11:58:19 GMT
• Title: Robust Privacy-Preserving Motion Detection and Object Tracking in Encrypted Streaming Video
• Authors: Xianhao Tian, Peijia Zheng, Jiwu Huang
• Abstract summary: We propose an efficient and robust privacy-preserving motion detection and multiple object tracking scheme for encrypted surveillance video bitstreams. Our scheme achieves the best detection and tracking performance compared with existing works in the encrypted and compressed domain. Our scheme can be effectively used in complex surveillance scenarios with different challenges, such as camera movement/jitter, dynamic background, and shadows.
• Score: 39.453548972987015
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video privacy leakage is becoming an increasingly severe public problem, especially in cloud-based video surveillance systems. It leads to the new need for secure cloud-based video applications, where the video is encrypted for privacy protection. Despite some methods that have been proposed for encrypted video moving object detection and tracking, none has robust performance against complex and dynamic scenes. In this paper, we propose an efficient and robust privacy-preserving motion detection and multiple object tracking scheme for encrypted surveillance video bitstreams. By analyzing the properties of the video codec and format-compliant encryption schemes, we propose a new compressed-domain feature to capture motion information in complex surveillance scenarios. Based on this feature, we design an adaptive clustering algorithm for moving object segmentation with an accuracy of 4x4 pixels. We then propose a multiple object tracking scheme that uses Kalman filter estimation and adaptive measurement refinement. The proposed scheme does not require video decryption or full decompression and has a very low computation load. The experimental results demonstrate that our scheme achieves the best detection and tracking performance compared with existing works in the encrypted and compressed domain. Our scheme can be effectively used in complex surveillance scenarios with different challenges, such as camera movement/jitter, dynamic background, and shadows.

Related papers

• PV-VTT: A Privacy-Centric Dataset for Mission-Specific Anomaly Detection and Natural Language Interpretation [5.0923114224599555]
  We present PV-VTT (Privacy Violation Video To Text), a unique multimodal dataset aimed at identifying privacy violations. PV-VTT provides detailed annotations for both video and text in scenarios. This privacy-focused approach allows researchers to use the dataset while protecting participant confidentiality.
  arXiv  Detail & Related papers  (2024-10-30T01:02:20Z)
• A motion-based compression algorithm for resource-constrained video camera traps [4.349838917565205]
  We introduce a new motion analysis-based video compression algorithm specifically designed for camera traps. The algorithm identifies and stores only image regions depicting motion relevant to motion pollination monitoring. Our experiments demonstrate the algorithm's capability to preserve critical information for insect behaviour analysis.
  arXiv  Detail & Related papers  (2024-05-23T10:39:33Z)
• Privacy Protectability: An Information-theoretical Approach [4.14084373472438]
  We propose a new metric, textitprivacy protectability, to characterize to what degree a video stream can be protected. Our definition of privacy protectability is rooted in information theory and we develop efficient algorithms to estimate the metric.
  arXiv  Detail & Related papers  (2023-05-25T04:06:55Z)
• Recovering Surveillance Video Using RF Cues [5.818870353966268]
  We propose CSI2Video, a novel cross-modal method to recover fine-grained surveillance video in real-time. Our solution generates realistic surveillance videos without any expensive wireless equipment and has ubiquitous, cheap, and real-time characteristics.
  arXiv  Detail & Related papers  (2022-12-27T01:57:03Z)
• Implicit Motion Handling for Video Camouflaged Object Detection [60.98467179649398]
  We propose a new video camouflaged object detection (VCOD) framework. It can exploit both short-term and long-term temporal consistency to detect camouflaged objects from video frames.
  arXiv  Detail & Related papers  (2022-03-14T17:55:41Z)
• Forgery Attack Detection in Surveillance Video Streams Using Wi-Fi Channel State Information [20.815889839515087]
  cybersecurity breaches expose surveillance video streams to forgery attacks. Traditional video forensics approaches can localize traces using spatial-temporal analysis on relatively long video clips. We propose Secure-Pose, which exploits the pervasive coexistence of surveillance and Wi-Fi infrastructures. Secure-Pose achieves a high detection accuracy of 98.7% and localizes abnormal objects under playback and tampering attacks.
  arXiv  Detail & Related papers  (2022-01-24T06:51:03Z)
• Argus++: Robust Real-time Activity Detection for Unconstrained Video Streams with Overlapping Cube Proposals [85.76513755331318]
  Argus++ is a robust real-time activity detection system for analyzing unconstrained video streams. The overall system is optimized for real-time processing on standalone consumer-level hardware.
  arXiv  Detail & Related papers  (2022-01-14T03:35:22Z)
• Video Salient Object Detection via Contrastive Features and Attention Modules [106.33219760012048]
  We propose a network with attention modules to learn contrastive features for video salient object detection. A co-attention formulation is utilized to combine the low-level and high-level features. We show that the proposed method requires less computation, and performs favorably against the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-11-03T17:40:32Z)
• Privacy-sensitive Objects Pixelation for Live Video Streaming [52.83247667841588]
  We propose a novel Privacy-sensitive Objects Pixelation (PsOP) framework for automatic personal privacy filtering during live video streaming. Our PsOP is extendable to any potential privacy-sensitive objects pixelation. In addition to the pixelation accuracy boosting, experiments on the streaming video data we built show that the proposed PsOP can significantly reduce the over-pixelation ratio in privacy-sensitive object pixelation.
  arXiv  Detail & Related papers  (2021-01-03T11:07:23Z)
• Gabriella: An Online System for Real-Time Activity Detection in Untrimmed Security Videos [72.50607929306058]
  We propose a real-time online system to perform activity detection on untrimmed security videos. The proposed method consists of three stages: tubelet extraction, activity classification and online tubelet merging. We demonstrate the effectiveness of the proposed approach in terms of speed (100 fps) and performance with state-of-the-art results.
  arXiv  Detail & Related papers  (2020-04-23T22:20:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.