Recovering Surveillance Video Using RF Cues

• URL: http://arxiv.org/abs/2212.13340v1
• Date: Tue, 27 Dec 2022 01:57:03 GMT
• Title: Recovering Surveillance Video Using RF Cues
• Authors: Xiang Li, Rabih Younes
• Abstract summary: We propose CSI2Video, a novel cross-modal method to recover fine-grained surveillance video in real-time. Our solution generates realistic surveillance videos without any expensive wireless equipment and has ubiquitous, cheap, and real-time characteristics.
• Score: 5.818870353966268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video capture is the most extensively utilized human perception source due to its intuitively understandable nature. A desired video capture often requires multiple environmental conditions such as ample ambient-light, unobstructed space, and proper camera angle. In contrast, wireless measurements are more ubiquitous and have fewer environmental constraints. In this paper, we propose CSI2Video, a novel cross-modal method that leverages only WiFi signals from commercial devices and a source of human identity information to recover fine-grained surveillance video in a real-time manner. Specifically, two tailored deep neural networks are designed to conduct cross-modal mapping and video generation tasks respectively. We make use of an auto-encoder-based structure to extract pose features from WiFi frames. Afterward, both extracted pose features and identity information are merged to generate synthetic surveillance video. Our solution generates realistic surveillance videos without any expensive wireless equipment and has ubiquitous, cheap, and real-time characteristics.

Related papers

• ViFi-ReID: A Two-Stream Vision-WiFi Multimodal Approach for Person Re-identification [3.3743041904085125]
  Person re-identification (ReID) plays a vital role in safety inspections, personnel counting, and more. Most current ReID approaches primarily extract features from images, which are easily affected by objective conditions. We leverage widely available routers as sensing devices by capturing gait information from pedestrians through the Channel State Information (CSI) in WiFi signals.
  arXiv  Detail & Related papers  (2024-10-13T15:34:11Z)
• CausalVE: Face Video Privacy Encryption via Causal Video Prediction [13.577971999457164]
  With the proliferation of video and live-streaming websites, public-face video distribution and interactions pose greater privacy risks. We propose a neural network framework, CausalVE, to address these shortcomings. Our framework has good security in public video dissemination and outperforms state-of-the-art methods from a qualitative, quantitative, and visual point of view.
  arXiv  Detail & Related papers  (2024-09-28T10:34:22Z)
• DensePose From WiFi [86.61881052177228]
  We develop a deep neural network that maps the phase and amplitude of WiFi signals to UV coordinates within 24 human regions. Our model can estimate the dense pose of multiple subjects, with comparable performance to image-based approaches.
  arXiv  Detail & Related papers  (2022-12-31T16:48:43Z)
• Spatial-Temporal Frequency Forgery Clue for Video Forgery Detection in VIS and NIR Scenario [87.72258480670627]
  Existing face forgery detection methods based on frequency domain find that the GAN forged images have obvious grid-like visual artifacts in the frequency spectrum compared to the real images. This paper proposes a Cosine Transform-based Forgery Clue Augmentation Network (FCAN-DCT) to achieve a more comprehensive spatial-temporal feature representation.
  arXiv  Detail & Related papers  (2022-07-05T09:27:53Z)
• A Wireless-Vision Dataset for Privacy Preserving Human Activity Recognition [53.41825941088989]
  A new WiFi-based and video-based neural network (WiNN) is proposed to improve the robustness of activity recognition. Our results show that WiVi data set satisfies the primary demand and all three branches in the proposed pipeline keep more than $80%$ of activity recognition accuracy.
  arXiv  Detail & Related papers  (2022-05-24T10:49:11Z)
• Forgery Attack Detection in Surveillance Video Streams Using Wi-Fi Channel State Information [20.815889839515087]
  cybersecurity breaches expose surveillance video streams to forgery attacks. Traditional video forensics approaches can localize traces using spatial-temporal analysis on relatively long video clips. We propose Secure-Pose, which exploits the pervasive coexistence of surveillance and Wi-Fi infrastructures. Secure-Pose achieves a high detection accuracy of 98.7% and localizes abnormal objects under playback and tampering attacks.
  arXiv  Detail & Related papers  (2022-01-24T06:51:03Z)
• Video Salient Object Detection via Contrastive Features and Attention Modules [106.33219760012048]
  We propose a network with attention modules to learn contrastive features for video salient object detection. A co-attention formulation is utilized to combine the low-level and high-level features. We show that the proposed method requires less computation, and performs favorably against the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-11-03T17:40:32Z)
• Robust Privacy-Preserving Motion Detection and Object Tracking in Encrypted Streaming Video [39.453548972987015]
  We propose an efficient and robust privacy-preserving motion detection and multiple object tracking scheme for encrypted surveillance video bitstreams. Our scheme achieves the best detection and tracking performance compared with existing works in the encrypted and compressed domain. Our scheme can be effectively used in complex surveillance scenarios with different challenges, such as camera movement/jitter, dynamic background, and shadows.
  arXiv  Detail & Related papers  (2021-08-30T11:58:19Z)
• A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identification [77.08204941207985]
  Video-based person re-identification (Re-ID) aims to retrieve video sequences of the same person under non-overlapping cameras. We propose a novel framework named Trigeminal Transformers (TMT) for video-based person Re-ID.
  arXiv  Detail & Related papers  (2021-04-05T02:50:16Z)
• Video Exploration via Video-Specific Autoencoders [60.256055890647595]
  We present video-specific autoencoders that enables human-controllable video exploration. We observe that a simple autoencoder trained on multiple frames of a specific video enables one to perform a large variety of video processing and editing tasks.
  arXiv  Detail & Related papers  (2021-03-31T17:56:13Z)
• A Flow-Guided Mutual Attention Network for Video-Based Person Re-Identification [25.217641512619178]
  Person ReID is a challenging problem in many analytics and surveillance applications. Video-based person ReID has recently gained much interest because it allows capturing feature discriminant-temporal information. In this paper, the motion pattern of a person is explored as an additional cue for ReID.
  arXiv  Detail & Related papers  (2020-08-09T18:58:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.