Privacy-Preserving Video Classification with Convolutional Neural
Networks
- URL: http://arxiv.org/abs/2102.03513v1
- Date: Sat, 6 Feb 2021 05:05:31 GMT
- Title: Privacy-Preserving Video Classification with Convolutional Neural
Networks
- Authors: Sikha Pentyala and Rafael Dowsley and Martine De Cock
- Abstract summary: We propose a privacy-preserving implementation of single-frame method based video classification with convolutional neural networks.
We evaluate our proposed solution in an application for private human emotion recognition.
- Score: 8.51142156817993
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many video classification applications require access to personal data,
thereby posing an invasive security risk to the users' privacy. We propose a
privacy-preserving implementation of single-frame method based video
classification with convolutional neural networks that allows a party to infer
a label from a video without necessitating the video owner to disclose their
video to other entities in an unencrypted manner. Similarly, our approach
removes the requirement of the classifier owner from revealing their model
parameters to outside entities in plaintext. To this end, we combine existing
Secure Multi-Party Computation (MPC) protocols for private image classification
with our novel MPC protocols for oblivious single-frame selection and secure
label aggregation across frames. The result is an end-to-end privacy-preserving
video classification pipeline. We evaluate our proposed solution in an
application for private human emotion recognition. Our results across a variety
of security settings, spanning honest and dishonest majority configurations of
the computing parties, and for both passive and active adversaries, demonstrate
that videos can be classified with state-of-the-art accuracy, and without
leaking sensitive user information.
Related papers
- Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning [62.224804688233]
differential privacy (DP) offers a promising solution by ensuring models are 'almost indistinguishable' with or without any particular privacy unit.
We study user-level DP motivated by applications where it necessary to ensure uniform privacy protection across users.
arXiv Detail & Related papers (2024-06-20T13:54:32Z) - Federated Face Forgery Detection Learning with Personalized Representation [63.90408023506508]
Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat.
Traditional forgery detection methods directly centralized training on data.
The paper proposes a novel federated face forgery detection learning with personalized representation.
arXiv Detail & Related papers (2024-06-17T02:20:30Z) - Multimodal Group Emotion Recognition In-the-wild Using Privacy-Compliant
Features [0.0]
Group-level emotion recognition can be useful in many fields including social robotics, conversational agents, e-coaching and learning analytics.
This paper explores privacy-compliant group-level emotion recognition ''in-the-wild'' within the EmotiW Challenge 2023.
arXiv Detail & Related papers (2023-12-06T08:58:11Z) - Privacy Side Channels in Machine Learning Systems [87.53240071195168]
We introduce privacy side channels: attacks that exploit system-level components to extract private information.
For example, we show that deduplicating training data before applying differentially-private training creates a side-channel that completely invalidates any provable privacy guarantees.
We further show that systems which block language models from regenerating training data can be exploited to exfiltrate private keys contained in the training set.
arXiv Detail & Related papers (2023-09-11T16:49:05Z) - Differentially Private Video Activity Recognition [79.36113764129092]
We propose Multi-Clip DP-SGD, a novel framework for enforcing video-level differential privacy through clip-based classification models.
Our approach achieves 81% accuracy with a privacy budget of epsilon=5 on UCF-101, marking a 76% improvement compared to a direct application of DP-SGD.
arXiv Detail & Related papers (2023-06-27T18:47:09Z) - Privacy-Preserving Action Recognition via Motion Difference Quantization [22.31448780032675]
This paper proposes a simple, yet robust privacy-preserving encoder called BDQ.
It is composed of three modules: Blur, Difference, and Quantization.
Experiments on three benchmark datasets show that the proposed encoder design can achieve state-of-the-art trade-off.
arXiv Detail & Related papers (2022-08-04T05:03:27Z) - OPOM: Customized Invisible Cloak towards Face Privacy Protection [58.07786010689529]
We investigate the face privacy protection from a technology standpoint based on a new type of customized cloak.
We propose a new method, named one person one mask (OPOM), to generate person-specific (class-wise) universal masks.
The effectiveness of the proposed method is evaluated on both common and celebrity datasets.
arXiv Detail & Related papers (2022-05-24T11:29:37Z) - SPAct: Self-supervised Privacy Preservation for Action Recognition [73.79886509500409]
Existing approaches for mitigating privacy leakage in action recognition require privacy labels along with the action labels from the video dataset.
Recent developments of self-supervised learning (SSL) have unleashed the untapped potential of the unlabeled data.
We present a novel training framework which removes privacy information from input video in a self-supervised manner without requiring privacy labels.
arXiv Detail & Related papers (2022-03-29T02:56:40Z) - Robust Privacy-Preserving Motion Detection and Object Tracking in
Encrypted Streaming Video [39.453548972987015]
We propose an efficient and robust privacy-preserving motion detection and multiple object tracking scheme for encrypted surveillance video bitstreams.
Our scheme achieves the best detection and tracking performance compared with existing works in the encrypted and compressed domain.
Our scheme can be effectively used in complex surveillance scenarios with different challenges, such as camera movement/jitter, dynamic background, and shadows.
arXiv Detail & Related papers (2021-08-30T11:58:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.