Privacy-Preserving Visual Localization with Event Cameras

• URL: http://arxiv.org/abs/2212.03177v1
• Date: Sun, 4 Dec 2022 07:22:17 GMT
• Title: Privacy-Preserving Visual Localization with Event Cameras
• Authors: Junho Kim, Young Min Kim, Yicheng Wu, Ramzi Zahreddine, Weston A. Welge, Gurunandan Krishnan, Sizhuo Ma, Jian Wang
• Abstract summary: Event cameras can potentially make robust localization due to high dynamic range and small motion blur. We propose applying event-to-image conversion prior to localization which leads to stable localization. In the privacy perspective, event cameras capture only a fraction of visual information compared to normal cameras.
• Score: 13.21898697942957
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a robust, privacy-preserving visual localization algorithm using event cameras. While event cameras can potentially make robust localization due to high dynamic range and small motion blur, the sensors exhibit large domain gaps making it difficult to directly apply conventional image-based localization algorithms. To mitigate the gap, we propose applying event-to-image conversion prior to localization which leads to stable localization. In the privacy perspective, event cameras capture only a fraction of visual information compared to normal cameras, and thus can naturally hide sensitive visual details. To further enhance the privacy protection in our event-based pipeline, we introduce privacy protection at two levels, namely sensor and network level. Sensor level protection aims at hiding facial details with lightweight filtering while network level protection targets hiding the entire user's view in private scene applications using a novel neural network inference pipeline. Both levels of protection involve light-weight computation and incur only a small performance loss. We thus project our method to serve as a building block for practical location-based services using event cameras. The code and dataset will be made public through the following link: https://github.com/82magnolia/event_localization.

Related papers

• EventTransAct: A video transformer-based framework for Event-camera based action recognition [52.537021302246664]
  Event cameras offer new opportunities compared to standard action recognition in RGB videos. In this study, we employ a computationally efficient model, namely the video transformer network (VTN), which initially acquires spatial embeddings per event-frame. In order to better adopt the VTN for the sparse and fine-grained nature of event data, we design Event-Contrastive Loss ($mathcalL_EC$) and event-specific augmentations.
  arXiv  Detail & Related papers  (2023-08-25T23:51:07Z)
• Person Re-Identification without Identification via Event Anonymization [23.062038973576296]
  Deep learning has been able to reconstruct images from event cameras with high fidelity, reintroducing a potential threat to privacy for event-based vision applications. We propose an end-to-end network architecture jointly optimized for the twofold objective of preserving privacy and performing a downstream task such as person ReId.
  arXiv  Detail & Related papers  (2023-08-08T17:04:53Z)
• Privacy-Preserving Representations are not Enough -- Recovering Scene Content from Camera Poses [63.12979986351964]
  Existing work on privacy-preserving localization aims to defend against an attacker who has access to a cloud-based service. We show that an attacker can learn about details of a scene without any access by simply querying a localization service.
  arXiv  Detail & Related papers  (2023-05-08T10:25:09Z)
• PL-EVIO: Robust Monocular Event-based Visual Inertial Odometry with Point and Line Features [3.6355269783970394]
  Event cameras are motion-activated sensors that capture pixel-level illumination changes instead of the intensity image with a fixed frame rate. We propose a robust, high-accurate, and real-time optimization-based monocular event-based visual-inertial odometry (VIO) method.
  arXiv  Detail & Related papers  (2022-09-25T06:14:12Z)
• On the Design of Privacy-Aware Cameras: a Study on Deep Neural Networks [0.7646713951724011]
  This paper studies the effect of camera distortions on data protection. We build a privacy-aware camera that cannot extract personal information such as license plate numbers. At the same time, we ensure that useful non-sensitive data can still be extracted from distorted images.
  arXiv  Detail & Related papers  (2022-08-24T08:45:31Z)
• PrivHAR: Recognizing Human Actions From Privacy-preserving Lens [58.23806385216332]
  We propose an optimizing framework to provide robust visual privacy protection along the human action recognition pipeline. Our framework parameterizes the camera lens to successfully degrade the quality of the videos to inhibit privacy attributes and protect against adversarial attacks.
  arXiv  Detail & Related papers  (2022-06-08T13:43:29Z)
• SPAct: Self-supervised Privacy Preservation for Action Recognition [73.79886509500409]
  Existing approaches for mitigating privacy leakage in action recognition require privacy labels along with the action labels from the video dataset. Recent developments of self-supervised learning (SSL) have unleashed the untapped potential of the unlabeled data. We present a novel training framework which removes privacy information from input video in a self-supervised manner without requiring privacy labels.
  arXiv  Detail & Related papers  (2022-03-29T02:56:40Z)
• Deep Learning Approach Protecting Privacy in Camera-Based Critical Applications [57.93313928219855]
  We propose a deep learning approach towards protecting privacy in camera-based systems. Our technique distinguishes between salient (visually prominent) and non-salient objects based on the intuition that the latter is unlikely to be needed by the application.
  arXiv  Detail & Related papers  (2021-10-04T19:16:27Z)
• Moving Object Detection for Event-based vision using Graph Spectral Clustering [6.354824287948164]
  Moving object detection has been a central topic of discussion in computer vision for its wide range of applications. We present an unsupervised Graph Spectral Clustering technique for Moving Object Detection in Event-based data. We additionally show how the optimum number of moving objects can be automatically determined.
  arXiv  Detail & Related papers  (2021-09-30T10:19:22Z)
• Privacy-sensitive Objects Pixelation for Live Video Streaming [52.83247667841588]
  We propose a novel Privacy-sensitive Objects Pixelation (PsOP) framework for automatic personal privacy filtering during live video streaming. Our PsOP is extendable to any potential privacy-sensitive objects pixelation. In addition to the pixelation accuracy boosting, experiments on the streaming video data we built show that the proposed PsOP can significantly reduce the over-pixelation ratio in privacy-sensitive object pixelation.
  arXiv  Detail & Related papers  (2021-01-03T11:07:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.