Privacy-Preserving Visual Localization with Event Cameras

• URL: http://arxiv.org/abs/2212.03177v1
• Date: Sun, 4 Dec 2022 07:22:17 GMT
• Title: Privacy-Preserving Visual Localization with Event Cameras
• Authors: Junho Kim, Young Min Kim, Yicheng Wu, Ramzi Zahreddine, Weston A. Welge, Gurunandan Krishnan, Sizhuo Ma, Jian Wang
• Abstract summary: Event cameras can potentially make robust localization due to high dynamic range and small motion blur. We propose applying event-to-image conversion prior to localization which leads to stable localization. In the privacy perspective, event cameras capture only a fraction of visual information compared to normal cameras.
• Score: 13.21898697942957
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a robust, privacy-preserving visual localization algorithm using event cameras. While event cameras can potentially make robust localization due to high dynamic range and small motion blur, the sensors exhibit large domain gaps making it difficult to directly apply conventional image-based localization algorithms. To mitigate the gap, we propose applying event-to-image conversion prior to localization which leads to stable localization. In the privacy perspective, event cameras capture only a fraction of visual information compared to normal cameras, and thus can naturally hide sensitive visual details. To further enhance the privacy protection in our event-based pipeline, we introduce privacy protection at two levels, namely sensor and network level. Sensor level protection aims at hiding facial details with lightweight filtering while network level protection targets hiding the entire user's view in private scene applications using a novel neural network inference pipeline. Both levels of protection involve light-weight computation and incur only a small performance loss. We thus project our method to serve as a building block for practical location-based services using event cameras. The code and dataset will be made public through the following link: https://github.com/82magnolia/event_localization.

Related papers

• A Privacy-Preserving Localization Scheme with Node Selection in Mobile Networks [48.845334743016345]
  We propose a privacy-preserving localization scheme, named PPLZN. PPLZN protects the location privacy of both the target and anchor nodes in crowdsourced localization.<n>It can achieve accurate position estimation without location leakage and outperform state-of-the-art approaches in both positioning accuracy and communication overhead.
  arXiv  Detail & Related papers  (2026-01-07T12:48:45Z)
• FedWiLoc: Federated Learning for Privacy-Preserving WiFi Indoor Localization [0.05941919160409143]
  Wi-Fi-based indoor localization systems face three critical challenges: protecting user privacy, achieving accurate predictions in dynamic multipath environments, and generalizing across different deployments.<n>We introduce FedWiLoc, a privacy-preserving indoor localization system that addresses these challenges through three key innovations.<n>We show that FedWiLoc outperforms state-of-the-art methods by up to 61.9% in median localization error while maintaining strong privacy guarantees throughout both training and inference.
  arXiv  Detail & Related papers  (2025-12-20T04:10:15Z)
• A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edge [3.344634520578015]
  We propose a distributed, hierarchical offloading framework for Vision Transformers (ViTs)<n>Our approach uses a local trusted edge device, such as a mobile phone or an Nvidia Jetson, as the edge orchestrator.<n>By design, no single external server possesses the complete image, preventing comprehensive data reconstruction.
  arXiv  Detail & Related papers  (2025-12-10T04:37:07Z)
• Activity Recognition on Avatar-Anonymized Datasets with Masked Differential Privacy [64.32494202656801]
  Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. We present anonymization pipeline that replaces sensitive human subjects in video datasets with synthetic avatars within context. We also proposeMaskDP to protect non-anonymized but privacy sensitive background information.
  arXiv  Detail & Related papers  (2024-10-22T15:22:53Z)
• Fast Private Location-based Information Retrieval Over the Torus [2.0680208842600454]
  LocPIR preserves user location privacy when retrieving data from public clouds. System employs TFHE's expertise in non-polynomial evaluations.
  arXiv  Detail & Related papers  (2024-07-29T10:42:17Z)
• Snail: Secure Single Iteration Localization [2.708816087833581]
  localization is a computer vision task by which the position and orientation of a camera is determined from an image and environmental map. We present two approaches to localization, a baseline data-oblivious adaptation of localization suitable for garbled circuits and our novel Single Iteration localization.
  arXiv  Detail & Related papers  (2024-03-22T02:41:14Z)
• EventTransAct: A video transformer-based framework for Event-camera based action recognition [52.537021302246664]
  Event cameras offer new opportunities compared to standard action recognition in RGB videos. In this study, we employ a computationally efficient model, namely the video transformer network (VTN), which initially acquires spatial embeddings per event-frame. In order to better adopt the VTN for the sparse and fine-grained nature of event data, we design Event-Contrastive Loss ($mathcalL_EC$) and event-specific augmentations.
  arXiv  Detail & Related papers  (2023-08-25T23:51:07Z)
• Person Re-Identification without Identification via Event Anonymization [23.062038973576296]
  Deep learning has been able to reconstruct images from event cameras with high fidelity, reintroducing a potential threat to privacy for event-based vision applications. We propose an end-to-end network architecture jointly optimized for the twofold objective of preserving privacy and performing a downstream task such as person ReId.
  arXiv  Detail & Related papers  (2023-08-08T17:04:53Z)
• Lazy Visual Localization via Motion Averaging [89.8709956317671]
  We show that it is possible to achieve high localization accuracy without reconstructing the scene from the database. Experiments show that our visual localization proposal, LazyLoc, achieves comparable performance against state-of-the-art structure-based methods.
  arXiv  Detail & Related papers  (2023-07-19T13:40:45Z)
• Privacy-Preserving Representations are not Enough -- Recovering Scene Content from Camera Poses [63.12979986351964]
  Existing work on privacy-preserving localization aims to defend against an attacker who has access to a cloud-based service. We show that an attacker can learn about details of a scene without any access by simply querying a localization service.
  arXiv  Detail & Related papers  (2023-05-08T10:25:09Z)
• PL-EVIO: Robust Monocular Event-based Visual Inertial Odometry with Point and Line Features [3.6355269783970394]
  Event cameras are motion-activated sensors that capture pixel-level illumination changes instead of the intensity image with a fixed frame rate. We propose a robust, high-accurate, and real-time optimization-based monocular event-based visual-inertial odometry (VIO) method.
  arXiv  Detail & Related papers  (2022-09-25T06:14:12Z)
• On the Design of Privacy-Aware Cameras: a Study on Deep Neural Networks [0.7646713951724011]
  This paper studies the effect of camera distortions on data protection. We build a privacy-aware camera that cannot extract personal information such as license plate numbers. At the same time, we ensure that useful non-sensitive data can still be extracted from distorted images.
  arXiv  Detail & Related papers  (2022-08-24T08:45:31Z)
• Visual Localization via Few-Shot Scene Region Classification [84.34083435501094]
  Visual (re)localization addresses the problem of estimating the 6-DoF camera pose of a query image captured in a known scene. Recent advances in structure-based localization solve this problem by memorizing the mapping from image pixels to scene coordinates. We propose a scene region classification approach to achieve fast and effective scene memorization with few-shot images.
  arXiv  Detail & Related papers  (2022-08-14T22:39:02Z)
• PrivHAR: Recognizing Human Actions From Privacy-preserving Lens [58.23806385216332]
  We propose an optimizing framework to provide robust visual privacy protection along the human action recognition pipeline. Our framework parameterizes the camera lens to successfully degrade the quality of the videos to inhibit privacy attributes and protect against adversarial attacks.
  arXiv  Detail & Related papers  (2022-06-08T13:43:29Z)
• SPAct: Self-supervised Privacy Preservation for Action Recognition [73.79886509500409]
  Existing approaches for mitigating privacy leakage in action recognition require privacy labels along with the action labels from the video dataset. Recent developments of self-supervised learning (SSL) have unleashed the untapped potential of the unlabeled data. We present a novel training framework which removes privacy information from input video in a self-supervised manner without requiring privacy labels.
  arXiv  Detail & Related papers  (2022-03-29T02:56:40Z)
• Deep Learning Approach Protecting Privacy in Camera-Based Critical Applications [57.93313928219855]
  We propose a deep learning approach towards protecting privacy in camera-based systems. Our technique distinguishes between salient (visually prominent) and non-salient objects based on the intuition that the latter is unlikely to be needed by the application.
  arXiv  Detail & Related papers  (2021-10-04T19:16:27Z)
• Moving Object Detection for Event-based vision using Graph Spectral Clustering [6.354824287948164]
  Moving object detection has been a central topic of discussion in computer vision for its wide range of applications. We present an unsupervised Graph Spectral Clustering technique for Moving Object Detection in Event-based data. We additionally show how the optimum number of moving objects can be automatically determined.
  arXiv  Detail & Related papers  (2021-09-30T10:19:22Z)
• VS-Net: Voting with Segmentation for Visual Localization [72.8165619061249]
  We propose a novel visual localization framework that establishes 2D-to-3D correspondences between the query image and the 3D map with a series of learnable scene-specific landmarks. Our proposed VS-Net is extensively tested on multiple public benchmarks and can outperform state-of-the-art visual localization methods.
  arXiv  Detail & Related papers  (2021-05-23T08:44:11Z)
• Privacy-sensitive Objects Pixelation for Live Video Streaming [52.83247667841588]
  We propose a novel Privacy-sensitive Objects Pixelation (PsOP) framework for automatic personal privacy filtering during live video streaming. Our PsOP is extendable to any potential privacy-sensitive objects pixelation. In addition to the pixelation accuracy boosting, experiments on the streaming video data we built show that the proposed PsOP can significantly reduce the over-pixelation ratio in privacy-sensitive object pixelation.
  arXiv  Detail & Related papers  (2021-01-03T11:07:23Z)
• Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings [72.68801373979943]
  Many computer vision systems require users to upload image features to the cloud for processing and storage. We propose a new privacy-preserving feature representation. Compared to the original features, our approach makes it significantly more difficult for an adversary to recover private information.
  arXiv  Detail & Related papers  (2020-06-11T17:29:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.