Sarus: Privacy-Preserving Multi-Vendor Perception Fusion via Homomorphic Encryption
- URL: http://arxiv.org/abs/2607.19146v1
- Date: Tue, 21 Jul 2026 14:38:52 GMT
- Title: Sarus: Privacy-Preserving Multi-Vendor Perception Fusion via Homomorphic Encryption
- Abstract summary: We present Sarus, a privacy-preserving framework for multi-vendor perception fusion via homomorphic encryption (HE)<n>Each vendor encodes detections as compact Gaussian moment vectors over a shared spatial lattice and transmits encrypted payloads to a fusion server.<n>The fused result is then decrypted and reconstructed into final detections through class-wise bin merging.
- Score: 0.20313422213594776
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Cooperative perception enables autonomous vehicles (AVs) to improve situational awareness by aggregating detection outputs from multiple agents and sensing platforms, often via a shared fusion service in multi-vendor deployments. However, sharing such outputs at inference time exposes proprietary model behavior and sensitive environmental information, creating significant privacy and security concerns. In this paper, we present Sarus, a privacy-preserving framework for multi-vendor perception fusion via homomorphic encryption (HE), enabling aggregation without revealing individual vendor outputs. Each vendor encodes detections as compact Gaussian moment vectors over a shared spatial lattice and transmits encrypted payloads to a fusion server, which aggregates them directly in the encrypted domain. The fused result is then decrypted and reconstructed into final detections through class-wise bin merging. We analyze the computational complexity, showing linear scaling for vendor payload construction and $O(BV)$ server-side fusion with the number of occupied bins $B$ and vendors $V$, while postprocessing scales as $O(B + \sum_{c\in \mathcal{C}} B_c^2)$, where $\mathcal{C}$ denotes the set of object classes and $B_c$ is the number of occupied bins for class $c$. Experiments demonstrate linear scaling in practice with only a bounded constant-factor overhead from HE, with decryption dominating postprocessing cost. Experiments on the KITTI dataset using camera (YOLOv8) and LiDAR (PointPillars, PV-RCNN) detectors show that Sarus improves scene-level coverage by effectively aggregating complementary detections, particularly in distance-dependent regimes where individual modalities degrade. These results indicate that privacy-preserving multi-vendor perception fusion is feasible for real-time deployment when statistical compression and spatial sparsity are jointly exploited.
Related papers
- Revisiting Continuous Noise Sampling for Multi-Party Differential Privacy [5.859502071587914]
In this paper, we revisit the continuous noise sampling protocols and present several improvements in both security and efficiency.<n>We demonstrate that the scaling operation in arithmetic circuits the noise to a sparse, publicly known set of values, so that an adversary can observe the released noisy queries and decide which dataset produced them.<n>Our implementation achieves $4times sim 612times$ speedup over existing secure discrete samplers and orders-of-magnitude speedup over the insecure sample-and-scale paradigm.
arXiv Detail & Related papers (2026-08-27T22:57:31Z) - HeteroPROPMT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework [4.904389322133549]
Collaborative Perception (CP) improves autonomous systems' awareness of their surroundings by sharing sensor data, intermediate features, and detection results.<n>Existing approaches typically retrain fusion and detection components or introduce modality-specific feature interpreters.<n>We propose HeteroPROMPT, a real-time and privacy-preserving framework for heterogeneous collaborative perception.
arXiv Detail & Related papers (2026-07-28T21:24:43Z) - UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment [20.399005485708273]
Device-free localization trains models from heterogeneous wireless and visual sensors distributed across edge devices.<n>We propose UMEDA, a graph federated learning framework in which clients form nodes of a global graph that share a continuous integral operator.<n> UMEDA outperforms state-of-the-art federated baselines in accuracy, convergence, and communication efficiency.
arXiv Detail & Related papers (2026-05-08T08:15:47Z) - Combinatorial Privacy: Private Multi-Party Bitstream Grand Sum by Hiding in Birkhoff Polytopes [6.178002001006941]
PolyVeil is a protocol for summation across $k$ clients that encodes private bits as permutation matrices in the Birkhoff polytope.<n>#P-hardness requires the full matrix view, while non-vacuous DP requires the scalar view.<n>The protocol needs no PKI, has $O(k)$ communication, and outputs exact aggregates.
arXiv Detail & Related papers (2026-03-24T05:08:38Z) - DP-CSGP: Differentially Private Stochastic Gradient Push with Compressed Communication [71.60998478544028]
We propose Differentially Private Gradient Push with Compressed communication (termedfrac-CSGP) for decentralized learning graphs.<n>For general non-math and smooth objective functions, we show that our algorithm is designed to maintain high accuracy and efficient communication.
arXiv Detail & Related papers (2025-12-15T17:37:02Z) - Perfectly-Private Analog Secure Aggregation in Federated Learning [51.61616734974475]
In federated learning, multiple parties train models locally and share their parameters with a central server, which aggregates them to update a global model.<n>In this paper, a novel secure parameter aggregation method is proposed that employs the torus rather than a finite field.
arXiv Detail & Related papers (2025-09-10T15:22:40Z) - Self-Localized Collaborative Perception [49.86110931859302]
We propose$mathttCoBEVGlue$, a novel self-localized collaborative perception system.
$mathttCoBEVGlue$ is a novel spatial alignment module, which provides the relative poses between agents.
$mathttCoBEVGlue$ achieves state-of-the-art detection performance under arbitrary localization noises and attacks.
arXiv Detail & Related papers (2024-06-18T15:26:54Z) - $\Lambda$-Split: A Privacy-Preserving Split Computing Framework for
Cloud-Powered Generative AI [3.363904632882723]
We introduce $Lambda$-Split, a split computing framework to facilitate computational offloading.
In $Lambda$-Split, a generative model, usually a deep neural network (DNN), is partitioned into three sub-models and distributed across the user's local device and a cloud server.
This architecture ensures that only the hidden layer outputs are transmitted, thereby preventing the external transmission of privacy-sensitive raw input and output data.
arXiv Detail & Related papers (2023-10-23T07:44:04Z) - Scalable Multi-agent Covering Option Discovery based on Kronecker Graphs [49.71319907864573]
In this paper, we propose multi-agent skill discovery which enables the ease of decomposition.
Our key idea is to approximate the joint state space as a Kronecker graph, based on which we can directly estimate its Fiedler vector.
Considering that directly computing the Laplacian spectrum is intractable for tasks with infinite-scale state spaces, we further propose a deep learning extension of our method.
arXiv Detail & Related papers (2023-07-21T14:53:12Z) - Federated Nearest Neighbor Machine Translation [66.8765098651988]
In this paper, we propose a novel federated nearest neighbor (FedNN) machine translation framework.
FedNN leverages one-round memorization-based interaction to share knowledge across different clients.
Experiments show that FedNN significantly reduces computational and communication costs compared with FedAvg.
arXiv Detail & Related papers (2023-02-23T18:04:07Z) - THE-X: Privacy-Preserving Transformer Inference with Homomorphic
Encryption [112.02441503951297]
Privacy-preserving inference of transformer models is on the demand of cloud service users.
We introduce $textitTHE-X$, an approximation approach for transformers, which enables privacy-preserving inference of pre-trained models.
arXiv Detail & Related papers (2022-06-01T03:49:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.