Deep-TEMPEST: Using Deep Learning to Eavesdrop on HDMI from its Unintended Electromagnetic Emanations

• URL: http://arxiv.org/abs/2407.09717v1
• Date: Fri, 12 Jul 2024 23:07:37 GMT
• Title: Deep-TEMPEST: Using Deep Learning to Eavesdrop on HDMI from its Unintended Electromagnetic Emanations
• Authors: Santiago Fernández, Emilio Martínez, Gabriel Varela, Pablo Musé, Federico Larroca,
• Abstract summary: We address the problem of eavesdropping on digital video displays by analyzing the electromagnetic waves that unintentionally emanate from the cables and connectors. Compared to the analog case (VGA), the digital case is harder due to a 10-bit encoding that results in a much larger bandwidth and non-linear mapping between the observed signal and the pixel's intensity. The proposed solution is to recast the problem as an inverse problem and train a deep learning module to map the observed electromagnetic signal back to the displayed image.
• Score: 0.34952465649465553
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we address the problem of eavesdropping on digital video displays by analyzing the electromagnetic waves that unintentionally emanate from the cables and connectors, particularly HDMI. This problem is known as TEMPEST. Compared to the analog case (VGA), the digital case is harder due to a 10-bit encoding that results in a much larger bandwidth and non-linear mapping between the observed signal and the pixel's intensity. As a result, eavesdropping systems designed for the analog case obtain unclear and difficult-to-read images when applied to digital video. The proposed solution is to recast the problem as an inverse problem and train a deep learning module to map the observed electromagnetic signal back to the displayed image. However, this approach still requires a detailed mathematical analysis of the signal, firstly to determine the frequency at which to tune but also to produce training samples without actually needing a real TEMPEST setup. This saves time and avoids the need to obtain these samples, especially if several configurations are being considered. Our focus is on improving the average Character Error Rate in text, and our system improves this rate by over 60 percentage points compared to previous available implementations. The proposed system is based on widely available Software Defined Radio and is fully open-source, seamlessly integrated into the popular GNU Radio framework. We also share the dataset we generated for training, which comprises both simulated and over 1000 real captures. Finally, we discuss some countermeasures to minimize the potential risk of being eavesdropped by systems designed based on similar principles.

Related papers

• A Computational Harmonic Detection Algorithm to Detect Data Leakage through EM Emanation [0.08192907805418582]
  Unintended electromagnetic emissions from electronic devices, known as EM emanations, pose significant security risks. Defense organizations typically use metal shielding to prevent data leakage, but this approach is costly and impractical for widespread use. We propose a harmonic-based detection method by developing a computational harmonic detector.
  arXiv  Detail & Related papers  (2024-10-09T14:40:15Z)
• Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging [22.365437882740657]
  This paper aims to facilitate more practical NLOS imaging by reducing the number of samplings and scan areas. We leverage a denoising autoencoder scheme to acquire rich and noise-robust representations in the measurement space. We introduce a phasor-based pipeline designed to limit the spectrum of our network to the frequency range of interests.
  arXiv  Detail & Related papers  (2024-07-26T07:57:07Z)
• A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition [53.800937914403654]
  Advanced Audio-Visual Speech Recognition (AVSR) systems have been observed to be sensitive to missing video frames. While applying the dropout technique to the video modality enhances robustness to missing frames, it simultaneously results in a performance loss when dealing with complete data input. We propose a novel Multimodal Distribution Approximation with Knowledge Distillation (MDA-KD) framework to reduce over-reliance on the audio modality.
  arXiv  Detail & Related papers  (2024-03-07T06:06:55Z)
• Restoring Original Signal From Pile-up Signal using Deep Learning [0.0]
  Pile-up signals are frequently produced in experimental physics. They create inaccurate physics data with high uncertainty. In this study, we implement a deep learning method to restore the original signals from the pile-up signals.
  arXiv  Detail & Related papers  (2023-04-24T08:42:17Z)
• Microseismic source imaging using physics-informed neural networks with hard constraints [4.07926531936425]
  We propose a direct microseismic imaging framework based on physics-informed neural networks (PINNs) We use the PINNs to represent a multi-frequency wavefield and then apply inverse Fourier transform to extract the source image. We further apply our method to hydraulic fracturing monitoring field data, and demonstrate that our method can correctly image the source with fewer artifacts.
  arXiv  Detail & Related papers  (2023-04-09T21:10:39Z)
• High Fidelity Neural Audio Compression [92.4812002532009]
  We introduce a state-of-the-art real-time, high-fidelity, audio leveraging neural networks. It consists in a streaming encoder-decoder architecture with quantized latent space trained in an end-to-end fashion. We simplify and speed-up the training by using a single multiscale spectrogram adversary.
  arXiv  Detail & Related papers  (2022-10-24T17:52:02Z)
• Overhead-Free Blockage Detection and Precoding Through Physics-Based Graph Neural Networks: LIDAR Data Meets Ray Tracing [58.73924499067486]
  Blockage detection is achieved by classifying light detection and ranging (LIDAR) data through a physics-based graph neural network (GNN) For precoder design, a preliminary channel estimate is obtained by running ray tracing on a 3D surface obtained from LIDAR data. Numerical simulations show that blockage detection is successful with 95% accuracy.
  arXiv  Detail & Related papers  (2022-09-15T15:04:55Z)
• SignalNet: A Low Resolution Sinusoid Decomposition and Estimation Network [79.04274563889548]
  We propose SignalNet, a neural network architecture that detects the number of sinusoids and estimates their parameters from quantized in-phase and quadrature samples. We introduce a worst-case learning threshold for comparing the results of our network relative to the underlying data distributions. In simulation, we find that our algorithm is always able to surpass the threshold for three-bit data but often cannot exceed the threshold for one-bit data.
  arXiv  Detail & Related papers  (2021-06-10T04:21:20Z)
• Deep Learning Radio Frequency Signal Classification with Hybrid Images [0.0]
  We focus on the different pre-processing steps that can be used on the input training data, and test the results on a fixed Deep Learning architecture. We propose a hybrid image that takes advantage of both time and frequency domain information, and tackles the classification as a Computer Vision problem.
  arXiv  Detail & Related papers  (2021-05-19T11:12:09Z)
• Digital Beamforming Robust to Time-Varying Carrier Frequency Offset [21.18926642388997]
  We present novel beamforming algorithms that are robust to signal corruptions arising from a time-variant carrier frequency offset. We propose two atomic-norm-minimization (ANM)-based methods to design a weight vector that can be used to cancel interference when there exist unknown time-varying frequency drift in the pilot and interferer signals.
  arXiv  Detail & Related papers  (2021-03-08T18:08:56Z)
• A Compressive Sensing Approach for Federated Learning over Massive MIMO Communication Systems [82.2513703281725]
  Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices. We present a compressive sensing approach for federated learning over massive multiple-input multiple-output communication systems.
  arXiv  Detail & Related papers  (2020-03-18T05:56:27Z)
• DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection [98.43451011898212]
  In multiuser multiple-input multiple-output (MIMO) setups, where multiple symbols are simultaneously transmitted, accurate symbol detection is challenging. We propose a data-driven implementation of the iterative soft interference cancellation (SIC) algorithm which we refer to as DeepSIC. DeepSIC learns to carry out joint detection from a limited set of training samples without requiring the channel to be linear.
  arXiv  Detail & Related papers  (2020-02-08T18:31:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.