OverHear: Headphone based Multi-sensor Keystroke Inference

• URL: http://arxiv.org/abs/2311.02288v1
• Date: Sat, 4 Nov 2023 00:48:20 GMT
• Title: OverHear: Headphone based Multi-sensor Keystroke Inference
• Authors: Raveen Wijewickrama, Maryam Abbasihafshejani, Anindya Maiti, Murtuza Jadliwala,
• Abstract summary: We develop a keystroke inference framework that leverages both acoustic and accelerometer data from headphones. We achieve top-5 key prediction accuracy of around 80% for mechanical keyboards and around 60% for membrane keyboards. Results highlight the effectiveness and limitations of our approach in the context of real-world scenarios.
• Score: 1.9915929143641455
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Headphones, traditionally limited to audio playback, have evolved to integrate sensors like high-definition microphones and accelerometers. While these advancements enhance user experience, they also introduce potential eavesdropping vulnerabilities, with keystroke inference being our concern in this work. To validate this threat, we developed OverHear, a keystroke inference framework that leverages both acoustic and accelerometer data from headphones. The accelerometer data, while not sufficiently detailed for individual keystroke identification, aids in clustering key presses by hand position. Concurrently, the acoustic data undergoes analysis to extract Mel Frequency Cepstral Coefficients (MFCC), aiding in distinguishing between different keystrokes. These features feed into machine learning models for keystroke prediction, with results further refined via dictionary-based word prediction methods. In our experimental setup, we tested various keyboard types under different environmental conditions. We were able to achieve top-5 key prediction accuracy of around 80% for mechanical keyboards and around 60% for membrane keyboards with top-100 word prediction accuracies over 70% for all keyboard types. The results highlight the effectiveness and limitations of our approach in the context of real-world scenarios.

Related papers

• Acoustic Side Channel Attack on Keyboards Based on Typing Patterns [0.0]
  Side-channel attacks on keyboards can bypass security measures in many systems that use keyboards as one of the input devices. This paper proposes an applicable method that takes into account the user's typing pattern in a realistic environment. Our method achieved an average success rate of 43% across all our case studies when considering real-world scenarios.
  arXiv  Detail & Related papers  (2024-03-13T17:44:15Z)
• Keystroke Verification Challenge (KVC): Biometric and Fairness Benchmark Evaluation [21.63351064421652]
  Keystroke dynamics (KD) for biometric verification has several advantages. KD is among the most discriminative behavioral traits. We present a new experimental framework to benchmark KD-based biometric verification performance and fairness.
  arXiv  Detail & Related papers  (2023-11-10T11:23:28Z)
• A Survey on Acoustic Side Channel Attacks on Keyboards [0.0]
  Mechanical keyboards are susceptible to acoustic side-channel attacks. Researchers have developed methods that can extract typed keystrokes from ambient noise. With the improvement of microphone technology, the potential vulnerability to acoustic side-channel attacks also increases.
  arXiv  Detail & Related papers  (2023-09-20T02:26:53Z)
• A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards [6.230751621285321]
  This paper presents a state-of-the-art deep learning model in order to classify laptop keystrokes, using a smartphone integrated microphone. When trained on keystrokes recorded by a nearby phone, the classifier achieved an accuracy of 95%, the highest accuracy seen without the use of a language model. We discuss a series of mitigation methods to protect users against these series of attacks.
  arXiv  Detail & Related papers  (2023-08-02T10:51:36Z)
• BeCAPTCHA-Type: Biometric Keystroke Data Generation for Improved Bot Detection [63.447493500066045]
  This work proposes a data driven learning model for the synthesis of keystroke biometric data. The proposed method is compared with two statistical approaches based on Universal and User-dependent models. Our experimental framework considers a dataset with 136 million keystroke events from 168 thousand subjects.
  arXiv  Detail & Related papers  (2022-07-27T09:26:15Z)
• Mobile Behavioral Biometrics for Passive Authentication [65.94403066225384]
  This work carries out a comparative analysis of unimodal and multimodal behavioral biometric traits. Experiments are performed over HuMIdb, one of the largest and most comprehensive freely available mobile user interaction databases. In our experiments, the most discriminative background sensor is the magnetometer, whereas among touch tasks the best results are achieved with keystroke.
  arXiv  Detail & Related papers  (2022-03-14T17:05:59Z)
• My(o) Armband Leaks Passwords: An EMG and IMU Based Keylogging Side-Channel Attack [8.195365677760211]
  We take a look at the potential of using electromyographic (EMG) data, a sensor modality which is new to the market. In our approach, the EMG data has proven to be the most prominent source of information compared to the accelerometer and gyroscope. We have created an extensive dataset including more than 310 000 keystrokes recorded from 37 volunteers.
  arXiv  Detail & Related papers  (2021-12-04T16:48:56Z)
• Accurate Grid Keypoint Learning for Efficient Video Prediction [87.71109421608232]
  Keypoint-based video prediction methods can consume substantial computing resources in training and deployment. In this paper, we design a new grid keypoint learning framework, aiming at a robust and explainable intermediate keypoint representation for long-term efficient video prediction. Our method outperforms the state-ofthe-art video prediction methods while saves 98% more than computing resources.
  arXiv  Detail & Related papers  (2021-07-28T05:04:30Z)
• TypeNet: Deep Learning Keystroke Biometrics [77.80092630558305]
  We introduce TypeNet, a Recurrent Neural Network trained with a moderate number of keystrokes per identity. With 5 gallery sequences and test sequences of length 50, TypeNet achieves state-of-the-art keystroke biometric authentication performance. Our experiments demonstrate a moderate increase in error with up to 100,000 subjects, demonstrating the potential of TypeNet to operate at an Internet scale.
  arXiv  Detail & Related papers  (2021-01-14T12:49:09Z)
• Keystroke Biometrics in Response to Fake News Propagation in a Global Pandemic [77.79066811371978]
  This work proposes and analyzes the use of keystroke biometrics for content de-anonymization. Fake news have become a powerful tool to manipulate public opinion, especially during major events.
  arXiv  Detail & Related papers  (2020-05-15T17:56:11Z)
• End-to-End Automatic Speech Recognition Integrated With CTC-Based Voice Activity Detection [48.80449801938696]
  This paper integrates a voice activity detection function with end-to-end automatic speech recognition. We focus on connectionist temporal classification ( CTC) and its extension ofsynchronous/attention. We use the labels as a cue for detecting speech segments with simple thresholding.
  arXiv  Detail & Related papers  (2020-02-03T03:36:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.