Contactless Human Activity Recognition using Deep Learning with Flexible and Scalable Software Define Radio

• URL: http://arxiv.org/abs/2304.09756v1
• Date: Tue, 18 Apr 2023 10:20:14 GMT
• Title: Contactless Human Activity Recognition using Deep Learning with Flexible and Scalable Software Define Radio
• Authors: Muhammad Zakir Khan, Jawad Ahmad, Wadii Boulila, Matthew Broadbent, Syed Aziz Shah, Anis Koubaa, Qammer H. Abbasi
• Abstract summary: This study investigates the use of Wi-Fi channel state information (CSI) as a novel method of ambient sensing. These methods avoid additional costly hardware required for vision-based systems, which are privacy-intrusive. This study presents a Wi-Fi CSI-based HAR system that assesses and contrasts deep learning approaches.
• Score: 1.3106429146573144
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ambient computing is gaining popularity as a major technological advancement for the future. The modern era has witnessed a surge in the advancement in healthcare systems, with viable radio frequency solutions proposed for remote and unobtrusive human activity recognition (HAR). Specifically, this study investigates the use of Wi-Fi channel state information (CSI) as a novel method of ambient sensing that can be employed as a contactless means of recognizing human activity in indoor environments. These methods avoid additional costly hardware required for vision-based systems, which are privacy-intrusive, by (re)using Wi-Fi CSI for various safety and security applications. During an experiment utilizing universal software-defined radio (USRP) to collect CSI samples, it was observed that a subject engaged in six distinct activities, which included no activity, standing, sitting, and leaning forward, across different areas of the room. Additionally, more CSI samples were collected when the subject walked in two different directions. This study presents a Wi-Fi CSI-based HAR system that assesses and contrasts deep learning approaches, namely convolutional neural network (CNN), long short-term memory (LSTM), and hybrid (LSTM+CNN), employed for accurate activity recognition. The experimental results indicate that LSTM surpasses current models and achieves an average accuracy of 95.3% in multi-activity classification when compared to CNN and hybrid techniques. In the future, research needs to study the significance of resilience in diverse and dynamic environments to identify the activity of multiple users.

Related papers

• Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
  We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS) FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
  arXiv  Detail & Related papers  (2024-01-22T14:16:37Z)
• Time-Selective RNN for Device-Free Multi-Room Human Presence Detection Using WiFi CSI [9.927073290898848]
  Device-free human presence detection is crucial technology for various applications, including home automation, security, and healthcare. Recent research has explored the use of wireless channel state information extracted from commercial WiFi access points (APs) to provide detailed channel characteristics. We propose a device-free human presence detection system for multi-room scenarios using a time-selective conditional dual feature extract recurrent network.
  arXiv  Detail & Related papers  (2023-04-25T19:21:47Z)
• Attention-Enhanced Deep Learning for Device-Free Through-the-Wall Presence Detection Using Indoor WiFi Systems [9.087163485833054]
  We propose a novel system for human presence detection using the channel state information (CSI) of WiFi signals. Our system named attention-enhanced deep learning for presence detection (ALPD) employs an attention mechanism to automatically select informative subcarriers from the CSI data. We evaluate the proposed ALPD system by deploying a pair of WiFi access points (APs) for collecting CSI dataset, which is further compared with several benchmarks.
  arXiv  Detail & Related papers  (2023-04-25T19:17:36Z)
• DensePose From WiFi [86.61881052177228]
  We develop a deep neural network that maps the phase and amplitude of WiFi signals to UV coordinates within 24 human regions. Our model can estimate the dense pose of multiple subjects, with comparable performance to image-based approaches.
  arXiv  Detail & Related papers  (2022-12-31T16:48:43Z)
• CRONOS: Colorization and Contrastive Learning for Device-Free NLoS Human Presence Detection using Wi-Fi CSI [9.927073290898848]
  Device-free human detection through sensors or cameras has been widely adopted, but it comes with privacy issues as well as misdetection for motionless people. We propose a system called CRONOS, which generates dynamic recurrence plots (RPs) and color-coded CSI ratios to distinguish mobile and stationary people.
  arXiv  Detail & Related papers  (2022-11-07T16:18:18Z)
• A Wireless-Vision Dataset for Privacy Preserving Human Activity Recognition [53.41825941088989]
  A new WiFi-based and video-based neural network (WiNN) is proposed to improve the robustness of activity recognition. Our results show that WiVi data set satisfies the primary demand and all three branches in the proposed pipeline keep more than $80%$ of activity recognition accuracy.
  arXiv  Detail & Related papers  (2022-05-24T10:49:11Z)
• Moving Object Classification with a Sub-6 GHz Massive MIMO Array using Real Data [64.48836187884325]
  Classification between different activities in an indoor environment using wireless signals is an emerging technology for various applications. In this paper, we analyze classification of moving objects by employing machine learning on real data from a massive multi-input-multi-output (MIMO) system in an indoor environment.
  arXiv  Detail & Related papers  (2021-02-09T15:48:35Z)
• Learning to Continuously Optimize Wireless Resource In Episodically Dynamic Environment [55.91291559442884]
  This work develops a methodology that enables data-driven methods to continuously learn and optimize in a dynamic environment. We propose to build the notion of continual learning into the modeling process of learning wireless systems. Our design is based on a novel min-max formulation which ensures certain fairness" across different data samples.
  arXiv  Detail & Related papers  (2020-11-16T08:24:34Z)
• Using GAN to Enhance the Accuracy of Indoor Human Activity Recognition [0.9239657838690226]
  We present a semi-supervised learning method for activity recognition systems in which long short-term memory (LSTM) is employed to learn features and recognize seven different actions. Our experimental results confirm that this model can increase classification accuracy by 3.4% and reduce the Log loss by almost 16%.
  arXiv  Detail & Related papers  (2020-04-23T15:22:05Z)
• Harvesting Ambient RF for Presence Detection Through Deep Learning [12.535149305258171]
  This paper explores the use of ambient radio frequency (RF) signals for human presence detection through deep learning. Using WiFi signal as an example, we demonstrate that the channel state information (CSI) obtained at the receiver contains rich information about the propagation environment. A convolutional neural network (CNN) properly trained with both magnitude and phase information is then designed to achieve reliable presence detection.
  arXiv  Detail & Related papers  (2020-02-13T20:35:55Z)
• EEG-based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and their Applications [65.32004302942218]
  Brain-Computer Interface (BCI) is a powerful communication tool between users and systems. Recent technological advances have increased interest in electroencephalographic (EEG) based BCI for translational and healthcare applications.
  arXiv  Detail & Related papers  (2020-01-28T10:36:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.