Millimeter Wave Radar-based Human Activity Recognition for Healthcare Monitoring Robot

• URL: http://arxiv.org/abs/2405.01882v1
• Date: Fri, 3 May 2024 06:57:59 GMT
• Title: Millimeter Wave Radar-based Human Activity Recognition for Healthcare Monitoring Robot
• Authors: Zhanzhong Gu, Xiangjian He, Gengfa Fang, Chengpei Xu, Feng Xia, Wenjing Jia,
• Abstract summary: We propose RobHAR, a movable robot-mounted mmWave radar system for real-time monitoring of human activities. We first propose a sparse point cloud-based global embedding to learn the features of point clouds. Then, we learn the temporal pattern with a bidirectional lightweight LSTM model (BiLiLSTM)
• Score: 8.98784164617929
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Healthcare monitoring is crucial, especially for the daily care of elderly individuals living alone. It can detect dangerous occurrences, such as falls, and provide timely alerts to save lives. Non-invasive millimeter wave (mmWave) radar-based healthcare monitoring systems using advanced human activity recognition (HAR) models have recently gained significant attention. However, they encounter challenges in handling sparse point clouds, achieving real-time continuous classification, and coping with limited monitoring ranges when statically mounted. To overcome these limitations, we propose RobHAR, a movable robot-mounted mmWave radar system with lightweight deep neural networks for real-time monitoring of human activities. Specifically, we first propose a sparse point cloud-based global embedding to learn the features of point clouds using the light-PointNet (LPN) backbone. Then, we learn the temporal pattern with a bidirectional lightweight LSTM model (BiLiLSTM). In addition, we implement a transition optimization strategy, integrating the Hidden Markov Model (HMM) with Connectionist Temporal Classification (CTC) to improve the accuracy and robustness of the continuous HAR. Our experiments on three datasets indicate that our method significantly outperforms the previous studies in both discrete and continuous HAR tasks. Finally, we deploy our system on a movable robot-mounted edge computing platform, achieving flexible healthcare monitoring in real-world scenarios.

Related papers

• Scaling Wearable Foundation Models [54.93979158708164]
  We investigate the scaling properties of sensor foundation models across compute, data, and model size. Using a dataset of up to 40 million hours of in-situ heart rate, heart rate variability, electrodermal activity, accelerometer, skin temperature, and altimeter per-minute data from over 165,000 people, we create LSM. Our results establish the scaling laws of LSM for tasks such as imputation, extrapolation, both across time and sensor modalities.
  arXiv  Detail & Related papers  (2024-10-17T15:08:21Z)
• Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps [56.827895559823126]
  Self-organizing map (SOM) is a neural model often used in clustering and dimensionality reduction. We propose a generalization of the SOM, the continual SOM, which is capable of online unsupervised learning under a low memory budget. Our results, on benchmarks including MNIST, Kuzushiji-MNIST, and Fashion-MNIST, show almost a two times increase in accuracy.
  arXiv  Detail & Related papers  (2024-02-19T19:11:22Z)
• Environment-independent mmWave Fall Detection with Interacting Multiple Model [1.9358739203360094]
  mmWave radar is a promising candidate technology for its privacy-preserving and non-contact manner. FADE is a practical fall detection radar system with enhanced accuracy and robustness in real-world scenarios.
  arXiv  Detail & Related papers  (2023-11-15T07:49:46Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloud [9.570438238511073]
  Motion prediction is key enabler for automated driving systems and intelligent transportation applications. Current challenges are how to effectively combine different perception tasks into a single backbone. We propose a novel attention network based on a transformer self-attention mechanism for joint semantic segmentation.
  arXiv  Detail & Related papers  (2022-02-28T23:18:27Z)
• Human Activity Recognition using Continuous Wavelet Transform and Convolutional Neural Networks [0.0]
  Human Activity Recognition (HAR) is a perspective and fast-paced Data Science field. We propose a new workflow to address the HAR problem and evaluate it on the UniMiB SHAR dataset. We succeed to reach 99.26 % accuracy and it is a worthy performance for this problem.
  arXiv  Detail & Related papers  (2021-06-23T21:49:17Z)
• System-reliability based multi-ensemble of GAN and one-class joint Gaussian distributions for unsupervised real-time structural health monitoring [0.0]
  This study introduces an unsupervised real-time SHM method with a mixture of low- and high-dimensional features without a case-dependent extraction scheme. A novelty detection system of limit-state functions based on GAN and 1-CG models' detection scores is constructed. The tuning makes the method robust to user-defined parameters, which is crucial as there is no rule for selecting those parameters in a real-time SHM.
  arXiv  Detail & Related papers  (2021-02-01T20:50:55Z)
• Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance [95.86944752753564]
  We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
  arXiv  Detail & Related papers  (2020-07-28T07:34:30Z)
• Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms [53.38353133198842]
  Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI) This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
  arXiv  Detail & Related papers  (2020-07-23T13:32:47Z)
• Object Tracking through Residual and Dense LSTMs [67.98948222599849]
  Deep learning-based trackers based on LSTMs (Long Short-Term Memory) recurrent neural networks have emerged as a powerful alternative. DenseLSTMs outperform Residual and regular LSTM, and offer a higher resilience to nuisances. Our case study supports the adoption of residual-based RNNs for enhancing the robustness of other trackers.
  arXiv  Detail & Related papers  (2020-06-22T08:20:17Z)
• ReRe: A Lightweight Real-time Ready-to-Go Anomaly Detection Approach for Time Series [0.27528170226206433]
  This paper introduces ReRe, a Real-time Ready-to-go proactive Anomaly Detection algorithm for streaming time series. ReRe employs two lightweight Long Short-Term Memory (LSTM) models to predict and jointly determine whether or not an upcoming data point is anomalous. Experiments based on real-world time-series datasets demonstrate the good performance of ReRe in real-time anomaly detection.
  arXiv  Detail & Related papers  (2020-04-05T21:26:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.