Towards Sustainable Personalized On-Device Human Activity Recognition with TinyML and Cloud-Enabled Auto Deployment

• URL: http://arxiv.org/abs/2409.00093v1
• Date: Mon, 26 Aug 2024 13:28:41 GMT
• Title: Towards Sustainable Personalized On-Device Human Activity Recognition with TinyML and Cloud-Enabled Auto Deployment
• Authors: Bidyut Saha, Riya Samanta, Soumya K Ghosh, Ram Babu Roy,
• Abstract summary: This work introduces a wrist-worn smart band designed to address challenges through a novel combination of on-device TinyML-driven computing and cloud-enabled auto-deployment. Users can tailor activity classes to their unique movement styles with minimal calibration. System achieves a 37% increase in accuracy over generalized models in personalized settings.
• Score: 6.9604565273682955
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Human activity recognition (HAR) holds immense potential for transforming health and fitness monitoring, yet challenges persist in achieving personalized outcomes and sustainability for on-device continuous inferences. This work introduces a wrist-worn smart band designed to address these challenges through a novel combination of on-device TinyML-driven computing and cloud-enabled auto-deployment. Leveraging inertial measurement unit (IMU) sensors and a customized 1D Convolutional Neural Network (CNN) for personalized HAR, users can tailor activity classes to their unique movement styles with minimal calibration. By utilising TinyML for local computations, the smart band reduces the necessity for constant data transmission and radio communication, which in turn lowers power consumption and reduces carbon footprint. This method also enhances the privacy and security of user data by limiting its transmission. Through transfer learning and fine-tuning on user-specific data, the system achieves a 37\% increase in accuracy over generalized models in personalized settings. Evaluation using three benchmark datasets, WISDM, PAMAP2, and the BandX demonstrates its effectiveness across various activity domains. Additionally, this work presents a cloud-supported framework for the automatic deployment of TinyML models to remote wearables, enabling seamless customization and on-device inference, even with limited target data. By combining personalized HAR with sustainable strategies for on-device continuous inferences, this system represents a promising step towards fostering healthier and more sustainable societies worldwide.

Related papers

• Scaling Wearable Foundation Models [54.93979158708164]
  We investigate the scaling properties of sensor foundation models across compute, data, and model size. Using a dataset of up to 40 million hours of in-situ heart rate, heart rate variability, electrodermal activity, accelerometer, skin temperature, and altimeter per-minute data from over 165,000 people, we create LSM. Our results establish the scaling laws of LSM for tasks such as imputation, extrapolation, both across time and sensor modalities.
  arXiv  Detail & Related papers  (2024-10-17T15:08:21Z)
• Millimeter Wave Radar-based Human Activity Recognition for Healthcare Monitoring Robot [8.98784164617929]
  We propose RobHAR, a movable robot-mounted mmWave radar system for real-time monitoring of human activities. We first propose a sparse point cloud-based global embedding to learn the features of point clouds. Then, we learn the temporal pattern with a bidirectional lightweight LSTM model (BiLiLSTM)
  arXiv  Detail & Related papers  (2024-05-03T06:57:59Z)
• Agile gesture recognition for low-power applications: customisation for generalisation [41.728933551492275]
  Automated hand gesture recognition has long been a focal point in the AI community. There is an increasing demand for gesture recognition technologies that operate on low-power sensor devices. In this study, we unveil a novel methodology for pattern recognition systems using adaptive and agile error correction.
  arXiv  Detail & Related papers  (2024-03-12T19:34:18Z)
• Autosen: improving automatic wifi human sensing through cross-modal autoencoder [56.44764266426344]
  WiFi human sensing is highly regarded for its low-cost and privacy advantages in recognizing human activities. Traditional cross-modal methods, aimed at enabling self-supervised learning without labeled data, struggle to extract meaningful features from amplitude-phase combinations. We introduce AutoSen, an innovative automatic WiFi sensing solution that departs from conventional approaches.
  arXiv  Detail & Related papers  (2024-01-08T19:50:02Z)
• WiFi-TCN: Temporal Convolution for Human Interaction Recognition based on WiFi signal [4.0773490083614075]
  Wi-Fi based human activity recognition has gained considerable interest in recent times. A challenge associated with Wi-Fi-based HAR is the significant decline in performance when the scene or subject changes. We propose a novel approach that leverages a temporal convolution network with augmentations and attention, referred to as TCN-AA.
  arXiv  Detail & Related papers  (2023-05-21T08:37:32Z)
• WiFi-based Spatiotemporal Human Action Perception [53.41825941088989]
  An end-to-end WiFi signal neural network (SNN) is proposed to enable WiFi-only sensing in both line-of-sight and non-line-of-sight scenarios. Especially, the 3D convolution module is able to explore thetemporal continuity of WiFi signals, and the feature self-attention module can explicitly maintain dominant features.
  arXiv  Detail & Related papers  (2022-06-20T16:03:45Z)
• Human Activity Recognition on wrist-worn accelerometers using self-supervised neural networks [0.0]
  Measures of Activity of Daily Living (ADL) are an important indicator of overall health but difficult to measure in-clinic. We propose a self-supervised learning paradigm to create a robust representation of accelerometer data that can generalize across devices and subjects. We also propose a segmentation algorithm which can identify segments of salient activity and boost HAR accuracy on continuous real-life data.
  arXiv  Detail & Related papers  (2021-12-22T23:35:20Z)
• Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device [53.323878851563414]
  We propose a compiler-aware unified framework incorporating network enhancement and pruning search with the reinforcement learning techniques. Specifically, a generator Recurrent Neural Network (RNN) is employed to provide the unified scheme for both network enhancement and pruning search automatically. The proposed framework achieves real-time 3D object detection on mobile devices with competitive detection performance.
  arXiv  Detail & Related papers  (2020-12-26T19:41:15Z)
• SensiX: A Platform for Collaborative Machine Learning on the Edge [69.1412199244903]
  We present SensiX, a personal edge platform that stays between sensor data and sensing models. We demonstrate its efficacy in developing motion and audio-based multi-device sensing systems. Our evaluation shows that SensiX offers a 7-13% increase in overall accuracy and up to 30% increase across different environment dynamics at the expense of 3mW power overhead.
  arXiv  Detail & Related papers  (2020-12-04T23:06:56Z)
• A Privacy-Preserving-Oriented DNN Pruning and Mobile Acceleration Framework [56.57225686288006]
  Weight pruning of deep neural networks (DNNs) has been proposed to satisfy the limited storage and computing capability of mobile edge devices. Previous pruning methods mainly focus on reducing the model size and/or improving performance without considering the privacy of user data. We propose a privacy-preserving-oriented pruning and mobile acceleration framework that does not require the private training dataset.
  arXiv  Detail & Related papers  (2020-03-13T23:52:03Z)
• MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing [14.574274428615666]
  Running deep learning on devices offers several advantages including data privacy preservation and low-latency response for both model robustness and update. Personal mobile sensing applications are mostly user-specific and highly affected by environment. We present MDLdroid, a novel decentralized mobile deep learning framework to enable resource-aware on-device collaborative learning.
  arXiv  Detail & Related papers  (2020-02-07T16:55:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.