Transfer Learning for Human Activity Recognition using Representational Analysis of Neural Networks

• URL: http://arxiv.org/abs/2012.04479v2
• Date: Tue, 23 Feb 2021 18:36:47 GMT
• Title: Transfer Learning for Human Activity Recognition using Representational Analysis of Neural Networks
• Authors: Sizhe An, Ganapati Bhat, Suat Gumussoy, Umit Ogras
• Abstract summary: We propose a transfer learning framework for human activity recognition. We show up to 43% accuracy improvement and 66% training time reduction when compared to the baseline without using transfer learning.
• Score: 0.5898893619901381
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Human activity recognition (HAR) research has increased in recent years due to its applications in mobile health monitoring, activity recognition, and patient rehabilitation. The typical approach is training a HAR classifier offline with known users and then using the same classifier for new users. However, the accuracy for new users can be low with this approach if their activity patterns are different than those in the training data. At the same time, training from scratch for new users is not feasible for mobile applications due to the high computational cost and training time. To address this issue, we propose a HAR transfer learning framework with two components. First, a representational analysis reveals common features that can transfer across users and user-specific features that need to be customized. Using this insight, we transfer the reusable portion of the offline classifier to new users and fine-tune only the rest. Our experiments with five datasets show up to 43% accuracy improvement and 66% training time reduction when compared to the baseline without using transfer learning. Furthermore, measurements on the Nvidia Jetson Xavier-NX hardware platform reveal that the power and energy consumption decrease by 43% and 68%, respectively, while achieving the same or higher accuracy as training from scratch.

Related papers

• SelfAct: Personalized Activity Recognition based on Self-Supervised and Active Learning [0.688204255655161]
  SelfAct is a novel framework for Human Activity Recognition (HAR) on wearable and mobile devices. It combines self-supervised and active learning to mitigate problems such as intra- and inter-variability of activity execution. Our experiments on two publicly available HAR datasets demonstrate that SelfAct achieves results close to or even better than the ones of fully supervised approaches.
  arXiv  Detail & Related papers  (2023-04-19T09:39:11Z)
• Convolutional Neural Networks for the classification of glitches in gravitational-wave data streams [52.77024349608834]
  We classify transient noise signals (i.e.glitches) and gravitational waves in data from the Advanced LIGO detectors. We use models with a supervised learning approach, both trained from scratch using the Gravity Spy dataset. We also explore a self-supervised approach, pre-training models with automatically generated pseudo-labels.
  arXiv  Detail & Related papers  (2023-03-24T11:12:37Z)
• Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling [66.02953670238647]
  Tail users suffer from significantly lower-quality recommendation than the head users after joint training. A model trained on tail users separately still achieve inferior results due to limited data. We propose a novel approach that significantly improves the recommendation performance of the tail users.
  arXiv  Detail & Related papers  (2022-08-19T02:50:19Z)
• Contextual Squeeze-and-Excitation for Efficient Few-Shot Image Classification [57.36281142038042]
  We present a new adaptive block called Contextual Squeeze-and-Excitation (CaSE) that adjusts a pretrained neural network on a new task to significantly improve performance. We also present a new training protocol based on Coordinate-Descent called UpperCaSE that exploits meta-trained CaSE blocks and fine-tuning routines for efficient adaptation.
  arXiv  Detail & Related papers  (2022-06-20T15:25:08Z)
• Classifying Human Activities using Machine Learning and Deep Learning Techniques [0.0]
  Human Activity Recognition (HAR) describes the machines ability to recognize human actions. Challenge in HAR is to overcome the difficulties of separating human activities based on the given data. Deep Learning techniques like Long Short-Term Memory (LSTM), Bi-Directional LS classifier, Recurrent Neural Network (RNN), and Gated Recurrent Unit (GRU) are trained. Experiment results proved that the Linear Support Vector in machine learning and Gated Recurrent Unit in Deep Learning provided better accuracy for human activity recognition.
  arXiv  Detail & Related papers  (2022-05-19T05:20:04Z)
• Enabling hand gesture customization on wrist-worn devices [28.583516259577486]
  We present a framework for gesture customization requiring minimal examples from users, all without degrading the performance of existing gesture sets. Our approach paves the way for a future where users are no longer bound to pre-existing gestures, freeing them to creatively introduce new gestures tailored to their preferences and abilities.
  arXiv  Detail & Related papers  (2022-03-29T05:12:32Z)
• BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines [49.75878234192369]
  We present WEAVER, a simple, yet efficient post-processing method that infuses old knowledge into the new model. We show that applying WEAVER in a sequential manner results in similar word embedding distributions as doing a combined training on all data at once.
  arXiv  Detail & Related papers  (2022-02-21T10:34:41Z)
• Learning to Reweight with Deep Interactions [104.68509759134878]
  We propose an improved data reweighting algorithm, in which the student model provides its internal states to the teacher model. Experiments on image classification with clean/noisy labels and neural machine translation empirically demonstrate that our algorithm makes significant improvement over previous methods.
  arXiv  Detail & Related papers  (2020-07-09T09:06:31Z)
• A Framework for Behavioral Biometric Authentication using Deep Metric Learning on Mobile Devices [17.905483523678964]
  We present a new framework to incorporate training on battery-powered mobile devices, so private data never leaves the device and training can be flexibly scheduled to adapt the behavioral patterns at runtime. Experiments demonstrate authentication accuracy over 95% on three public datasets, a sheer 15% gain from multi-class classification with less data and robustness against brute-force and side-channel attacks with 99% and 90% success, respectively. Our results indicate that training consumes lower energy than watching videos and slightly higher energy than playing games.
  arXiv  Detail & Related papers  (2020-05-26T17:56:20Z)
• Incremental Real-Time Personalization in Human Activity Recognition Using Domain Adaptive Batch Normalization [1.160208922584163]
  Human Activity Recognition (HAR) from devices like smartphone accelerometers is a fundamental problem in ubiquitous computing. Previous work has addressed this challenge by personalizing general recognition models to the unique motion pattern of a new user in a static batch setting. Our work addresses all of these challenges by proposing an unsupervised online domain adaptation algorithm.
  arXiv  Detail & Related papers  (2020-05-25T15:49:10Z)
• Omni-supervised Facial Expression Recognition via Distilled Data [120.11782405714234]
  We propose omni-supervised learning to exploit reliable samples in a large amount of unlabeled data for network training. We experimentally verify that the new dataset can significantly improve the ability of the learned FER model. To tackle this, we propose to apply a dataset distillation strategy to compress the created dataset into several informative class-wise images.
  arXiv  Detail & Related papers  (2020-05-18T09:36:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.