Personalized Activity Recognition with Deep Triplet Embeddings

• URL: http://arxiv.org/abs/2001.05517v1
• Date: Wed, 15 Jan 2020 19:17:02 GMT
• Title: Personalized Activity Recognition with Deep Triplet Embeddings
• Authors: David M. Burns and Cari M. Whyne
• Abstract summary: We present an approach to personalized activity recognition based on deep embeddings derived from a fully convolutional neural network. We evaluate these methods on three publicly available inertial human activity recognition data sets.
• Score: 2.1320960069210475
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A significant challenge for a supervised learning approach to inertial human activity recognition is the heterogeneity of data between individual users, resulting in very poor performance of impersonal algorithms for some subjects. We present an approach to personalized activity recognition based on deep embeddings derived from a fully convolutional neural network. We experiment with both categorical cross entropy loss and triplet loss for training the embedding, and describe a novel triplet loss function based on subject triplets. We evaluate these methods on three publicly available inertial human activity recognition data sets (MHEALTH, WISDM, and SPAR) comparing classification accuracy, out-of-distribution activity detection, and embedding generalization to new activities. The novel subject triplet loss provides the best performance overall, and all personalized deep embeddings out-perform our baseline personalized engineered feature embedding and an impersonal fully convolutional neural network classifier.

Related papers

• Deep Adversarial Learning with Activity-Based User Discrimination Task for Human Activity Recognition [0.0]
  We present a new adversarial deep learning framework for the problem of human activity recognition. Our framework incorporates a novel activity-based discrimination task that addresses inter-person variability.
  arXiv  Detail & Related papers  (2024-10-01T11:58:33Z)
• Multi-threshold Deep Metric Learning for Facial Expression Recognition [60.26967776920412]
  We present the multi-threshold deep metric learning technique, which avoids the difficult threshold validation. We find that each threshold of the triplet loss intrinsically determines a distinctive distribution of inter-class variations. It makes the embedding layer, which is composed of a set of slices, a more informative and discriminative feature.
  arXiv  Detail & Related papers  (2024-06-24T08:27:31Z)
• AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation [55.179287851188036]
  We introduce a novel all-in-one-stage framework, AiOS, for expressive human pose and shape recovery without an additional human detection step. We first employ a human token to probe a human location in the image and encode global features for each instance. Then, we introduce a joint-related token to probe the human joint in the image and encoder a fine-grained local feature.
  arXiv  Detail & Related papers  (2024-03-26T17:59:23Z)
• CLAN: A Contrastive Learning based Novelty Detection Framework for Human Activity Recognition [3.0108863071498035]
  CLAN is a two-tower contrastive learning-based novelty detection framework for human activity recognition. It is tailored to challenges with human activity characteristics, including the significance of temporal and frequency features. Experiments on four real-world human activity datasets show that CLAN surpasses the best performance of existing novelty detection methods.
  arXiv  Detail & Related papers  (2024-01-17T03:57:36Z)
• Feature Decoupling-Recycling Network for Fast Interactive Segmentation [79.22497777645806]
  Recent interactive segmentation methods iteratively take source image, user guidance and previously predicted mask as the input. We propose the Feature Decoupling-Recycling Network (FDRN), which decouples the modeling components based on their intrinsic discrepancies.
  arXiv  Detail & Related papers  (2023-08-07T12:26:34Z)
• HAL3D: Hierarchical Active Learning for Fine-Grained 3D Part Labeling [16.74185233682209]
  We present the first active learning tool for fine-grained 3D part labeling. Our tool iteratively verifies or modifies part labels predicted by a deep neural network. Our human-in-the-loop approach, coined HAL3D, achieves 100% accuracy on any test set with pre-defined hierarchical part labels.
  arXiv  Detail & Related papers  (2023-01-25T08:40:34Z)
• Dataset Bias in Human Activity Recognition [57.91018542715725]
  This contribution statistically curates the training data to assess to what degree the physical characteristics of humans influence HAR performance. We evaluate the performance of a state-of-the-art convolutional neural network on two HAR datasets that vary in the sensors, activities, and recording for time-series HAR.
  arXiv  Detail & Related papers  (2023-01-19T12:33:50Z)
• Discriminative Attribution from Counterfactuals [64.94009515033984]
  We present a method for neural network interpretability by combining feature attribution with counterfactual explanations. We show that this method can be used to quantitatively evaluate the performance of feature attribution methods in an objective manner.
  arXiv  Detail & Related papers  (2021-09-28T00:53:34Z)
• Attribute-Guided Adversarial Training for Robustness to Natural Perturbations [64.35805267250682]
  We propose an adversarial training approach which learns to generate new samples so as to maximize exposure of the classifier to the attributes-space. Our approach enables deep neural networks to be robust against a wide range of naturally occurring perturbations.
  arXiv  Detail & Related papers  (2020-12-03T10:17:30Z)
• Generic Semi-Supervised Adversarial Subject Translation for Sensor-Based Human Activity Recognition [6.2997667081978825]
  This paper presents a novel generic and robust approach for semi-supervised domain adaptation in Human Activity Recognition. It capitalizes on the advantages of the adversarial framework to tackle the shortcomings, by leveraging knowledge from annotated samples exclusively from the source subject and unlabeled ones of the target subject. The results demonstrate the effectiveness of our proposed algorithms over state-of-the-art methods, which led in up to 13%, 4%, and 13% improvement of our high-level activities recognition metrics for Opportunity, LISSI, and PAMAP2 datasets.
  arXiv  Detail & Related papers  (2020-11-11T12:16:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.