Online recognition of unsegmented actions with hierarchical SOM architecture

• URL: http://arxiv.org/abs/2104.11637v1
• Date: Fri, 23 Apr 2021 14:41:46 GMT
• Title: Online recognition of unsegmented actions with hierarchical SOM architecture
• Authors: Zahra Gharaee
• Abstract summary: A novel approach for recognizing unsegmented actions in online test experiments is proposed. The unique features of an action sequence are represented as a series of elicited key activations by the first-layer self-organizing map. The experiment results show that although the performance drops slightly in online experiments compared to the offline tests, the ability of the proposed architecture to deal with the unsegmented action sequences as well as the online performance makes the system more plausible and practical in real-case scenarios.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Automatic recognition of an online series of unsegmented actions requires a method for segmentation that determines when an action starts and when it ends. In this paper, a novel approach for recognizing unsegmented actions in online test experiments is proposed. The method uses self-organizing neural networks to build a three-layer cognitive architecture. The unique features of an action sequence are represented as a series of elicited key activations by the first-layer self-organizing map. An average length of a key activation vector is calculated for all action sequences in a training set and adjusted in learning trials to generate input patterns to the second-layer self-organizing map. The pattern vectors are clustered in the second layer, and the clusters are then labeled by an action identity in the third layer neural network. The experiment results show that although the performance drops slightly in online experiments compared to the offline tests, the ability of the proposed architecture to deal with the unsegmented action sequences as well as the online performance makes the system more plausible and practical in real-case scenarios.

Related papers

• Unsupervised 3D registration through optimization-guided cyclical self-training [71.75057371518093]
  State-of-the-art deep learning-based registration methods employ three different learning strategies. We propose a novel self-supervised learning paradigm for unsupervised registration, relying on self-training. We evaluate the method for abdomen and lung registration, consistently surpassing metric-based supervision and outperforming diverse state-of-the-art competitors.
  arXiv  Detail & Related papers  (2023-06-29T14:54:10Z)
• Dynamic Perceiver for Efficient Visual Recognition [87.08210214417309]
  We propose Dynamic Perceiver (Dyn-Perceiver) to decouple the feature extraction procedure and the early classification task. A feature branch serves to extract image features, while a classification branch processes a latent code assigned for classification tasks. Early exits are placed exclusively within the classification branch, thus eliminating the need for linear separability in low-level features.
  arXiv  Detail & Related papers  (2023-06-20T03:00:22Z)
• Unified Keypoint-based Action Recognition Framework via Structured Keypoint Pooling [3.255030588361124]
  This paper simultaneously addresses three limitations associated with conventional skeleton-based action recognition. A point cloud deep-learning paradigm is introduced to the action recognition. A novel deep neural network architecture called Structured Keypoint Pooling is proposed.
  arXiv  Detail & Related papers  (2023-03-27T14:59:08Z)
• Advancing 3D finger knuckle recognition via deep feature learning [51.871256510747465]
  Contactless 3D finger knuckle patterns have emerged as an effective biometric identifier due to its discriminativeness, visibility from a distance, and convenience. Recent research has developed a deep feature collaboration network which simultaneously incorporates intermediate features from deep neural networks with multiple scales. This paper advances this approach by investigating the possibility of learning a discriminative feature vector with the least possible dimension for representing 3D finger knuckle images.
  arXiv  Detail & Related papers  (2023-01-07T20:55:16Z)
• Unsupervised Dense Nuclei Detection and Segmentation with Prior Self-activation Map For Histology Images [5.3882963853819845]
  We propose a self-supervised learning based approach with a Prior Self-activation Module (PSM) PSM generates self-activation maps from the input images to avoid labeling costs and further produce pseudo masks for the downstream task. Compared with other fully-supervised and weakly-supervised methods, our method can achieve competitive performance without any manual annotations.
  arXiv  Detail & Related papers  (2022-10-14T14:34:26Z)
• Action in Mind: A Neural Network Approach to Action Recognition and Segmentation [0.0]
  This thesis presents a novel computational approach for human action recognition through different implementations of multi-layer architectures based on artificial neural networks. The proposed action recognition architecture is composed of several processing layers including a preprocessing layer, an ordered vector representation layer and three layers of neural networks. For each level of development the system is trained with the input data consisting of consecutive 3D body postures and tested with generalized input data that the system has never met before.
  arXiv  Detail & Related papers  (2021-04-30T09:53:28Z)
• Hierarchical growing grid networks for skeleton based action recognition [0.0]
  A novel cognitive architecture for action recognition is developed by applying layers of growing grid neural networks. The system is provided with a prior knowledge of the input space, which increases the processing speed of the learning phase. The performance of the growing grid architecture is com-pared with the results from a system based on Self-Organizing Maps.
  arXiv  Detail & Related papers  (2021-04-22T16:35:32Z)
• Online Recognition of Actions Involving Objects [0.0]
  We present an online system for real time recognition of actions involving objects working in online mode. The system merges two streams of information processing running in parallel. The presented method combines the two information processing streams to determine what action the agent performed and on what object.
  arXiv  Detail & Related papers  (2021-04-13T10:08:20Z)
• MetricUNet: Synergistic Image- and Voxel-Level Learning for Precise CT Prostate Segmentation via Online Sampling [66.01558025094333]
  We propose a two-stage framework, with the first stage to quickly localize the prostate region and the second stage to precisely segment the prostate. We introduce a novel online metric learning module through voxel-wise sampling in the multi-task network. Our method can effectively learn more representative voxel-level features compared with the conventional learning methods with cross-entropy or Dice loss.
  arXiv  Detail & Related papers  (2020-05-15T10:37:02Z)
• Progressive Graph Convolutional Networks for Semi-Supervised Node Classification [97.14064057840089]
  Graph convolutional networks have been successful in addressing graph-based tasks such as semi-supervised node classification. We propose a method to automatically build compact and task-specific graph convolutional networks.
  arXiv  Detail & Related papers  (2020-03-27T08:32:16Z)
• Unpaired Multi-modal Segmentation via Knowledge Distillation [77.39798870702174]
  We propose a novel learning scheme for unpaired cross-modality image segmentation. In our method, we heavily reuse network parameters, by sharing all convolutional kernels across CT and MRI. We have extensively validated our approach on two multi-class segmentation problems.
  arXiv  Detail & Related papers  (2020-01-06T20:03:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.