Improved Static Hand Gesture Classification on Deep Convolutional Neural Networks using Novel Sterile Training Technique

• URL: http://arxiv.org/abs/2305.02039v1
• Date: Wed, 3 May 2023 11:10:50 GMT
• Title: Improved Static Hand Gesture Classification on Deep Convolutional Neural Networks using Novel Sterile Training Technique
• Authors: Josiah Smith, Shiva Thiagarajan, Richard Willis, Yiorgos Makris, Murat Torlak
• Abstract summary: Non-contact hand pose and static gesture recognition have received considerable attention in many applications. This article presents an efficient data collection approach and a novel technique for deep CNN training by introducing sterile'' images. Applying the proposed data collection and training methods yields an increase in classification rate of static hand gestures from $85%$ to $93%$.
• Score: 2.534406146337704
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we investigate novel data collection and training techniques towards improving classification accuracy of non-moving (static) hand gestures using a convolutional neural network (CNN) and frequency-modulated-continuous-wave (FMCW) millimeter-wave (mmWave) radars. Recently, non-contact hand pose and static gesture recognition have received considerable attention in many applications ranging from human-computer interaction (HCI), augmented/virtual reality (AR/VR), and even therapeutic range of motion for medical applications. While most current solutions rely on optical or depth cameras, these methods require ideal lighting and temperature conditions. mmWave radar devices have recently emerged as a promising alternative offering low-cost system-on-chip sensors whose output signals contain precise spatial information even in non-ideal imaging conditions. Additionally, deep convolutional neural networks have been employed extensively in image recognition by learning both feature extraction and classification simultaneously. However, little work has been done towards static gesture recognition using mmWave radars and CNNs due to the difficulty involved in extracting meaningful features from the radar return signal, and the results are inferior compared with dynamic gesture classification. This article presents an efficient data collection approach and a novel technique for deep CNN training by introducing ``sterile'' images which aid in distinguishing distinct features among the static gestures and subsequently improve the classification accuracy. Applying the proposed data collection and training methods yields an increase in classification rate of static hand gestures from $85\%$ to $93\%$ and $90\%$ to $95\%$ for range and range-angle profiles, respectively.

Related papers

• Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data [4.392337343771302]
  We propose a system that fuses already processed multi-sensor data into a new Deep Neural Network to increase its classification accuracy towards UAV detection. The model fuses high-level features extracted from individual object detection and classification models associated with thermal, optronic, and radar data.
  arXiv  Detail & Related papers  (2024-10-21T15:12:37Z)
• Radar-Based Recognition of Static Hand Gestures in American Sign Language [17.021656590925005]
  This study explores the efficacy of synthetic data generated by an advanced radar ray-tracing simulator. The simulator employs an intuitive material model that can be adjusted to introduce data diversity. Despite exclusively training the NN on synthetic data, it demonstrates promising performance when put to the test with real measurement data.
  arXiv  Detail & Related papers  (2024-02-20T08:19:30Z)
• Real-Time Model-Based Quantitative Ultrasound and Radar [65.268245109828]
  We propose a neural network based on the physical model of wave propagation, which defines the relationship between the received signals and physical properties. Our network can reconstruct multiple physical properties in less than one second for complex and realistic scenarios.
  arXiv  Detail & Related papers  (2024-02-16T09:09:16Z)
• Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
  We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions. We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training. Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T02:27:02Z)
• Histogram Layer Time Delay Neural Networks for Passive Sonar Classification [58.720142291102135]
  A novel method combines a time delay neural network and histogram layer to incorporate statistical contexts for improved feature learning and underwater acoustic target classification. The proposed method outperforms the baseline model, demonstrating the utility in incorporating statistical contexts for passive sonar target recognition.
  arXiv  Detail & Related papers  (2023-07-25T19:47:26Z)
• Novel Hybrid-Learning Algorithms for Improved Millimeter-Wave Imaging Systems [0.0]
  This dissertation introduces novel hybrid-learning algorithms for improved mmWave imaging systems. Various problem spaces are explored, including static and dynamic gesture classification. High-resolution near-field mmWave imaging using forward synthetic aperture radar (SAR); SAR under irregular scanning geometries.
  arXiv  Detail & Related papers  (2023-06-27T09:51:20Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• Agile gesture recognition for capacitive sensing devices: adapting on-the-job [55.40855017016652]
  We demonstrate a hand gesture recognition system that uses signals from capacitive sensors embedded into the etee hand controller. The controller generates real-time signals from each of the wearer five fingers. We use a machine learning technique to analyse the time series signals and identify three features that can represent 5 fingers within 500 ms.
  arXiv  Detail & Related papers  (2023-05-12T17:24:02Z)
• Neural Architectural Nonlinear Pre-Processing for mmWave Radar-based Human Gesture Perception [10.826849062116748]
  This paper utilizes two deep learning models, U-Net and EfficientNet, to detect hand gestures and remove noise in a millimeter-wave (mmWave) radar image. A novel pre-processing approach to denoise images before entering the first deep learning model stage increases the accuracy of classification.
  arXiv  Detail & Related papers  (2022-11-07T12:42:13Z)
• Decision Forest Based EMG Signal Classification with Low Volume Dataset Augmented with Random Variance Gaussian Noise [51.76329821186873]
  We produce a model that can classify six different hand gestures with a limited number of samples that generalizes well to a wider audience. We appeal to a set of more elementary methods such as the use of random bounds on a signal, but desire to show the power these methods can carry in an online setting.
  arXiv  Detail & Related papers  (2022-06-29T23:22:18Z)
• Classification of Intra-Pulse Modulation of Radar Signals by Feature Fusion Based Convolutional Neural Networks [5.199765487172328]
  We propose a novel deep-learning based technique that automatically recognizes intra-pulse modulation types of radar signals. We show that the proposed FF-CNN technique outperforms the current state-of-the-art alternatives.
  arXiv  Detail & Related papers  (2022-05-19T20:18:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.