Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognition

• URL: http://arxiv.org/abs/2503.14513v1
• Date: Tue, 11 Mar 2025 13:16:30 GMT
• Title: Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognition
• Authors: Seyed Muhammad Hossein Mousavi,
• Abstract summary: This research introduces a novel application of the Neural Gas Network (NGN) algorithm for synthesizing body motion data.<n>By learning skeletal structure topology, the NGN fits the neurons or gas particles on body joints.<n>By attaching body postures over frames, the final synthetic body motion appears.
• Score: 0.9790236766474201
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In the domain of emotion recognition using body motion, the primary challenge lies in the scarcity of diverse and generalizable datasets. Automatic emotion recognition uses machine learning and artificial intelligence techniques to recognize a person's emotional state from various data types, such as text, images, sound, and body motion. Body motion poses unique challenges as many factors, such as age, gender, ethnicity, personality, and illness, affect its appearance, leading to a lack of diverse and robust datasets specifically for emotion recognition. To address this, employing Synthetic Data Generation (SDG) methods, such as Generative Adversarial Networks (GANs) and Variational Auto Encoders (VAEs), offers potential solutions, though these methods are often complex. This research introduces a novel application of the Neural Gas Network (NGN) algorithm for synthesizing body motion data and optimizing diversity and generation speed. By learning skeletal structure topology, the NGN fits the neurons or gas particles on body joints. Generated gas particles, which form the skeletal structure later on, will be used to synthesize the new body posture. By attaching body postures over frames, the final synthetic body motion appears. We compared our generated dataset against others generated by GANs, VAEs, and another benchmark algorithm, using benchmark metrics such as Fr\'echet Inception Distance (FID), Diversity, and a few more. Furthermore, we continued evaluation using classification metrics such as accuracy, precision, recall, and a few others. Joint-related features or kinematic parameters were extracted, and the system assessed model performance against unseen data. Our findings demonstrate that the NGN algorithm produces more realistic and emotionally distinct body motion data and does so with more synthesizing speed than existing methods.

Related papers

• Synthetic Data Generation by Supervised Neural Gas Network for Physiological Emotion Recognition Data [0.0]
  This study introduces an innovative approach to synthetic data generation using a Supervised Neural Gas (SNG) network.<n>The SNG efficiently processes the input data, creating synthetic instances that closely mimic the original data distributions.
  arXiv  Detail & Related papers  (2025-01-19T15:34:05Z)
• Exploring the Impact of Synthetic Data on Human Gesture Recognition Tasks Using GANs [0.0]
  This study is the first to explore the feasibility of synthesizing motion gestures for allergic rhinitis from wearable IoT device data using Generative Adversarial Networks (GANs)<n>We also focus on these AI models' performance in terms of fidelity, diversity, and privacy.
  arXiv  Detail & Related papers  (2024-12-09T11:15:47Z)
• Scaling Up Dynamic Human-Scene Interaction Modeling [58.032368564071895]
  TRUMANS is the most comprehensive motion-captured HSI dataset currently available. It intricately captures whole-body human motions and part-level object dynamics. We devise a diffusion-based autoregressive model that efficiently generates HSI sequences of any length.
  arXiv  Detail & Related papers  (2024-03-13T15:45:04Z)
• DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models [102.13968267347553]
  We present DiffuseBot, a physics-augmented diffusion model that generates soft robot morphologies capable of excelling in a wide spectrum of tasks. We showcase a range of simulated and fabricated robots along with their capabilities.
  arXiv  Detail & Related papers  (2023-11-28T18:58:48Z)
• Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances [76.34037366117234]
  We introduce a new dataset called Robot Control Gestures (RoCoG-v2) The dataset is composed of both real and synthetic videos from seven gesture classes. We present results using state-of-the-art action recognition and domain adaptation algorithms.
  arXiv  Detail & Related papers  (2023-03-17T23:23:55Z)
• Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps [100.72245315180433]
  We present a reconfigurable data glove design to capture different modes of human hand-object interactions. The glove operates in three modes for various downstream tasks with distinct features. We evaluate the system's three modes by (i) recording hand gestures and associated forces, (ii) improving manipulation fluency in VR, and (iii) producing realistic simulation effects of various tool uses.
  arXiv  Detail & Related papers  (2023-01-14T05:35:50Z)
• Graph Neural Networks with Trainable Adjacency Matrices for Fault Diagnosis on Multivariate Sensor Data [69.25738064847175]
  It is necessary to consider the behavior of the signals in each sensor separately, to take into account their correlation and hidden relationships with each other. The graph nodes can be represented as data from the different sensors, and the edges can display the influence of these data on each other. It was proposed to construct a graph during the training of graph neural network. This allows to train models on data where the dependencies between the sensors are not known in advance.
  arXiv  Detail & Related papers  (2022-10-20T11:03:21Z)
• Generative Adversarial Graph Convolutional Networks for Human Action Synthesis [3.0664963196464448]
  We propose Kinetic-GAN, a novel architecture to synthesise the kinetics of the human body. The proposed adversarial architecture can condition up to 120 different actions over local and global body movements. Our experiments were carried out in three well-known datasets.
  arXiv  Detail & Related papers  (2021-10-21T15:01:32Z)
• Object recognition for robotics from tactile time series data utilising different neural network architectures [0.0]
  This paper investigates the use of Convolutional Neural Networks (CNN) and Long-Short Term Memory (LSTM) neural network architectures for object classification on tactile data. We compare these methods using data from two different fingertip sensors (namely the BioTac SP and WTS-FT) in the same physical setup. The results show that the proposed method improves the maximum accuracy from 82.4% (BioTac SP fingertips) and 90.7% (WTS-FT fingertips) with complete time-series data to about 94% for both sensor types.
  arXiv  Detail & Related papers  (2021-09-09T22:05:45Z)
• Synthesizing Skeletal Motion and Physiological Signals as a Function of a Virtual Human's Actions and Emotions [10.59409233835301]
  We develop for the first time a system consisting of computational models for synchronously skeletal motion, electrocardiogram, blood pressure, respiration, and skin conductance signals. The proposed framework is modular and allows the flexibility to experiment with different models. In addition to facilitating ML research for round-the-clock monitoring at a reduced cost, the proposed framework will allow reusability of code and data.
  arXiv  Detail & Related papers  (2021-02-08T21:56:15Z)
• Learning to Simulate Complex Physics with Graph Networks [68.43901833812448]
  We present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains. Our framework---which we term "Graph Network-based Simulators" (GNS)--represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time.
  arXiv  Detail & Related papers  (2020-02-21T16:44:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.