Voice Analysis for Stress Detection and Application in Virtual Reality to Improve Public Speaking in Real-time: A Review

• URL: http://arxiv.org/abs/2208.01041v1
• Date: Mon, 1 Aug 2022 03:51:43 GMT
• Title: Voice Analysis for Stress Detection and Application in Virtual Reality to Improve Public Speaking in Real-time: A Review
• Abstract summary: Stress during public speaking is common and adversely affects performance and self-confidence. In this paper, we propose a stress detection computational algorithmic model that could be integrated into a Virtual Reality (VR) application. The developed model will be able to detect excessive stress in real time by analysing voice features correlated to physiological parameters indicative of stress.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Stress during public speaking is common and adversely affects performance and self-confidence. Extensive research has been carried out to develop various models to recognize emotional states. However, minimal research has been conducted to detect stress during public speaking in real time using voice analysis. In this context, the current review showed that the application of algorithms was not properly explored and helped identify the main obstacles in creating a suitable testing environment while accounting for current complexities and limitations. In this paper, we present our main idea and propose a stress detection computational algorithmic model that could be integrated into a Virtual Reality (VR) application to create an intelligent virtual audience for improving public speaking skills. The developed model, when integrated with VR, will be able to detect excessive stress in real time by analysing voice features correlated to physiological parameters indicative of stress and help users gradually control excessive stress and improve public speaking performance

Related papers

• Automatic Detection of Stress from Speech in the Trier Social Stress Test [12.593761734231883]
  This study investigates the automatic differentiation between a stressful and non-stressful situation, and the prediction of physiological and affective stress responses.<n>With a processing pipeline that included speaker diarization and machine learning models, we achieved stress detection performance significantly above a mean baseline.
  arXiv  Detail & Related papers  (2026-07-01T14:21:53Z)
• Dual-Model Prediction of Affective Engagement and Vocal Attractiveness from Speaker Expressiveness in Video Learning [1.338174941551702]
  This paper outlines a machine learning-enabled speaker-centric Emotion AI approach capable of predicting audience-affective engagement and vocal attractiveness.<n>Inspired by the demand for scalable, privacy-preserving affective computing applications, this speaker-centric Emotion AI approach incorporates two distinct regression models.
  arXiv  Detail & Related papers  (2026-03-19T11:09:58Z)
• The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning [76.96796481909581]
  Internal cognitive processing is instrumental in formulating high-quality responses.<n>We propose a novel method named FLAIR that conducts latent thinking simultaneously with speech perception.<n>Our approach aligns seamlessly with spoken dialogue systems.
  arXiv  Detail & Related papers  (2026-03-18T15:30:29Z)
• Chronological Thinking in Full-Duplex Spoken Dialogue Language Models [66.84843878538207]
  Chronological Thinking aims to improve response quality in full SDLMs.<n>No additional latency: once the user stops speaking, the agent halts thinking and begins speaking without further delay.<n>Results: Experiments demonstrate the effectiveness of chronological thinking through both objective metrics and human evaluations.
  arXiv  Detail & Related papers  (2025-10-02T10:28:11Z)
• Dynamic Stress Detection: A Study of Temporal Progression Modelling of Stress in Speech [1.3320917259299652]
  We model stress as a temporally evolving phenomenon influenced by historical emotional state.<n>We propose a dynamic labelling strategy that fine-grained stress annotations from emotional labels.<n>Our approach achieves notable accuracy gains on MuSE and StressID over existing baselines.
  arXiv  Detail & Related papers  (2025-10-02T06:30:44Z)
• Audio Driven Real-Time Facial Animation for Social Telepresence [65.66220599734338]
  We present an audio-driven real-time system for animating photorealistic 3D facial avatars with minimal latency.<n>Central to our approach is an encoder model that transforms audio signals into latent facial expression sequences in real time.<n>We capture the rich spectrum of facial expressions necessary for natural communication while achieving real-time performance.
  arXiv  Detail & Related papers  (2025-10-01T17:57:05Z)
• Advancing Hearing Assessment: An ASR-Based Frequency-Specific Speech Test for Diagnosing Presbycusis [0.0]
  Traditional audiometry fails to fully characterize the functional impact of hearing loss on speech understanding.<n>This paper presents the development and simulated evaluation of a novel Automatic Speech Recognition (ASR)-based frequency-specific speech test.
  arXiv  Detail & Related papers  (2025-05-28T11:06:22Z)
• Predictive Speech Recognition and End-of-Utterance Detection Towards Spoken Dialog Systems [55.99999020778169]
  We study a function that can predict the forthcoming words and estimate the time remaining until the end of an utterance. We develop a cross-attention-based algorithm that incorporates both acoustic and linguistic information. Results demonstrate the proposed model's ability to predict upcoming words and estimate future EOU events up to 300ms prior to the actual EOU.
  arXiv  Detail & Related papers  (2024-09-30T06:29:58Z)
• StressPrompt: Does Stress Impact Large Language Models and Human Performance Similarly? [7.573284169975824]
  This study explores whether Large Language Models (LLMs) exhibit stress responses similar to those of humans. We developed a novel set of prompts, termed StressPrompt, designed to induce varying levels of stress. The findings suggest that LLMs, like humans, perform optimally under moderate stress, consistent with the Yerkes-Dodson law.
  arXiv  Detail & Related papers  (2024-09-14T08:32:31Z)
• Stress Management Using Virtual Reality-Based Attention Training [3.686808512438363]
  We show that VR-based attention training consistently resulted in reducing the number of recognized stress instances in the recorded EEG signals. This research gives preliminary insights on adopting VR-based attention training for managing stress.
  arXiv  Detail & Related papers  (2023-12-10T22:42:00Z)
• Speaker Embeddings as Individuality Proxy for Voice Stress Detection [14.332772222772668]
  Since the mental states of the speaker modulate speech, stress introduced by cognitive or physical loads could be detected in the voice. The existing voice stress detection benchmark has shown that the audio embeddings extracted from the Hybrid BYOL-S self-supervised model perform well. This paper presents the design and development of voice stress detection, trained on more than 100 speakers from 9 language groups and five different types of stress.
  arXiv  Detail & Related papers  (2023-06-09T14:11:07Z)
• Deepfake audio detection by speaker verification [79.99653758293277]
  We propose a new detection approach that leverages only the biometric characteristics of the speaker, with no reference to specific manipulations. The proposed approach can be implemented based on off-the-shelf speaker verification tools. We test several such solutions on three popular test sets, obtaining good performance, high generalization ability, and high robustness to audio impairment.
  arXiv  Detail & Related papers  (2022-09-28T13:46:29Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Hybrid Handcrafted and Learnable Audio Representation for Analysis of Speech Under Cognitive and Physical Load [17.394964035035866]
  We introduce a set of five datasets for task load detection in speech. The voice recordings were collected as either cognitive or physical stress was induced in the cohort of volunteers. We used the datasets to design and evaluate a novel self-supervised audio representation.
  arXiv  Detail & Related papers  (2022-03-30T19:43:21Z)
• Autonomous Reinforcement Learning: Formalism and Benchmarking [106.25788536376007]
  Real-world embodied learning, such as that performed by humans and animals, is situated in a continual, non-episodic world. Common benchmark tasks in RL are episodic, with the environment resetting between trials to provide the agent with multiple attempts. This discrepancy presents a major challenge when attempting to take RL algorithms developed for episodic simulated environments and run them on real-world platforms.
  arXiv  Detail & Related papers  (2021-12-17T16:28:06Z)
• BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments [70.18430114842094]
  We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities in simulation. These activities are designed to be realistic, diverse, and complex. We include 500 human demonstrations in virtual reality (VR) to serve as the human ground truth.
  arXiv  Detail & Related papers  (2021-08-06T23:36:23Z)
• MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task [22.80682208862559]
  Stress and emotion are both human affective states, and stress has proven to have important implications on the regulation and expression of emotion. In this work, we investigate the value of emotion recognition as an auxiliary task to improve stress detection. We propose M -- a transformer-based model architecture and a novel multi-task learning algorithm with speed-based dynamic sampling strategy.
  arXiv  Detail & Related papers  (2021-05-17T20:24:46Z)
• Does Visual Self-Supervision Improve Learning of Speech Representations for Emotion Recognition? [63.564385139097624]
  This work investigates visual self-supervision via face reconstruction to guide the learning of audio representations. We show that a multi-task combination of the proposed visual and audio self-supervision is beneficial for learning richer features. We evaluate our learned audio representations for discrete emotion recognition, continuous affect recognition and automatic speech recognition.
  arXiv  Detail & Related papers  (2020-05-04T11:33:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.