A Multimodal Approach Combining Biometrics and Self-Report Instruments for Monitoring Stress in Programming: Methodological Insights

• URL: http://arxiv.org/abs/2507.02118v2
• Date: Sat, 05 Jul 2025 14:33:57 GMT
• Title: A Multimodal Approach Combining Biometrics and Self-Report Instruments for Monitoring Stress in Programming: Methodological Insights
• Authors: Cristina Martinez Montes, Daniela Grassi, Nicole Novielli, Birgit Penzenstadler,
• Abstract summary: The study of well-being, stress and other human factors has traditionally relied on self-report instruments to assess key variables.<n>We aimed to (i) compare psychometric stress measures and biometric indicators and (ii) identify stress-related patterns in biometric data during software engineering tasks.
• Score: 5.512504195291804
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The study of well-being, stress and other human factors has traditionally relied on self-report instruments to assess key variables. However, concerns about potential biases in these instruments, even when thoroughly validated and standardised, have driven growing interest in alternatives in combining these measures with more objective methods, such as physiological measures. We aimed to (i) compare psychometric stress measures and biometric indicators and (ii) identify stress-related patterns in biometric data during software engineering tasks. We conducted an experiment where participants completed a pre-survey, then programmed two tasks wearing biometric sensors, answered brief post-surveys for each, and finally went through a short exit interview. Our results showed diverse outcomes; we found no stress in the psychometric instruments. Participants in the interviews reported a mix of feeling no stress and experiencing time pressure. Finally, the biometrics showed a significant difference only in EDA phasic peaks. We conclude that our chosen way of inducing stress by imposing a stricter time limit was insufficient. We offer methodological insights for future studies working with stress, biometrics, and psychometric instruments.

Related papers

• Causal Representation Learning from Multimodal Biomedical Observations [57.00712157758845]
  We develop flexible identification conditions for multimodal data and principled methods to facilitate the understanding of biomedical datasets.<n>Key theoretical contribution is the structural sparsity of causal connections between modalities.<n>Results on a real-world human phenotype dataset are consistent with established biomedical research.
  arXiv  Detail & Related papers  (2024-11-10T16:40:27Z)
• Computational Analysis of Stress, Depression and Engagement in Mental Health: A Survey [62.31381724639944]
  Stress and depression are interrelated and together they impact engagement in daily tasks.<n>This survey is the first to simultaneously explore computational methods for analyzing stress, depression and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• Simulation-based Inference for Cardiovascular Models [43.55219268578912]
  We use simulation-based inference to solve the inverse problem of mapping waveforms back to plausible physiological parameters.<n>We perform an in-silico uncertainty analysis of five biomarkers of clinical interest.<n>We study the gap between in-vivo and in-silico with the MIMIC-III waveform database.
  arXiv  Detail & Related papers  (2023-07-26T02:34:57Z)
• Employing Multimodal Machine Learning for Stress Detection [8.430502131775722]
  Mental wellness is one of the most neglected but crucial aspects of today's world. In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels.
  arXiv  Detail & Related papers  (2023-06-15T14:34:16Z)
• Multi-Channel Time-Series Person and Soft-Biometric Identification [65.83256210066787]
  This work investigates person and soft-biometrics identification from recordings of humans performing different activities using deep architectures. We evaluate the method on four datasets of multi-channel time-series human activity recognition (HAR) Soft-biometric based attribute representation shows promising results and emphasis the necessity of larger datasets.
  arXiv  Detail & Related papers  (2023-04-04T07:24:51Z)
• Pain level and pain-related behaviour classification using GRU-based sparsely-connected RNNs [61.080598804629375]
  People with chronic pain unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities. We proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
  arXiv  Detail & Related papers  (2022-12-20T12:56:28Z)
• Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation [63.05890836038913]
  We study the role of soft biometrics to enhance person recognition systems in unconstrained scenarios. We consider two assumptions: 1) manual estimation of soft biometrics and 2) automatic estimation from two commercial off-the-shelf systems. Experiments are carried out fusing soft biometrics with two state-of-the-art face recognition systems based on deep learning.
  arXiv  Detail & Related papers  (2022-10-24T11:29:57Z)
• Machine Learning for Stress Monitoring from Wearable Devices: A Systematic Literature Review [1.5293427903448025]
  The aim of this review is to provide an overview of the current state of stress detection and monitoring using wearable devices. The reviewed works were synthesized into three categories of publicly available stress datasets, machine learning, and future research directions.
  arXiv  Detail & Related papers  (2022-09-29T23:40:38Z)
• Insights on Modelling Physiological, Appraisal, and Affective Indicators of Stress using Audio Features [10.093374748790037]
  Utilising speech samples collected while the subject is undergoing an induced stress episode has recently shown promising results for the automatic characterisation of individual stress responses. We introduce new findings that shed light onto whether speech signals are suited to model physiological biomarkers.
  arXiv  Detail & Related papers  (2022-05-09T14:32:38Z)
• Evaluation of a User Authentication Schema Using Behavioral Biometrics and Machine Learning [0.0]
  This study contributes to the research being done on behavioral biometrics by creating and evaluating a user authentication scheme using behavioral biometrics. The behavioral biometrics used in this study include touch dynamics and phone movement. We evaluate the performance of different single-modal and multi-modal combinations of the two biometrics.
  arXiv  Detail & Related papers  (2022-05-07T05:16:34Z)
• Personalized Stress Monitoring using Wearable Sensors in Everyday Settings [9.621481727547215]
  We explore objective prediction of stress levels in everyday settings based on heart rate (HR) and heart rate variability (HRV) We present a layered system architecture for personalized stress monitoring that supports a tunable collection of data samples for labeling, and present a method for selecting informative samples from the stream of real-time data for labeling.
  arXiv  Detail & Related papers  (2021-07-31T04:15:15Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.