Development, Deployment, and Evaluation of DyMand -- An Open-Source Smartwatch and Smartphone System for Capturing Couples' Dyadic Interactions in Chronic Disease Management in Daily Life

• URL: http://arxiv.org/abs/2205.07671v1
• Date: Mon, 16 May 2022 13:37:42 GMT
• Title: Development, Deployment, and Evaluation of DyMand -- An Open-Source Smartwatch and Smartphone System for Capturing Couples' Dyadic Interactions in Chronic Disease Management in Daily Life
• Authors: George Boateng, Prabhakaran Santhanam, Elgar Fleisch, Janina L\"uscher, Theresa Pauly, Urte Scholz, Tobias Kowatsch
• Abstract summary: DyMand is a novel open-source smartwatch and smartphone system for collecting data from couples based on partners' interaction moments. Our algorithm uses the Bluetooth signal strength between two smartwatches each worn by one partner, and a voice activity detection machine-learning algorithm to infer that the partners are interacting. Our system triggered 99.1% of the expected number of sensor and self-report data when the app was running, and 77.6% of algorithm-triggered recordings contained partners' conversation moments.
• Score: 4.269935075264936
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Dyadic interactions of couples are of interest as they provide insight into relationship quality and chronic disease management. Currently, ambulatory assessment of couples' interactions entails collecting data at random or scheduled times which could miss significant couples' interaction/conversation moments. In this work, we developed, deployed and evaluated DyMand, a novel open-source smartwatch and smartphone system for collecting self-report and sensor data from couples based on partners' interaction moments. Our smartwatch-based algorithm uses the Bluetooth signal strength between two smartwatches each worn by one partner, and a voice activity detection machine-learning algorithm to infer that the partners are interacting, and then to trigger data collection. We deployed the DyMand system in a 7-day field study and collected data about social support, emotional well-being, and health behavior from 13 (N=26) Swiss-based heterosexual couples managing diabetes mellitus type 2 of one partner. Our system triggered 99.1% of the expected number of sensor and self-report data when the app was running, and 77.6% of algorithm-triggered recordings contained partners' conversation moments compared to 43.8% for scheduled triggers. The usability evaluation showed that DyMand was easy to use. DyMand can be used by social, clinical, or health psychology researchers to understand the social dynamics of couples in everyday life, and for developing and delivering behavioral interventions for couples who are managing chronic diseases.

Related papers

• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• MedNgage: A Dataset for Understanding Engagement in Patient-Nurse Conversations [4.847266237348932]
  Patients who effectively manage their symptoms often demonstrate higher levels of engagement in conversations and interventions with healthcare practitioners. It is crucial for AI systems to understand the engagement in natural conversations between patients and practitioners to better contribute toward patient care. We present a novel dataset (MedNgage) which consists of patient-nurse conversations about cancer symptom management.
  arXiv  Detail & Related papers  (2023-05-31T16:06:07Z)
• CDANs: Temporal Causal Discovery from Autocorrelated and Non-Stationary Time Series Data [5.130175508025212]
  Causal discovery holds the potential to play a significant role in extracting actionable insights about human health. We present a novel constraint-based causal discovery approach for autocorrelated and non-stationary time series data. Our approach identifies lagged and instantaneous/contemporaneous causal relationships along with changing modules that vary over time.
  arXiv  Detail & Related papers  (2023-02-07T04:13:48Z)
• "Are you okay, honey?": Recognizing Emotions among Couples Managing Diabetes in Daily Life using Multimodal Real-World Smartwatch Data [8.355190969810305]
  Couples generally manage chronic diseases together and the management takes an emotional toll on both patients and their romantic partners. Recognizing the emotions of each partner in daily life could provide an insight into their emotional well-being in chronic disease management. We extracted physiological, movement, acoustic, and linguistic features, and trained machine learning models to recognize each partner's self-reported emotions.
  arXiv  Detail & Related papers  (2022-08-16T22:04:12Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Subgroup discovery of Parkinson's Disease by utilizing a multi-modal smart device system [63.20765930558542]
  We used smartwatches and smartphones to collect multi-modal data from 504 participants, including PD patients, DD and HC. We were able to show that by combining various modalities, classification accuracy improved and further PD clusters were discovered.
  arXiv  Detail & Related papers  (2022-05-12T08:59:57Z)
• Reducing a complex two-sided smartwatch examination for Parkinson's Disease to an efficient one-sided examination preserving machine learning accuracy [63.20765930558542]
  We have recorded participants performing technology-based assessments in a prospective study to research Parkinson's Disease (PD) This study provided the largest PD sample size of two-hand synchronous smartwatch measurements.
  arXiv  Detail & Related papers  (2022-05-11T09:12:59Z)
• Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data [74.60507696087966]
  Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is daily smartphone usage. We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
  arXiv  Detail & Related papers  (2021-06-24T17:46:03Z)
• MedSensor: Medication Adherence Monitoring Using Neural Networks on Smartwatch Accelerometer Sensor Data [0.0]
  Poor medication adherence presents serious economic and health problems. We developed a smartwatch application to collect the accelerometer hand gesture data from the smartwatch. We developed neural networks, then trained the networks on the sensor data to recognize medication and non-medication gestures.
  arXiv  Detail & Related papers  (2021-05-19T03:42:30Z)
• Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study [34.550824104906255]
  Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is from daily smartphone usage. We study behavioral markers or daily mood using a recent dataset of mobile behaviors from high-risk adolescent populations.
  arXiv  Detail & Related papers  (2020-12-04T01:44:22Z)
• Predicting Parkinson's Disease with Multimodal Irregularly Collected Longitudinal Smartphone Data [75.23250968928578]
  Parkinsons Disease is a neurological disorder and prevalent in elderly people. Traditional ways to diagnose the disease rely on in-person subjective clinical evaluations on the quality of a set of activity tests. We propose a novel time-series based approach to predicting Parkinson's Disease with raw activity test data collected by smartphones in the wild.
  arXiv  Detail & Related papers  (2020-09-25T01:50:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.