Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study

• URL: http://arxiv.org/abs/2012.02359v1
• Date: Fri, 4 Dec 2020 01:44:22 GMT
• Title: Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
• Authors: Terrance Liu, Paul Pu Liang, Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, Louis-Philippe Morency
• Abstract summary: Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is from daily smartphone usage. We study behavioral markers or daily mood using a recent dataset of mobile behaviors from high-risk adolescent populations.
• Score: 34.550824104906255
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications towards the early detection and intervention of mental health disorders. One promising data source to help monitor human behavior is from daily smartphone usage. However, care must be taken to summarize behaviors without identifying the user through personal (e.g., personally identifiable information) or protected attributes (e.g., race, gender). In this paper, we study behavioral markers or daily mood using a recent dataset of mobile behaviors from high-risk adolescent populations. Using computational models, we find that multimodal modeling of both text and app usage features is highly predictive of daily mood over each modality alone. Furthermore, we evaluate approaches that reliably obfuscate user identity while remaining predictive of daily mood. By combining multimodal representations with privacy-preserving learning, we are able to push forward the performance-privacy frontier as compared to unimodal approaches.

Related papers

• Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation [70.52558242336988]
  We focus on predicting engagement in dyadic interactions by scrutinizing verbal and non-verbal cues, aiming to detect signs of disinterest or confusion. In this work, we collect a dataset featuring 34 participants engaged in casual dyadic conversations, each providing self-reported engagement ratings at the end of each conversation. We introduce a novel fusion strategy using Large Language Models (LLMs) to integrate multiple behavior modalities into a multimodal transcript''
  arXiv  Detail & Related papers  (2024-09-13T18:28:12Z)
• Modeling User Preferences via Brain-Computer Interfacing [54.3727087164445]
  We use Brain-Computer Interfacing technology to infer users' preferences, their attentional correlates towards visual content, and their associations with affective experience. We link these to relevant applications, such as information retrieval, personalized steering of generative models, and crowdsourcing population estimates of affective experiences.
  arXiv  Detail & Related papers  (2024-05-15T20:41:46Z)
• Objective Prediction of Tomorrow's Affect Using Multi-Modal Physiological Data and Personal Chronicles: A Study of Monitoring College Student Well-being in 2020 [0.0]
  The goal of our study was to investigate the capacity to more accurately predict affect through a fully automatic and objective approach using multiple commercial devices. Longitudinal physiological data and daily assessments of emotions were collected from a sample of college students using smart wearables and phones for over a year. Results showed that our model was able to predict next-day affect with accuracy comparable to state of the art methods.
  arXiv  Detail & Related papers  (2022-01-26T23:06:20Z)
• Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection [7.263558963357268]
  Unpredictable ML model behavior on unseen data, especially in the health domain, raises serious concerns about its safety. We show that Mahalanobis distance- and Gram matrices-based out-of-distribution detection methods are able to detect out-of-distribution data with high accuracy. We then translate the out-of-distribution score into a human interpretable CONFIDENCE SCORE to investigate its effect on the users' interaction with health ML applications.
  arXiv  Detail & Related papers  (2021-10-26T20:49:01Z)
• Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data [74.60507696087966]
  Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is daily smartphone usage. We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
  arXiv  Detail & Related papers  (2021-06-24T17:46:03Z)
• Covert Embodied Choice: Decision-Making and the Limits of Privacy Under Biometric Surveillance [6.92628425870087]
  We present results from a virtual reality task in which gaze, movement, and other physiological signals are tracked. We find that while participants use a variety of strategies, data collected remains highly predictive of choice (80% accuracy). A significant portion of participants became more predictable despite efforts to obfuscate, possibly indicating mistaken priors about the dynamics of algorithmic prediction.
  arXiv  Detail & Related papers  (2021-01-04T04:45:22Z)
• Predicting Parkinson's Disease with Multimodal Irregularly Collected Longitudinal Smartphone Data [75.23250968928578]
  Parkinsons Disease is a neurological disorder and prevalent in elderly people. Traditional ways to diagnose the disease rely on in-person subjective clinical evaluations on the quality of a set of activity tests. We propose a novel time-series based approach to predicting Parkinson's Disease with raw activity test data collected by smartphones in the wild.
  arXiv  Detail & Related papers  (2020-09-25T01:50:15Z)
• Anxiety Detection Leveraging Mobile Passive Sensing [53.11661460916551]
  Anxiety disorders are the most common class of psychiatric problems affecting both children and adults. Leveraging passive and unobtrusive data collection from smartphones could be a viable alternative to classical methods. eWellness is an experimental mobile application designed to track a full-suite of sensor and user-log data off an individual's device in a continuous and passive manner.
  arXiv  Detail & Related papers  (2020-08-09T20:22:52Z)
• Jointly Predicting Job Performance, Personality, Cognitive Ability, Affect, and Well-Being [42.67003631848889]
  We create a benchmark for predictive analysis of individuals from a perspective that integrates physical and physiological behavior, psychological states and traits, and job performance. We design data mining techniques as benchmark and uses real noisy and incomplete data derived from wearable sensors to predict 19 constructs based on 12 standardized well-validated tests.
  arXiv  Detail & Related papers  (2020-06-10T14:30:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.