Leveraging LLMs to Predict Affective States via Smartphone Sensor Features
- URL: http://arxiv.org/abs/2407.08240v1
- Date: Thu, 11 Jul 2024 07:37:52 GMT
- Title: Leveraging LLMs to Predict Affective States via Smartphone Sensor Features
- Authors: Tianyi Zhang, Songyan Teng, Hong Jia, Simon D'Alfonso,
- Abstract summary: Digital phenotyping involves collecting and analysing data from personal digital devices to infer behaviours and mental health.
The emergence of large language models (LLMs) offers a new approach to make sense of smartphone sensing data.
Our study aims to bridge this gap by employing LLMs to predict affect outcomes based on smartphone sensing data from university students.
- Score: 6.1930355276269875
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As mental health issues for young adults present a pressing public health concern, daily digital mood monitoring for early detection has become an important prospect. An active research area, digital phenotyping, involves collecting and analysing data from personal digital devices such as smartphones (usage and sensors) and wearables to infer behaviours and mental health. Whilst this data is standardly analysed using statistical and machine learning approaches, the emergence of large language models (LLMs) offers a new approach to make sense of smartphone sensing data. Despite their effectiveness across various domains, LLMs remain relatively unexplored in digital mental health, particularly in integrating mobile sensor data. Our study aims to bridge this gap by employing LLMs to predict affect outcomes based on smartphone sensing data from university students. We demonstrate the efficacy of zero-shot and few-shot embedding LLMs in inferring general wellbeing. Our findings reveal that LLMs can make promising predictions of affect measures using solely smartphone sensing data. This research sheds light on the potential of LLMs for affective state prediction, emphasizing the intricate link between smartphone behavioral patterns and affective states. To our knowledge, this is the first work to leverage LLMs for affective state prediction and digital phenotyping tasks.
Related papers
- Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models [57.518784855080334]
Large Language Models (LLMs) have demonstrated exceptional task-solving capabilities, increasingly adopting roles akin to human-like assistants.
This paper presents a framework for investigating psychology dimension in LLMs, including psychological identification, assessment dataset curation, and assessment with results validation.
We introduce a comprehensive psychometrics benchmark for LLMs that covers six psychological dimensions: personality, values, emotion, theory of mind, motivation, and intelligence.
arXiv Detail & Related papers (2024-06-25T16:09:08Z) - Understanding Privacy Risks of Embeddings Induced by Large Language Models [75.96257812857554]
Large language models show early signs of artificial general intelligence but struggle with hallucinations.
One promising solution is to store external knowledge as embeddings, aiding LLMs in retrieval-augmented generation.
Recent studies experimentally showed that the original text can be partially reconstructed from text embeddings by pre-trained language models.
arXiv Detail & Related papers (2024-04-25T13:10:48Z) - Personality Trait Inference Via Mobile Phone Sensors: A Machine Learning
Approach [0.0]
This study provides evidence that personality can be reliably predicted from activity data collected through mobile phone sensors.
We were able to predict users' personality up to a 0.78 F1 score on a two class problem.
We show how a combination of rich behavioral data obtained with smartphone sensing and the use of machine learning techniques can help to advance personality research.
arXiv Detail & Related papers (2024-01-18T13:18:51Z) - A Survey on Detection of LLMs-Generated Content [97.87912800179531]
The ability to detect LLMs-generated content has become of paramount importance.
We aim to provide a detailed overview of existing detection strategies and benchmarks.
We also posit the necessity for a multi-faceted approach to defend against various attacks.
arXiv Detail & Related papers (2023-10-24T09:10:26Z) - Redefining Digital Health Interfaces with Large Language Models [69.02059202720073]
Large Language Models (LLMs) have emerged as general-purpose models with the ability to process complex information.
We show how LLMs can provide a novel interface between clinicians and digital technologies.
We develop a new prognostic tool using automated machine learning.
arXiv Detail & Related papers (2023-10-05T14:18:40Z) - Care for the Mind Amid Chronic Diseases: An Interpretable AI Approach
Using IoT [3.2054478691773363]
Existing health sensing studies primarily focus on the prediction of physical chronic diseases.
Depression, a widespread complication of chronic diseases, is however understudied.
We develop an interpretable deep learning model: Temporal Prototype Network (TempPNet)
Patients, doctors, and caregivers can deploy our model on mobile devices to monitor patients' depression risks in real-time.
arXiv Detail & Related papers (2022-11-08T19:09:39Z) - Objective Prediction of Tomorrow's Affect Using Multi-Modal
Physiological Data and Personal Chronicles: A Study of Monitoring College
Student Well-being in 2020 [0.0]
The goal of our study was to investigate the capacity to more accurately predict affect through a fully automatic and objective approach using multiple commercial devices.
Longitudinal physiological data and daily assessments of emotions were collected from a sample of college students using smart wearables and phones for over a year.
Results showed that our model was able to predict next-day affect with accuracy comparable to state of the art methods.
arXiv Detail & Related papers (2022-01-26T23:06:20Z) - Learning Language and Multimodal Privacy-Preserving Markers of Mood from
Mobile Data [74.60507696087966]
Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care.
One promising data source to help monitor human behavior is daily smartphone usage.
We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
arXiv Detail & Related papers (2021-06-24T17:46:03Z) - Interpretable Deep Learning for the Remote Characterisation of
Ambulation in Multiple Sclerosis using Smartphones [3.5547766520356547]
Deep convolutional neural networks (DCNN) applied to smartphone inertial sensor data were shown to better distinguish healthy from MS participant ambulation.
A transfer learning (TL) model from similar large open-source datasets was proposed.
A lack of transparency of "black-box" deep networks remains one of the largest stumbling blocks to the wider acceptance of deep learning for clinical applications.
arXiv Detail & Related papers (2021-03-16T16:15:49Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.