Inferring Mood-While-Eating with Smartphone Sensing and Community-Based Model Personalization

• URL: http://arxiv.org/abs/2306.00723v2
• Date: Sat, 9 Dec 2023 21:58:40 GMT
• Title: Inferring Mood-While-Eating with Smartphone Sensing and Community-Based Model Personalization
• Authors: Wageesha Bangamuarachchi and Anju Chamantha and Lakmal Meegahapola and Haeeun Kim and Salvador Ruiz-Correa and Indika Perera and Daniel Gatica-Perez
• Abstract summary: Phone sensor data have been used to characterize both eating behavior and mood, independently, in the context of mobile food diaries and mobile health applications. Our results indicate that generic mood inference models decline in performance in certain contexts, such as when eating. To address these limitations, we employed a novel community-based approach for personalization by building models with data from a set of similar users to a target user.
• Score: 4.245223529153532
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The interplay between mood and eating has been the subject of extensive research within the fields of nutrition and behavioral science, indicating a strong connection between the two. Further, phone sensor data have been used to characterize both eating behavior and mood, independently, in the context of mobile food diaries and mobile health applications. However, limitations within the current body of literature include: i) the lack of investigation around the generalization of mood inference models trained with passive sensor data from a range of everyday life situations, to specific contexts such as eating, ii) no prior studies that use sensor data to study the intersection of mood and eating, and iii) the inadequate examination of model personalization techniques within limited label settings, as we commonly experience in mood inference. In this study, we sought to examine everyday eating behavior and mood using two datasets of college students in Mexico (N_mex = 84, 1843 mood-while-eating reports) and eight countries (N_mul = 678, 329K mood reports incl. 24K mood-while-eating reports), containing both passive smartphone sensing and self-report data. Our results indicate that generic mood inference models decline in performance in certain contexts, such as when eating. Additionally, we found that population-level (non-personalized) and hybrid (partially personalized) modeling techniques were inadequate for the commonly used three-class mood inference task (positive, neutral, negative). Furthermore, we found that user-level modeling was challenging for the majority of participants due to a lack of sufficient labels and data from the negative class. To address these limitations, we employed a novel community-based approach for personalization by building models with data from a set of similar users to a target user.

Related papers

• Modeling User Preferences via Brain-Computer Interfacing [54.3727087164445]
  We use Brain-Computer Interfacing technology to infer users' preferences, their attentional correlates towards visual content, and their associations with affective experience. We link these to relevant applications, such as information retrieval, personalized steering of generative models, and crowdsourcing population estimates of affective experiences.
  arXiv  Detail & Related papers  (2024-05-15T20:41:46Z)
• Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
  Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable. Existing susceptibility studies heavily rely on self-reported beliefs. We propose a computational approach to model users' latent susceptibility levels.
  arXiv  Detail & Related papers  (2023-11-16T07:22:56Z)
• NutritionVerse: Empirical Study of Various Dietary Intake Estimation Approaches [59.38343165508926]
  Accurate dietary intake estimation is critical for informing policies and programs to support healthy eating. Recent work has focused on using computer vision and machine learning to automatically estimate dietary intake from food images. We introduce NutritionVerse- Synth, the first large-scale dataset of 84,984 synthetic 2D food images with associated dietary information. We also collect a real image dataset, NutritionVerse-Real, containing 889 images of 251 dishes to evaluate realism.
  arXiv  Detail & Related papers  (2023-09-14T13:29:41Z)
• Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity [5.764112063319108]
  This study focuses on a dataset of approximately 24K self-reports on eating events provided by 678 college students in eight countries. Our analysis revealed that while some smartphone usage features during eating events were similar across countries, others exhibited unique trends in each country.
  arXiv  Detail & Related papers  (2023-06-01T14:16:59Z)
• The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation [69.13075715686622]
  MuSe 2023 is a set of shared tasks addressing three different contemporary multimodal affect and sentiment analysis problems. MuSe 2023 seeks to bring together a broad audience from different research communities.
  arXiv  Detail & Related papers  (2023-05-05T08:53:57Z)
• Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countries [8.218081835111912]
  We collect a mobile sensing dataset with 329K self-reports from 678 participants in eight countries. We evaluate country-specific (trained and tested within a country), continent-specific (trained and tested within a continent), country-agnostic (tested on a country not seen on training data) and multi-country (trained and tested with multiple countries) approaches.
  arXiv  Detail & Related papers  (2022-11-06T02:26:52Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data [74.60507696087966]
  Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is daily smartphone usage. We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
  arXiv  Detail & Related papers  (2021-06-24T17:46:03Z)
• Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study [34.550824104906255]
  Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is from daily smartphone usage. We study behavioral markers or daily mood using a recent dataset of mobile behaviors from high-risk adolescent populations.
  arXiv  Detail & Related papers  (2020-12-04T01:44:22Z)
• Alone or With Others? Understanding Eating Episodes of College Students with Mobile Sensing [7.786904858719634]
  The social context of eating (alone, with friends, with family, with a partner, etc.) is an important self-reported feature that influences aspects such as food type, psychological state while eating, and the amount of food. In this work, we examine the relation between the social context of eating and passive sensing data from wearables and smartphones.
  arXiv  Detail & Related papers  (2020-11-23T19:45:55Z)
• Eating Habits Discovery in Egocentric Photo-streams [9.436913961194671]
  We build a food-related behavioural pattern discovery model, which discloses nutritional routines from the activities performed throughout the days. Within this framework, we present a simple, but robust and fast novel classification pipeline. We show an application for the identification of food-related scenes when the camera eats in isolation.
  arXiv  Detail & Related papers  (2020-09-16T12:46:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.