Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity

• URL: http://arxiv.org/abs/2306.00709v3
• Date: Wed, 4 Oct 2023 21:50:48 GMT
• Title: Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity
• Authors: Nathan Kammoun and Lakmal Meegahapola and Daniel Gatica-Perez
• Abstract summary: This study focuses on a dataset of approximately 24K self-reports on eating events provided by 678 college students in eight countries. Our analysis revealed that while some smartphone usage features during eating events were similar across countries, others exhibited unique trends in each country.
• Score: 5.764112063319108
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding the social context of eating is crucial for promoting healthy eating behaviors. Multimodal smartphone sensor data could provide valuable insights into eating behavior, particularly in mobile food diaries and mobile health apps. However, research on the social context of eating with smartphone sensor data is limited, despite extensive studies in nutrition and behavioral science. Moreover, the impact of country differences on the social context of eating, as measured by multimodal phone sensor data and self-reports, remains under-explored. To address this research gap, our study focuses on a dataset of approximately 24K self-reports on eating events provided by 678 college students in eight countries to investigate the country diversity that emerges from smartphone sensors during eating events for different social contexts (alone or with others). Our analysis revealed that while some smartphone usage features during eating events were similar across countries, others exhibited unique trends in each country. We further studied how user and country-specific factors impact social context inference by developing machine learning models with population-level (non-personalized) and hybrid (partially personalized) experimental setups. We showed that models based on the hybrid approach achieve AUC scores up to 0.75 with XGBoost models. These findings emphasize the importance of considering country differences in building and deploying machine learning models to minimize biases and improve generalization across different populations.

Related papers

• FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture [60.51749998013166]
  We introduce FoodieQA, a manually curated, fine-grained image-text dataset capturing the intricate features of food cultures across various regions in China. We evaluate vision-language Models (VLMs) and large language models (LLMs) on newly collected, unseen food images and corresponding questions. Our findings highlight that understanding food and its cultural implications remains a challenging and under-explored direction.
  arXiv  Detail & Related papers  (2024-06-16T17:59:32Z)
• Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future [59.78608958395464]
  We build a Social AI Data Infrastructure, which consists of a comprehensive social AI taxonomy and a data library of 480 NLP datasets. Our infrastructure allows us to analyze existing dataset efforts, and also evaluate language models' performance in different social intelligence aspects. We show there is a need for multifaceted datasets, increased diversity in language and culture, more long-tailed social situations, and more interactive data in future social intelligence data efforts.
  arXiv  Detail & Related papers  (2024-02-28T00:22:42Z)
• Learning About Social Context from Smartphone Data: Generalization Across Countries and Daily Life Moments [5.764112063319108]
  We used a novel, large-scale, and multimodal smartphone sensing dataset with over 216K self-reports collected from 581 young adults in five countries. Several sensors are informative of social context, that partially personalized multi-country models (trained and tested with data from all countries) and country-specific models (trained and tested within countries) can achieve similar performance above 90% AUC. These findings confirm the importance of the diversity of mobile data, to better understand social context inference models in different countries.
  arXiv  Detail & Related papers  (2023-06-01T17:20:56Z)
• Inferring Mood-While-Eating with Smartphone Sensing and Community-Based Model Personalization [4.245223529153532]
  Phone sensor data have been used to characterize both eating behavior and mood, independently, in the context of mobile food diaries and mobile health applications. Our results indicate that generic mood inference models decline in performance in certain contexts, such as when eating. To address these limitations, we employed a novel community-based approach for personalization by building models with data from a set of similar users to a target user.
  arXiv  Detail & Related papers  (2023-06-01T14:24:10Z)
• Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK [6.52702503779308]
  Smartphones enable understanding human behavior with activity recognition to support people's daily lives. People are more sedentary in the post-pandemic world with the prevalence of remote/hybrid work/study settings. We analyzed in-the-wild smartphone data and over 216K self-reports from 637 college students in five countries.
  arXiv  Detail & Related papers  (2023-02-16T21:34:55Z)
• Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countries [8.218081835111912]
  We collect a mobile sensing dataset with 329K self-reports from 678 participants in eight countries. We evaluate country-specific (trained and tested within a country), continent-specific (trained and tested within a continent), country-agnostic (tested on a country not seen on training data) and multi-country (trained and tested with multiple countries) approaches.
  arXiv  Detail & Related papers  (2022-11-06T02:26:52Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• The Second-Level Smartphone Divide: A Typology of Smartphone Usage Based on Frequency of Use, Skills, and Types of Activities [77.34726150561087]
  This paper examines inequalities in the usage of smartphone technology based on five samples of smartphone owners collected in Germany and Austria between 2016 and 2020. We identify six distinct types of smartphone users by conducting latent class analyses that classify individuals based on their frequency of smartphone use, self-rated smartphone skills, and activities carried out on their smartphone.
  arXiv  Detail & Related papers  (2021-11-09T13:38:59Z)
• Towards Building a Food Knowledge Graph for Internet of Food [66.57235827087092]
  We review the evolution of food knowledge organization, from food classification to food to food knowledge graphs. Food knowledge graphs play an important role in food search and Question Answering (QA), personalized dietary recommendation, food analysis and visualization. Future directions for food knowledge graphs cover several fields such as multimodal food knowledge graphs and food intelligence.
  arXiv  Detail & Related papers  (2021-07-13T06:26:53Z)
• Alone or With Others? Understanding Eating Episodes of College Students with Mobile Sensing [7.786904858719634]
  The social context of eating (alone, with friends, with family, with a partner, etc.) is an important self-reported feature that influences aspects such as food type, psychological state while eating, and the amount of food. In this work, we examine the relation between the social context of eating and passive sensing data from wearables and smartphones.
  arXiv  Detail & Related papers  (2020-11-23T19:45:55Z)
• ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network [50.7720194859196]
  We introduce the dataset ISIA Food- 500 with 500 categories from the list in the Wikipedia and 399,726 images. This dataset surpasses existing popular benchmark datasets by category coverage and data volume. We propose a stacked global-local attention network, which consists of two sub-networks for food recognition.
  arXiv  Detail & Related papers  (2020-08-13T02:48:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.