Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment

• URL: http://arxiv.org/abs/2605.27950v1
• Date: Wed, 27 May 2026 04:44:35 GMT
• Title: Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment
• Abstract summary: Self-report-based behavior change receptivity is sparse and delayed, limiting its practical use in continuous monitoring.<n>This study conducts a pilot investigation of inferring participants' self-reported behavior change receptivity from egocentric eating images collected by a wearable camera.<n>Preliminary experimental results show promising improvements over simple baseline models for behavior change receptivity indicators.
• Score: 15.613992770403739
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Accurately assessing dietary behavior change receptivity is essential for designing effective just-in-time adaptive interventions (JITAIs) that promote healthier eating habits. However, self-report-based assessment of behavior change receptivity is sparse and delayed, limiting its practical use in continuous monitoring. To explore whether passive sensing may help address this challenge, this study conducts a pilot investigation of inferring participants' self-reported behavior change receptivity from egocentric eating images collected by a wearable camera. We use pilot data obtained from free-living eating episodes using the Automatic Ingestion Monitor v2 (AIM-2). The data included egocentric image sequences captured during eating and paired with responses to questions assessing specific dimensions of behavior change receptivity (awareness, interaction capability, and motivation). To examine whether visual information contained any relevancy to these responses, we evaluated a transfer-learning-assisted framework that combines a pre-trained Contrastive Language-Image Pre-Training (CLIP) vision encoder with a lightweight transformer classifier. The model processes eating episode image sequences to extract potential semantic and temporal cues related to behavior change receptivity. Preliminary experimental results show promising improvements over simple baseline models for behavior change receptivity indicators. These early findings suggest that egocentric eating episode images may contain cues related to dietary behavior change receptivity, and warrant further investigation with larger and more comprehensive datasets.

Related papers

• World Models for Embodied Intelligence: From Plausible to Controllable to Actionable [100.13060753774657]
  World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interventions, and adapting when execution departs from expectations.<n>This raises a central question: which predictive capabilities improve behavior?<n>We introduce three progressively stronger capability levels: Plausible models preserve task-relevant temporal, geometric, or physical structure; Controllable models additionally predict how interventions alter that structure; and Actionable models translate predictions into measurable gains in planning, action, learning, evaluation, verification, recovery, or data selection.
  arXiv  Detail & Related papers  (2026-09-15T06:22:42Z)
• What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies [28.136436759581926]
  Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects are introduced.<n>We introduce distractor objects with controlled color and shape similarity and localize failures to picking and placement.<n>We find that distractor sensitivity is specific to both the type of visual similarity and the manipulation stage.
  arXiv  Detail & Related papers  (2026-09-04T17:27:35Z)
• Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent [58.90049897180927]
  We introduce an automated framework for detecting unintended reliance on visual features in vision models.<n>A self-reflective agent generates and tests hypotheses about visual attributes that a model may rely on.<n>We evaluate our approach on a novel benchmark of 130 models designed to exhibit diverse visual attribute dependencies.
  arXiv  Detail & Related papers  (2025-10-24T17:59:02Z)
• Visually grounded emotion regulation via diffusion models and user-driven reappraisal [0.0]
  We propose a novel, visually based augmentation of cognitive reappraisal by integrating large-scale text-to-image diffusion models into the emotional regulation process.<n>Specifically, we introduce a system in which users reinterpret emotionally negative images via spoken reappraisals.<n>This generative transformation visually instantiates users' reappraisals while maintaining structural similarity to the original stimuli, externalizing and reinforcing regulatory intent.
  arXiv  Detail & Related papers  (2025-07-14T23:28:59Z)
• An Active Inference Model of Covert and Overt Visual Attention [0.0]
  This paper introduces a model of covert and overt visual attention through the framework of active inference.<n>The model determines visual sensory precisions based on both current environmental beliefs and sensory input.
  arXiv  Detail & Related papers  (2025-05-06T09:26:00Z)
• Dietary Intake Estimation via Continuous 3D Reconstruction of Food [5.010690651107531]
  This study proposes an approach to accurately monitor ingest behaviours by leveraging 3D food models constructed from monocular 2D video.<n>Experiments with toy models and real food items demonstrate the approach's potential.
  arXiv  Detail & Related papers  (2025-05-01T15:35:42Z)
• NutritionVerse-Direct: Exploring Deep Neural Networks for Multitask Nutrition Prediction from Food Images [63.314702537010355]
  Self-reporting methods are often inaccurate and suffer from substantial bias. Recent work has explored using computer vision prediction systems to predict nutritional information from food images. This paper aims to enhance the efficacy of dietary intake estimation by leveraging various neural network architectures.
  arXiv  Detail & Related papers  (2024-05-13T14:56:55Z)
• Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
  Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable. Existing susceptibility studies heavily rely on self-reported beliefs. We propose a computational approach to model users' latent susceptibility levels.
  arXiv  Detail & Related papers  (2023-11-16T07:22:56Z)
• NutritionVerse: Empirical Study of Various Dietary Intake Estimation Approaches [59.38343165508926]
  Accurate dietary intake estimation is critical for informing policies and programs to support healthy eating. Recent work has focused on using computer vision and machine learning to automatically estimate dietary intake from food images. We introduce NutritionVerse- Synth, the first large-scale dataset of 84,984 synthetic 2D food images with associated dietary information. We also collect a real image dataset, NutritionVerse-Real, containing 889 images of 251 dishes to evaluate realism.
  arXiv  Detail & Related papers  (2023-09-14T13:29:41Z)
• Feature-Suppressed Contrast for Self-Supervised Food Pre-training [22.48308786497061]
  We propose Feature Suppressed Contrast (FeaSC) to reduce mutual information between views. FeaSC uses a response-aware scheme to localize salient features in an unsupervised manner. As a plug-and-play module, the proposed method consistently improves BYOL and SimSiam by 1.70% $sim$ 6.69% classification accuracy on four publicly available food recognition datasets.
  arXiv  Detail & Related papers  (2023-08-07T03:27:04Z)
• Self-Regulated Learning for Egocentric Video Activity Anticipation [147.9783215348252]
  Self-Regulated Learning (SRL) aims to regulate the intermediate representation consecutively to produce representation that emphasizes the novel information in the frame of the current time-stamp. SRL sharply outperforms existing state-of-the-art in most cases on two egocentric video datasets and two third-person video datasets.
  arXiv  Detail & Related papers  (2021-11-23T03:29:18Z)
• Eating Habits Discovery in Egocentric Photo-streams [9.436913961194671]
  We build a food-related behavioural pattern discovery model, which discloses nutritional routines from the activities performed throughout the days. Within this framework, we present a simple, but robust and fast novel classification pipeline. We show an application for the identification of food-related scenes when the camera eats in isolation.
  arXiv  Detail & Related papers  (2020-09-16T12:46:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.