HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care

• URL: http://arxiv.org/abs/2609.06976v1
• Date: Mon, 07 Sep 2026 03:11:34 GMT
• Title: HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care
• Abstract summary: We introduce HealthLoopQA, a diagnostic benchmark for evaluating large language models (LLMs) over continuous diabetes monitoring data.<n>HealthLoopQA comprises 127 tasks and over 1,500 QA instances spanning process mining, anomaly detection, and prediction over 30-day horizons.<n>We complement real-world datasets with a fault-injected simulation testbed modeling diverse device malfunctions and cyber-physical attacks to generate physiologically plausible hazard scenarios.
• Score: 25.340084694880048
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: As medical wearables become integrated into daily chronic disease care, effectively interpreting longitudinal monitoring data is essential for patients and clinicians to understand health trends, detect safety-critical events, and make informed decisions. While large language models (LLMs) show promise for transforming this streaming physiological data into personalized health insights, evaluating their reasoning capability and analytical rigor in diverse monitoring tasks remains a fundamental challenge. Existing medical wearable question answering (QA) benchmarks primarily assess short-horizon classification or statistical summaries, largely ignoring the long-term patterns, therapeutic and behavioural contexts, and potential system failures inherent in real-world deployments. To address this, we introduce HealthLoopQA, a comprehensive diagnostic benchmark for evaluating LLM reasoning over continuous diabetes monitoring data. Grounded in a novel taxonomy of eleven atomic reasoning abilities, HealthLoopQA comprises 127 tasks and over 1,500 QA instances spanning process mining, anomaly detection, and prediction over 30-day horizons. To systematically evaluate safety awareness, we complement real-world datasets with a fault-injected simulation testbed modeling diverse device malfunctions and cyber-physical attacks to generate physiologically plausible hazard scenarios. Evaluating state-of-the-art LLMs across prompting and agentic frameworks reveals severe limitations in complex temporal pattern mining. Furthermore, we identify a broader phenomenon of In-context Laziness under long-context prompting, highlighting critical open challenges in deploying LLMs for rigorous long-horizon medical reasoning.

Related papers

• Towards a General Intelligence and Interface for Wearable Health Data [45.854819784803055]
  We propose a foundation model for wearable health that is pretrained on more than one trillion minutes of unlabeled sensor signals.<n>We find that this population scale representation unlocks label-efficient few-shot learning and generative capabilities for robust daily metric estimation.
  arXiv  Detail & Related papers  (2026-05-21T17:24:06Z)
• A Multi-Dimensional Clustering Approach for Identifying Inborn Errors of Immunity [40.41295591212923]
  Rare diseases such as inborn errors of immunity (IEI) require early diagnosis to prevent end organ damage and improve quality of life.<n>Development of machine learning (ML) algorithms in IEI for pattern recognition is limited.<n>This study refines IEI feature awareness, develops data tool kits for rare disease populations analysis, and expands on transforming complex medical records in data structures interpretable by unsupervised ML.
  arXiv  Detail & Related papers  (2026-05-16T03:29:36Z)
• VitalDiagnosis: AI-Driven Ecosystem for 24/7 Vital Monitoring and Chronic Disease Management [16.145016231691972]
  We introduce VitalDiagnosis, an ecosystem designed to shift chronic disease management from passive monitoring to proactive, interactive engagement.<n>By integrating continuous data from wearable devices with the reasoning capabilities of LLMs, the system addresses both acute health anomalies and routine adherence.<n>This approach aims to promote a more proactive and cooperative care paradigm, with the potential to enhance patient self-management and reduce avoidable clinical workload.
  arXiv  Detail & Related papers  (2026-01-22T09:31:19Z)
• Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models [48.95516224614331]
  We introduce MedGaze-Bench, the first benchmark leveraging clinician gaze as a Cognitive Cursor to assess intent understanding across surgery, emergency simulation, and diagnostic interpretation.<n>Our benchmark addresses three fundamental challenges: visual homogeneity of anatomical structures, strict temporal-causal dependencies in clinical, and implicit adherence to safety protocols.
  arXiv  Detail & Related papers  (2026-01-11T02:20:40Z)
• A Proposed Paradigm for Imputing Missing Multi-Sensor Data in the Healthcare Domain [1.0927928652289287]
  This study examines the limitations of existing datasets and emphasizes the temporal characteristics of key features relevant to hypoglycemia prediction.<n>A systematic paradigm is proposed, wherein imputation strategies are tailored to the nature of specific features and the duration of missing intervals.
  arXiv  Detail & Related papers  (2026-01-07T04:23:47Z)
• AURA: Development and Validation of an Augmented Unplanned Removal Alert System using Synthetic ICU Videos [1.8993428741072542]
  Unplanned extubation (UE) remains a critical patient safety concern in intensive care units (ICUs)<n>We propose Augmented Unplanned Removal Alert (AURA), a vision-based risk detection system developed and validated entirely on a fully synthetic video dataset.
  arXiv  Detail & Related papers  (2025-11-15T14:52:37Z)
• Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications [59.721265428780946]
  Large Language Models (LLMs) in medicine have enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning.<n>This paper provides the first systematic review of this emerging field.<n>We propose a taxonomy of reasoning enhancement techniques, categorized into training-time strategies and test-time mechanisms.
  arXiv  Detail & Related papers  (2025-08-01T14:41:31Z)
• Stress Monitoring in Healthcare: An Ensemble Machine Learning Framework Using Wearable Sensor Data [0.0]
  This study introduces a dataset comprising physiological signals, electrodermal activity, heart rate and skin temperature.<n>To overcome these challenges, the dataset underwent preprocessing with the Synthetic Minority Over sampling Technique (SMOTE)<n>Advanced machine learning models including Random Forest, XGBoost and a Multi-Layer Perceptron (MLP) were evaluated and combined into a Stacking to leverage their collective predictive strengths.
  arXiv  Detail & Related papers  (2025-07-10T09:47:56Z)
• A Vector-Quantized Foundation Model for Patient Behavior Monitoring [41.48188433408574]
  This paper introduces a novel foundation model based on a modified vector quantized variational autoencoder, specifically designed to process real-world data from smartphones and wearable devices.<n>We leveraged the discrete latent representation of this model to effectively perform two downstream tasks, suicide risk assessment and emotional state prediction, on different held-out clinical cohorts without the need of fine-tuning.
  arXiv  Detail & Related papers  (2025-03-19T14:01:16Z)
• Machine Learning Applications in Medical Prognostics: A Comprehensive Review [0.0]
  Machine learning (ML) has revolutionized medical prognostics by integrating advanced algorithms with clinical data. RF models demonstrate robust performance in handling high-dimensional data. CNNs have shown exceptional accuracy in cancer detection. LSTM networks excel in analyzing temporal data, providing accurate predictions of clinical deterioration.
  arXiv  Detail & Related papers  (2024-08-05T09:41:34Z)
• Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
  Time-series learning is the bread and butter of data-driven *clinical decision support* Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit. Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
  arXiv  Detail & Related papers  (2023-10-28T12:08:03Z)
• Remote Medication Status Prediction for Individuals with Parkinson's Disease using Time-series Data from Smartphones [75.23250968928578]
  We present a method for predicting the medication status of Parkinson's disease patients using the public mPower dataset. The proposed method shows promising results in predicting three medication statuses objectively.
  arXiv  Detail & Related papers  (2022-07-26T02:08:08Z)
• MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
  This paper aims at a unified deep learning approach to predict patient prognosis and therapy response. We formalize the prognosis modeling as a multi-modal asynchronous time series classification task. Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
  arXiv  Detail & Related papers  (2020-10-08T15:30:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.