Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecasting

• URL: http://arxiv.org/abs/2411.10703v1
• Date: Sat, 16 Nov 2024 05:09:20 GMT
• Title: Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecasting
• Authors: Ebrahim Farahmand, Shovito Barua Soumma, Nooshin Taheri Chatrudi, Hassan Ghasemzadeh,
• Abstract summary: GlucoNet is an AI-powered sensor system for continuously monitoring behavioral and physiological health. We propose a decomposition-based transformer model that incorporates patients' behavioral and physiological data. G GlucoNet achieves a 60% improvement in RMSE and a 21% reduction in the number of parameters, using data obtained involving 12 participants with T1-Diabetes.
• Score: 6.466206145151128
• License:
• Abstract: The availability of continuous glucose monitors as over-the-counter commodities have created a unique opportunity to monitor a person's blood glucose levels, forecast blood glucose trajectories and provide automated interventions to prevent devastating chronic complications that arise from poor glucose control. However, forecasting blood glucose levels is challenging because blood glucose changes consistently in response to food intake, medication intake, physical activity, sleep, and stress. It is particularly difficult to accurately predict BGL from multimodal and irregularly sampled data and over long prediction horizons. Furthermore, these forecasting models must operate in real-time on edge devices to provide in-the-moment interventions. To address these challenges, we propose GlucoNet, an AI-powered sensor system for continuously monitoring behavioral and physiological health and robust forecasting of blood glucose patterns. GlucoNet devises a feature decomposition-based transformer model that incorporates patients' behavioral and physiological data and transforms sparse and irregular patient data (e.g., diet and medication intake data) into continuous features using a mathematical model, facilitating better integration with the BGL data. Given the non-linear and non-stationary nature of BG signals, we propose a decomposition method to extract both low and high-frequency components from the BGL signals, thus providing accurate forecasting. To reduce the computational complexity, we also propose to employ knowledge distillation to compress the transformer model. GlucoNet achieves a 60% improvement in RMSE and a 21% reduction in the number of parameters, using data obtained involving 12 participants with T1-Diabetes. These results underscore GlucoNet's potential as a compact and reliable tool for real-world diabetes prevention and management.

Related papers

• GlucoBench: Curated List of Continuous Glucose Monitoring Datasets with Prediction Benchmarks [0.12564343689544843]
  Continuous glucose monitors (CGM) are small medical devices that measure blood glucose levels at regular intervals. Forecasting of glucose trajectories based on CGM data holds the potential to substantially improve diabetes management.
  arXiv  Detail & Related papers  (2024-10-08T08:01:09Z)
• FedGlu: A personalized federated learning-based glucose forecasting algorithm for improved performance in glycemic excursion regions [4.073768455373616]
  Continuous glucose monitoring (CGM) devices provide real-time glucose monitoring and timely alerts for glycemic excursions. Rare events like hypoglycemia and hyperglycemia remain challenging due to their infrequency. We propose a novel Hypo-Hyper (HH) loss function, which significantly improves performance in the glycemic excursion regions.
  arXiv  Detail & Related papers  (2024-08-25T19:51:27Z)
• From Glucose Patterns to Health Outcomes: A Generalizable Foundation Model for Continuous Glucose Monitor Data Analysis [50.80532910808962]
  We present GluFormer, a generative foundation model on biomedical temporal data based on a transformer architecture. GluFormer generalizes to 15 different external datasets, including 4936 individuals across 5 different geographical regions. It can also predict onset of future health outcomes even 4 years in advance.
  arXiv  Detail & Related papers  (2024-08-20T13:19:06Z)
• Privacy Preserved Blood Glucose Level Cross-Prediction: An Asynchronous Decentralized Federated Learning Approach [13.363740869325646]
  Newly diagnosed Type 1 Diabetes (T1D) patients often struggle to obtain effective Blood Glucose (BG) prediction models. We propose "GluADFL", blood Glucose prediction by Asynchronous Decentralized Federated Learning.
  arXiv  Detail & Related papers  (2024-06-21T17:57:39Z)
• Toward Short-Term Glucose Prediction Solely Based on CGM Time Series [4.7066018521459725]
  TimeGlu is an end-to-end pipeline for short-term glucose prediction based on CGM time series data. It achieves state-of-the-art performance without the need for additional personal data from patients.
  arXiv  Detail & Related papers  (2024-04-18T06:02:12Z)
• Multi-scale Spatio-temporal Transformer-based Imbalanced Longitudinal Learning for Glaucoma Forecasting from Irregular Time Series Images [45.894671834869975]
  Glaucoma is one of the major eye diseases that leads to progressive optic nerve fiber damage and irreversible blindness. We introduce the Multi-scale Spatio-temporal Transformer Network (MST-former) based on the transformer architecture tailored for sequential image inputs. Our method shows excellent generalization capability on the Alzheimer's Disease Neuroimaging Initiative (ADNI) MRI dataset, with an accuracy of 90.3% for mild cognitive impairment and Alzheimer's disease prediction.
  arXiv  Detail & Related papers  (2024-02-21T02:16:59Z)
• Learning to Denoise Biomedical Knowledge Graph for Robust Molecular Interaction Prediction [50.7901190642594]
  We propose BioKDN (Biomedical Knowledge Graph Denoising Network) for robust molecular interaction prediction. BioKDN refines the reliable structure of local subgraphs by denoising noisy links in a learnable manner. It maintains consistent and robust semantics by smoothing relations around the target interaction.
  arXiv  Detail & Related papers  (2023-12-09T07:08:00Z)
• Improving Diffusion Models for ECG Imputation with an Augmented Template Prior [43.6099225257178]
  noisy and poor-quality recordings are a major issue for signals collected using mobile health systems. Recent studies have explored the imputation of missing values in ECG with probabilistic time-series models. We present a template-guided denoising diffusion probabilistic model (DDPM), PulseDiff, which is conditioned on an informative prior for a range of health conditions.
  arXiv  Detail & Related papers  (2023-10-24T11:34:15Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• Machine Learning based prediction of Glucose Levels in Type 1 Diabetes Patients with the use of Continuous Glucose Monitoring Data [0.0]
  Continuous Glucose Monitoring (CGM) devices offer detailed, non-intrusive and real time insights into a patient's blood glucose concentrations. Leveraging advanced Machine Learning (ML) Models as methods of prediction of future glucose levels, gives rise to substantial quality of life improvements.
  arXiv  Detail & Related papers  (2023-02-24T19:10:40Z)
• Short Term Blood Glucose Prediction based on Continuous Glucose Monitoring Data [53.01543207478818]
  This study explores the use of Continuous Glucose Monitoring (CGM) data as input for digital decision support tools. We investigate how Recurrent Neural Networks (RNNs) can be used for Short Term Blood Glucose (STBG) prediction.
  arXiv  Detail & Related papers  (2020-02-06T16:39:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.