Frailty Estimation in Elderly Oncology Patients Using Multimodal Wearable Data and Multi-Instance Learning

• URL: http://arxiv.org/abs/2604.06985v1
• Date: Wed, 08 Apr 2026 12:00:40 GMT
• Title: Frailty Estimation in Elderly Oncology Patients Using Multimodal Wearable Data and Multi-Instance Learning
• Abstract summary: We propose a multimodal wearable framework to estimate frailty-related functional change between visits in elderly breast cancer patients.<n>Our innovation is an attention-based multiple instance learning (MIL) formulation that fuses irregular, multimodal wearable instances under real-world missingness and weak supervision.
• Score: 1.226215564499691
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Frailty and functional decline strongly influence treatment tolerance and outcomes in older patients with cancer, yet assessment is typically limited to infrequent clinic visits. We propose a multimodal wearable framework to estimate frailty-related functional change between visits in elderly breast cancer patients enrolled in the multicenter CARDIOCARE study. Free-living smartwatch physical activity and sleep features are combined with ECG-derived heart rate variability (HRV) features from a chest strap and organized into patient-horizon bags aligned to month 3 (M3) and month 6 (M6) follow-ups. Our innovation is an attention-based multiple instance learning (MIL) formulation that fuses irregular, multimodal wearable instances under real-world missingness and weak supervision. An attention-based MIL model with modality-specific multilayer perceptron (MLP) encoders with embedding dimension 128 aggregates variable-length and partially missing longitudinal instances to predict discretized change-from-baseline classes (worsened, stable, improved) for FACIT-F and handgrip strength. Under subject-independent leave-one-subject-out (LOSO) evaluation, the full multimodal model achieved balanced accuracy/F1 of 0.68 +/- 0.08/0.67 +/- 0.09 at M3 and 0.70 +/- 0.10/0.69 +/- 0.08 at M6 for handgrip, and 0.59 +/- 0.04/0.58 +/- 0.06 at M3 and 0.64 +/- 0.05/0.63 +/- 0.07 at M6 for FACIT-F. Ablation results indicated that smartwatch activity and sleep provide the strongest predictive information for frailty-related functional changes, while HRV contributes complementary information when fused with smartwatch streams.

Related papers

• AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis [9.26430087315053]
  In longitudinal Alzheimer's disease (AD) diagnosis support, clinical and imaging information is often collected at irregular visits.<n>We propose AT-Attn, a temporal-aware multimodal framework that combines Change-and-Time encoding, time-biased asymmetric cross-attention, and gated fusion to integrate MRI with longitudinal clinical information.
  arXiv  Detail & Related papers  (2026-07-08T07:25:56Z)
• Differentiable latent structure discovery for interpretable forecasting in clinical time series [38.473526928012724]
  We introduce StructGP, a continuous-time multi-task Gaussian process that couples differentiable structure learning to uncover a sparse, ordered directed acyclic graph (DAG) of inter-variable dependencies while preserving principled uncertainty.<n>We propose LP-StructGP, which augments StructGP with latent pathways-shared, temporally shifted trajectories inferred via subject-specific coupling filters and a softmax gating mechanism-to capture cross-patient progression patterns.
  arXiv  Detail & Related papers  (2026-04-30T14:59:50Z)
• Toward Safe Autonomous Robotic Endovascular Interventions using World Models [34.54099310430464]
  We investigate a world-model-based framework for autonomous endovascular navigation built on TD-MPC2.<n>We evaluate a TD-MPC2 agent trained on multiple navigation across hold out patient-specific vasculatures.<n>We benchmark its performance against the state-of-the-art Soft Actor-Critic (SAC) algorithm agent.
  arXiv  Detail & Related papers  (2026-04-22T03:32:18Z)
• Stress Estimation in Elderly Oncology Patients Using Visual Wearable Representations and Multi-Instance Learning [1.226215564499691]
  We estimate perceived stress in an elderly, multicenter breast cancer cohort using multimodal wearable data.<n>A single Perceived Stress Scale (PSS) score corresponds to many unlabeled windows.<n>A lightweight pretrained mixture-of-experts backbone embeds each representation into 192-dimensional vectors, which are aggregated via attention-based multiple instance learning.
  arXiv  Detail & Related papers  (2026-04-08T12:06:21Z)
• Cerebra: A Multidisciplinary AI Board for Multimodal Dementia Characterization and Risk Assessment [56.62016795093786]
  Cerebra is an interactive multi-agent AI team that coordinates specialized agents for EHR, clinical notes, and medical imaging analysis.<n>It supports privacy-preserving deployment by operating on structured representations and remains robust when modalities are incomplete.<n>Cerebra significantly improved expert performance, increasing accuracy by 17.5 percentage points in prospective dementia risk estimation.
  arXiv  Detail & Related papers  (2026-03-23T05:46:45Z)
• In-Hospital Stroke Prediction from PPG-Derived Hemodynamic Features [34.880478990331916]
  We develop an LLM-assisted data mining pipeline to extract precise in-hospital stroke onset timestamps from unstructured clinical notes.<n>We then extract hemodynamic features from PPG and employ a ResNet-1D model to predict impending stroke across multiple early-warning horizons.<n>These results provide the first empirical evidence from real-world clinical data that PPG contains predictive signatures of stroke several hours before onset.
  arXiv  Detail & Related papers  (2026-02-10T01:50:26Z)
• A Sparse-Attention Deep Learning Model Integrating Heterogeneous Multimodal Features for Parkinson's Disease Severity Profiling [4.813020904720317]
  Class-Weighted Sparse-Attention Fusion Network (SAFN) is an interpretable deep learning framework for robust multimodal profiling.<n>SAFN integrates MRI cortical thickness, MRI volumetric measures, clinical assessments, and demographic variables.<n>It achieves an accuracy of 0.98 plus or minus 0.02 and a PR-AUC of 1.00 plus or minus 0.00, outperforming established machine learning and deep learning baselines.
  arXiv  Detail & Related papers  (2026-01-02T00:51:21Z)
• Multimodal Functional Maximum Correlation for Emotion Recognition [41.64451298000105]
  Emotional states manifest as coordinated yet heterogeneous physiological responses across central and autonomic systems.<n>We propose Multimodal Functional Maximum Correlation (MFMC) to maximize higher-order multimodal dependence.<n>MFMC consistently state-of-the-art or competitive under both subject-dependent and subject-independent evaluation protocols.
  arXiv  Detail & Related papers  (2025-12-28T20:48:02Z)
• Transparent Early ICU Mortality Prediction with Clinical Transformer and Per-Case Modality Attribution [42.85462513661566]
  We present a lightweight, transparent multimodal ensemble that fuses physiological time-series measurements with unstructured clinical notes from the first 48 hours of an ICU stay.<n>A logistic regression model combines predictions from two modality-specific models: a bidirectional LSTM for vitals and a finetuned ClinicalModernBERT transformer for notes.<n>On the MIMIC-III benchmark, our late-fusion ensemble improves discrimination over the best single model while maintaining well-calibrated predictions.
  arXiv  Detail & Related papers  (2025-11-19T20:11:49Z)
• Predicting Length of Stay in Neurological ICU Patients Using Classical Machine Learning and Neural Network Models: A Benchmark Study on MIMIC-IV [49.1574468325115]
  This study explores multiple ML approaches for predicting LOS in ICU specifically for the patients with neurological diseases based on the MIMIC-IV dataset.<n>The evaluated models include classic ML algorithms (K-Nearest Neighbors, Random Forest, XGBoost and CatBoost) and Neural Networks (LSTM, BERT and Temporal Fusion Transformer)
  arXiv  Detail & Related papers  (2025-05-23T14:06:42Z)
• BioFusionNet: Deep Learning-Based Survival Risk Stratification in ER+ Breast Cancer Through Multifeature and Multimodal Data Fusion [16.83901927767791]
  We present BioFusionNet, a deep learning framework that fuses image-derived features with genetic and clinical data to obtain a holistic profile. Our model achieves a mean concordance index of 0.77 and a time-dependent area under the curve of 0.84, outperforming state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-16T14:19:33Z)
• COVID-MTL: Multitask Learning with Shift3D and Random-weighted Loss for Automated Diagnosis and Severity Assessment of COVID-19 [39.57518533765393]
  There is an urgent need for automated methods to assist accurate and effective assessment of COVID-19. We present an end-to-end multitask learning framework (COVID-MTL) that is capable of automated and simultaneous detection (against both radiology and NAT) and severity assessment of COVID-19.
  arXiv  Detail & Related papers  (2020-12-10T08:30:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.