DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learning
- URL: http://arxiv.org/abs/2608.25073v2
- Date: Sun, 30 Aug 2026 14:48:43 GMT
- Title: DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learning
- Abstract summary: Digital mobility outcomes (DMOs) derived from wearable sensors offer a promising means of monitoring disease progression.<n>Existing DMO studies have typically focused on either a single disease or a single visit.<n>We propose DeMMO, an interpretable framework for longitudinal, multi-disease, and multi-outcome learning.
- Score: 6.318710451121123
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Digital mobility outcomes (DMOs) derived from wearable sensors characterise mobility in daily life and offer a promising means of monitoring disease progression. However, existing DMO studies have typically focused on either a single disease or a single visit. To the best of our knowledge, this is the first study to systematically model and analyse longitudinal multivariate DMOs across diverse mobility-limiting diseases. Specifically, we propose DeMMO, an interpretable framework for longitudinal, multi-disease, and multi-outcome learning. DeMMO represents each disease--outcome objective using a longitudinal DMO coefficient matrix and combines temporal regularisation with stable and visit-specific feature selection. Its central technical contribution is an automatic cross-disease and cross-outcome relation-learning mechanism that infers signed relations directly from these longitudinal mappings, thereby enabling selective information sharing across cohorts without requiring paired participants. We evaluate DeMMO on the recently released, large-scale, multicentre Mobilise-D dataset, which comprises four participant-disjoint cohorts representing distinct mobility-limiting diseases, with each cohort contributing one or more clinical measurement outcomes. Compared with eight strong structural longitudinal and deep-regression baselines, DeMMO achieves the best overall predictive performance and outperforms the baselines for most individual outcomes. Stability selection further identifies reliable longitudinal DMO patterns that can inform subsequent clinical validation and disease monitoring. The implementation code is available at https://github.com/menghui-zhou/DeMMO.
Related papers
- LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts [2.537429062537451]
Multimodal clinical learning is increasingly important for integrating diverse patient data, including imaging, text, and personalised health records.<n>It faces two fundamental challenges: i) modality missingness, where arbitrary subsets of modalities are unavailable at a given patient visit, and ii) longitudinal dynamics, where the diagnostic significance of an observation depends on the patient's evolving disease trajectory over time.<n>We propose LongMoE (Longitudinal Mixture-of-Experts), the unified framework to jointly address both challenges.
arXiv Detail & Related papers (2026-06-06T07:50:41Z) - M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model [53.96788246923603]
We propose M-IDoL, a self-supervised underlinetextitMFM that introduces Information Decomposition for multimodal representation Learning.<n>By pre-training on 1.15 million medical images, M-IDoL i) delivers superior generalization across 21 downstream clinical tasks.
arXiv Detail & Related papers (2026-04-10T04:06:11Z) - Early Prediction of Multiple Sclerosis Disability Progression via Multimodal Foundation Model Benchmarks [0.0]
This work predicts 48- and 72-week disability using sparse clinical data and daily digital Floodlight data from the CONSONANCE clinical trial.<n>We employed state-of-the-art foundation models (FMs), a custom multimodal attention-based transformer, and machine learning methods.<n>Our findings demonstrate the promise of FMs and multimodal approaches to extract predictive signals from complex and diverse clinical and digital life sciences data.
arXiv Detail & Related papers (2025-06-17T21:37:45Z) - A Learnable Multi-views Contrastive Framework with Reconstruction Discrepancy for Medical Time-Series [8.741139851597364]
We propose incorporating external data from related tasks and leveraging AE-GAN to extract prior knowledge.<n>We introduce LMCF, a framework that integrates a multi-head attention mechanism and adaptively learns representations from different views.<n>Experiments on three target datasets demonstrate that our method consistently outperforms seven other baselines.
arXiv Detail & Related papers (2025-01-30T14:20:11Z) - Continually Evolved Multimodal Foundation Models for Cancer Prognosis [50.43145292874533]
Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates.<n>Previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic data, leveraging their complementary information.<n>Existing approaches face two major limitations. First, they struggle to incorporate newly arrived data with varying distributions into training, such as patient records from different hospitals.<n>Second, most multimodal integration methods rely on simplistic concatenation or task-specific pipelines, which fail to capture the complex interdependencies across modalities.
arXiv Detail & Related papers (2025-01-30T06:49:57Z) - MVICAD2: Multi-View Independent Component Analysis with Delays and Dilations [61.59658203704757]
We propose Multi-View Independent Component Analysis with Delays and Dilations (MVICAD2), which allows sources to differ across subjects in both temporal delays and dilations.<n>We present a model with identifiable sources, derive an approximation of its likelihood in closed form, and use regularization and optimization techniques to enhance performance.
arXiv Detail & Related papers (2025-01-13T15:47:02Z) - HC-LLM: Historical-Constrained Large Language Models for Radiology Report Generation [89.3260120072177]
We propose a novel Historical-Constrained Large Language Models (HC-LLM) framework for Radiology report generation.<n>Our approach extracts both time-shared and time-specific features from longitudinal chest X-rays and diagnostic reports to capture disease progression.<n> Notably, our approach performs well even without historical data during testing and can be easily adapted to other multimodal large models.
arXiv Detail & Related papers (2024-12-15T06:04:16Z) - Medical Video Generation for Disease Progression Simulation [40.38123964910394]
We propose the first Medical Video Generation framework that enables controlled manipulation of disease-related image and video features.
We validate our framework across three medical imaging domains: chest X-ray, fundus photography, and skin image.
MVG significantly outperforms baseline models in generating coherent and clinically plausible disease trajectories.
arXiv Detail & Related papers (2024-11-18T18:37:09Z) - SegHeD: Segmentation of Heterogeneous Data for Multiple Sclerosis Lesions with Anatomical Constraints [1.498084483844508]
Machine learning models have demonstrated a great potential for automated MS lesion segmentation.
SegHeD is a novel multi-dataset multi-task segmentation model that can incorporate heterogeneous data as input.
SegHeD is assessed on five MS datasets and achieves a high performance in all, new, and vanishing-lesion segmentation.
arXiv Detail & Related papers (2024-10-02T17:21:43Z) - PMT: Progressive Mean Teacher via Exploring Temporal Consistency for Semi-Supervised Medical Image Segmentation [51.509573838103854]
We propose a semi-supervised learning framework, termed Progressive Mean Teachers (PMT), for medical image segmentation.
Our PMT generates high-fidelity pseudo labels by learning robust and diverse features in the training process.
Experimental results on two datasets with different modalities, i.e., CT and MRI, demonstrate that our method outperforms the state-of-the-art medical image segmentation approaches.
arXiv Detail & Related papers (2024-09-08T15:02:25Z) - MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild [81.32127423981426]
Multimodal emotion recognition based on audio and video data is important for real-world applications.
Recent methods have focused on exploiting advances of self-supervised learning (SSL) for pre-training of strong multimodal encoders.
We propose a different perspective on the problem and investigate the advancement of multimodal DFER performance by adapting SSL-pre-trained disjoint unimodal encoders.
arXiv Detail & Related papers (2024-04-13T13:39:26Z) - C^2M-DoT: Cross-modal consistent multi-view medical report generation
with domain transfer network [67.97926983664676]
We propose a cross-modal consistent multi-view medical report generation with a domain transfer network (C2M-DoT)
C2M-DoT substantially outperforms state-of-the-art baselines in all metrics.
arXiv Detail & Related papers (2023-10-09T02:31:36Z) - Predicting multiple sclerosis disease severity with multimodal deep
neural networks [10.599189568556508]
We describe a pilot effort to leverage structured EHR data, neuroimaging data and clinical notes to build a multi-modal deep learning framework to predict patient's MS disease severity.
The proposed pipeline demonstrates up to 25% increase in terms of the area under the Area Under the Receiver Operating Characteristic curve (AUROC) compared to models using single-modal data.
arXiv Detail & Related papers (2023-04-08T16:23:18Z) - Benchmarking Continuous Time Models for Predicting Multiple Sclerosis
Progression [46.394865849252696]
Multiple sclerosis is a disease that affects the brain and spinal cord, it can lead to severe disability and has no known cure.
In a recent paper it was shown that disease progression can be predicted effectively using performance outcome measures and demographic data.
We benchmark four continuous time models using a publicly available multiple sclerosis dataset.
We find that the best continuous model is often able to outperform the best benchmarked discrete time model.
arXiv Detail & Related papers (2023-02-15T18:45:32Z) - Temporal Clustering with External Memory Network for Disease Progression
Modeling [8.015263440307631]
Disease progression modeling (DPM) involves using mathematical frameworks to quantitatively measure the severity of how certain disease progresses.
DPM is useful in many ways such as predicting health state, categorizing disease stages, and assessing patients disease trajectory etc.
arXiv Detail & Related papers (2021-09-29T02:32:06Z) - Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization.
We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise.
We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
arXiv Detail & Related papers (2020-06-11T17:29:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.