Neural ODE enhanced linear mixed effect models for estimating complex association patterns of time-varying covariates with the marker trajectory
- URL: http://arxiv.org/abs/2608.29714v1
- Date: Sun, 30 Aug 2026 10:45:02 GMT
- Title: Neural ODE enhanced linear mixed effect models for estimating complex association patterns of time-varying covariates with the marker trajectory
- Abstract summary: We propose the Neural ODE-LMM, which embeds a Neural Ordinary Differential Equation (Neural ODE) within the linear mixed-effects framework.<n>The method reveals trajectory-dependent associations of BMI and fasting glucose with cognitive decline.
- Score: 0.3420768233632066
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Longitudinal cohort studies produce repeated data that enable the assessment of time-varying association patterns between exposures and health outcomes. Classical linear mixed-effects models (LMMs) can accommodate a large variety of association patterns while accounting for the irregularly spaced, partially observed measurement. But they require the analyst to pre-specify the functional form linking the exposure history to the outcome. We propose the Neural ODE-LMM, which embeds a Neural Ordinary Differential Equation (Neural ODE) within the linear mixed-effects framework: a learned vector field encodes covariate trajectories into a continuous-time latent state that drives both the fixed- and random-effect design, while preserving the standard LMM observation model. This retains classical likelihood-based inference while learning complex, potentially cumulative, covariate effects flexibly. All parameters are estimated by maximising a penalised marginal likelihood. To quantify covariate effects, we introduce contrasts of counterfactual predictions that compare the expected outcome under alternative covariate trajectories with variance estimated via the delta method. In simulations, the model recovers both instantaneous and cumulative-burden effects without prior specification of the functional form. Applied to the Trois-Cités (3C) cohort, a population-based study of 7{,}324 participants, the method reveals trajectory-dependent associations of BMI and fasting glucose with cognitive decline.
Related papers
- Multimodal Empirical Bayes Variational Autoencoders for Joint Longitudinal and Time-to-Event Modeling [0.0]
We extend the empirical Bayes variational autoencoder (EB-VAE) framework to joint longitudinal and time-to-event modeling.<n>The framework represents inter-individual variability using latent individual effects regularized by a co-conditioned empirical Bayes prior.<n>The hybrid decoder recovered treatment-effect parameters broadly consistent with previously reported nonlinear mixed-effects estimates.
arXiv Detail & Related papers (2026-07-15T16:13:14Z) - Integrating Neural Encoders in Bayesian Generalized Linear Mixed Models for Multimodal Data [2.566287700129649]
We develop a conditional-Bayes design for generalized linear mixed models (GLMMs)<n>We learn one or more modality-specific neural encoders jointly with a GLMM objective, then performing variance-correctedgradient MCMC for the GLMM parameters conditional on the learned representation.<n>The framework allows nuanced assessment of the relative importance of each modality on both individual and population levels without sacrificing predictive performance.
arXiv Detail & Related papers (2026-07-06T04:01:22Z) - Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback [56.69850045068714]
We introduce textitInfluence-Guided Regression (IGSR), a method that frames equation discovery as an iterative two-step process.<n>We demonstrate IGSRs effectiveness on a diverse suite of benchmarks, including LLM-SRBench, pharmacological PKPD models, an epidemiological simulation, and real-world genomic data.
arXiv Detail & Related papers (2026-05-27T23:48:01Z) - Observable Neural ODEs for Identifiable Causal Forecasting in Continuous Time [0.0]
We show that, in latent state-space models with time-varying interventions, observability of the latent dynamics from observed data is necessary.<n>We propose Observable Neural ODEs (ObsNODEs), Neural ODE models in observable normal form for causal forecasting.
arXiv Detail & Related papers (2026-04-28T19:18:42Z) - Predictive Causal Inference via Spatio-Temporal Modeling and Penalized Empirical Likelihood [0.0]
This study introduces an integrated framework for predictive causal inference designed to overcome limitations in conventional single model approaches.<n> Specifically, we combine a Hidden Markov Model for spatial health state estimation with a Multi Task and Multi Graph Convolutional Network (MTGCN) for capturing temporal outcome trajectories.<n>To demonstrate its utility, we focus on clinical domains such as cancer, dementia, Parkinson disease, where treatment effects are challenging to observe directly.
arXiv Detail & Related papers (2025-07-11T03:11:15Z) - Prediction of cancer dynamics under treatment using Bayesian neural networks: A simulated study [0.0]
We develop a hierarchical Bayesian model of subpopulation dynamics to predict cancer dynamics under treatment.
We are inspired by cancer dynamics in multiple myeloma (MM), where serum M protein is a well-known proxy of tumor burden.
arXiv Detail & Related papers (2024-05-23T12:47:19Z) - Online Variational Sequential Monte Carlo [49.97673761305336]
We build upon the variational sequential Monte Carlo (VSMC) method, which provides computationally efficient and accurate model parameter estimation and Bayesian latent-state inference.
Online VSMC is capable of performing efficiently, entirely on-the-fly, both parameter estimation and particle proposal adaptation.
arXiv Detail & Related papers (2023-12-19T21:45:38Z) - Continuous-Time Modeling of Counterfactual Outcomes Using Neural
Controlled Differential Equations [84.42837346400151]
Estimating counterfactual outcomes over time has the potential to unlock personalized healthcare.
Existing causal inference approaches consider regular, discrete-time intervals between observations and treatment decisions.
We propose a controllable simulation environment based on a model of tumor growth for a range of scenarios.
arXiv Detail & Related papers (2022-06-16T17:15:15Z) - Mixed Effects Neural ODE: A Variational Approximation for Analyzing the
Dynamics of Panel Data [50.23363975709122]
We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data.
We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem.
We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
arXiv Detail & Related papers (2022-02-18T22:41:51Z) - Estimation of Bivariate Structural Causal Models by Variational Gaussian
Process Regression Under Likelihoods Parametrised by Normalising Flows [74.85071867225533]
Causal mechanisms can be described by structural causal models.
One major drawback of state-of-the-art artificial intelligence is its lack of explainability.
arXiv Detail & Related papers (2021-09-06T14:52:58Z) - Efficient Causal Inference from Combined Observational and
Interventional Data through Causal Reductions [68.6505592770171]
Unobserved confounding is one of the main challenges when estimating causal effects.
We propose a novel causal reduction method that replaces an arbitrary number of possibly high-dimensional latent confounders.
We propose a learning algorithm to estimate the parameterized reduced model jointly from observational and interventional data.
arXiv Detail & Related papers (2021-03-08T14:29:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.