Latent Factor Point Processes for Patient Representation in Electronic Health Records
- URL: http://arxiv.org/abs/2508.20327v1
- Date: Thu, 28 Aug 2025 00:08:55 GMT
- Title: Latent Factor Point Processes for Patient Representation in Electronic Health Records
- Abstract summary: Most statistical methods reduce the irregular timing of EHR codes into simple counts, thereby discarding rich temporal structure.<n>We propose the latent factor point process model, which represents code occurrences as a high-dimensional point process.<n>This low-rank structure reflects the clinical reality that thousands of codes are governed by a small number of underlying disease processes.
- Score: 12.377029213322198
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Electronic health records (EHR) contain valuable longitudinal patient-level information, yet most statistical methods reduce the irregular timing of EHR codes into simple counts, thereby discarding rich temporal structure. Existing temporal models often impose restrictive parametric assumptions or are tailored to code level rather than patient-level tasks. We propose the latent factor point process model, which represents code occurrences as a high-dimensional point process whose conditional intensity is driven by a low dimensional latent Poisson process. This low-rank structure reflects the clinical reality that thousands of codes are governed by a small number of underlying disease processes, while enabling statistically efficient estimation in high dimensions. Building on this model, we introduce the Fourier-Eigen embedding, a patient representation constructed from the spectral density matrix of the observed process. We establish theoretical guarantees showing that these embeddings efficiently capture subgroup-specific temporal patterns for downstream classification and clustering. Simulations and an application to an Alzheimer's disease EHR cohort demonstrate the practical advantages of our approach in uncovering clinically meaningful heterogeneity.
Related papers
- Provably Learning Diffusion Models under the Manifold Hypothesis: Collapse and Refine [60.669081685261965]
Diffusion models generate high-dimensional data with remarkable quality.<n>How their training efficiently learns the score function remains theoretically unexplained.<n>We instantiate this principle as Score-induced Latent Diffusion (SiLD)
arXiv Detail & Related papers (2026-05-16T16:51:10Z) - Knowledge-Embedded Latent Projection for Robust Representation Learning [5.79422287722755]
We propose a knowledge-embedded latent projection model that leverages semantic side information to regularize representation learning.<n>Specifically, we model column embeddings as smooth functions of semantic embeddings via a kernel mapping in a Hilbert space.<n>We develop a computationally efficient two-step embedding estimation procedure that combines semantically guided subspace construction via kernel principal component embedding.
arXiv Detail & Related papers (2026-02-18T18:58:16Z) - Rethinking Tokenization for Clinical Time Series: When Less is More [0.20388938295521575]
We present a systematic evaluation of tokenization approaches for clinical time series modeling.<n>We show that explicit time encodings provide no consistent statistically significant benefit for the evaluated downstream tasks.<n>Value features show task-dependent importance, affecting mortality prediction but not readmission, suggesting code sequences alone can carry sufficient predictive signal.
arXiv Detail & Related papers (2025-12-04T19:39:10Z) - Machine Learning Approaches to Clinical Risk Prediction: Multi-Scale Temporal Alignment in Electronic Health Records [2.9576397177561087]
This study proposes a risk prediction method based on a Multi-Scale Temporal Alignment Network (MSTAN)<n>It addresses the challenges of temporal irregularity, sampling interval differences, and multi-scale dynamic dependencies in Electronic Health Records (EHR)<n> Experiments conducted on publicly available EHR datasets show that the proposed model outperforms mainstream baselines in accuracy, recall, precision, and F1-Score.
arXiv Detail & Related papers (2025-11-26T16:33:59Z) - Deep Learning Approach for Clinical Risk Identification Using Transformer Modeling of Heterogeneous EHR Data [0.0]
This study proposes a Transformer-based longitudinal modeling method to address challenges in clinical risk classification with heterogeneous EHR data.<n>The method takes multi-source medical features as input and employs a feature embedding layer to achieve a unified representation of structured and unstructured data.<n> Experimental results show that the proposed model outperforms traditional machine learning and temporal deep learning models in accuracy, recall, precision, and F1-Score.
arXiv Detail & Related papers (2025-11-06T08:02:21Z) - Time-Aware Attention for Enhanced Electronic Health Records Modeling [8.4225455796455]
TALE-EHR is a Transformer-based framework featuring a novel time-aware attention mechanism that explicitly models continuous temporal gaps.<n>Our approach outperforms state-of-the-art baselines on tasks such as disease progression forecasting.
arXiv Detail & Related papers (2025-07-20T07:32:41Z) - Channel-Imposed Fusion: A Simple yet Effective Method for Medical Time Series Classification [11.520819583343128]
This study shifts focus toward a modeling paradigm that emphasizes structural transparency, aligning more closely with the intrinsic characteristics of medical data.<n>We propose a novel method, Channel Imposed Fusion (CIF), which enhances the signal-to-noise ratio through cross-channel information fusion.<n> Experimental results on multiple publicly available EEG and ECG datasets demonstrate that the proposed method not only outperforms existing state-of-the-art (SOTA) approaches in terms of various classification metrics, but also significantly enhances the transparency of the classification process, offering a novel perspective for medical time series classification.
arXiv Detail & Related papers (2025-05-31T01:44:30Z) - Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data [5.591260685112265]
SCORE is a semi-supervised representation learning framework that captures multi-domain disease profiles through patient embeddings.<n>To handle the computational challenges of large-scale data, it introduces a hybrid Expectation-Maximization (EM) and Gaussian Variational Approximation (GVA) algorithm.<n>Our analysis shows that incorporating unlabeled data enhances accuracy and reduces sensitivity to label scarcity.
arXiv Detail & Related papers (2025-05-27T05:20:17Z) - REST: Efficient and Accelerated EEG Seizure Analysis through Residual State Updates [54.96885726053036]
This paper introduces a novel graph-based residual state update mechanism (REST) for real-time EEG signal analysis.
By leveraging a combination of graph neural networks and recurrent structures, REST efficiently captures both non-Euclidean geometry and temporal dependencies within EEG data.
Our model demonstrates high accuracy in both seizure detection and classification tasks.
arXiv Detail & Related papers (2024-06-03T16:30:19Z) - High Rank Path Development: an approach of learning the filtration of stochastic processes [6.245824251614165]
We introduce a novel metric called High Rank PCF Distance (HRPCFD) for extended weak convergence.
We then show that such HRPCFD admits many favourable analytic properties which allows us to design an efficient algorithm for training HRPCFD from data and construct the HRPCF-GAN.
Our numerical experiments on both hypothesis testing and generative modelling validate the out-performance of our approach compared with several state-of-the-art methods.
arXiv Detail & Related papers (2024-05-23T13:20:47Z) - Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image.
In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting.
Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
arXiv Detail & Related papers (2023-11-27T13:14:06Z) - ChiroDiff: Modelling chirographic data with Diffusion Models [132.5223191478268]
We introduce a powerful model-class namely "Denoising Diffusion Probabilistic Models" or DDPMs for chirographic data.
Our model named "ChiroDiff", being non-autoregressive, learns to capture holistic concepts and therefore remains resilient to higher temporal sampling rate.
arXiv Detail & Related papers (2023-04-07T15:17:48Z) - T-Phenotype: Discovering Phenotypes of Predictive Temporal Patterns in
Disease Progression [82.85825388788567]
We develop a novel temporal clustering method, T-Phenotype, to discover phenotypes of predictive temporal patterns from labeled time-series data.
We show that T-Phenotype achieves the best phenotype discovery performance over all the evaluated baselines.
arXiv Detail & Related papers (2023-02-24T13:30:35Z) - DriPP: Driven Point Processes to Model Stimuli Induced Patterns in M/EEG
Signals [62.997667081978825]
We develop a novel statistical point process model-called driven temporal point processes (DriPP)
We derive a fast and principled expectation-maximization (EM) algorithm to estimate the parameters of this model.
Results on standard MEG datasets demonstrate that our methodology reveals event-related neural responses.
arXiv Detail & Related papers (2021-12-08T13:07:21Z) - Concept-based model explanations for Electronic Health Records [1.6837409766909865]
Testing with Concept Activation Vectors (TCAV) has recently been introduced as a way of providing human-understandable explanations.
We propose an extension of the method to time series data to enable an application of TCAV to sequential predictions in the EHR.
arXiv Detail & Related papers (2020-12-03T22:18:24Z) - Statistical control for spatio-temporal MEG/EEG source imaging with
desparsified multi-task Lasso [102.84915019938413]
Non-invasive techniques like magnetoencephalography (MEG) or electroencephalography (EEG) offer promise of non-invasive techniques.
The problem of source localization, or source imaging, poses however a high-dimensional statistical inference challenge.
We propose an ensemble of desparsified multi-task Lasso (ecd-MTLasso) to deal with this problem.
arXiv Detail & Related papers (2020-09-29T21:17:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.