LifeSentence: Language models can encode human life course trajectories from longitudinal panel data

• URL: http://arxiv.org/abs/2606.11220v1
• Date: Thu, 14 May 2026 20:28:41 GMT
• Title: LifeSentence: Language models can encode human life course trajectories from longitudinal panel data
• Abstract summary: LifeSentence is a model for life-course reasoning that bridges large language models with longitudinal panel data.<n> Trained on approximately 65,000 individuals from the German Socio-Economic Panel.
• Score: 3.665697585894509
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Forecasting human life outcomes is important to gain insights into how individuals attain long and healthy lives. Conventional statistical approaches yield limited accuracy, potentially due to discarding the sequential structure of the life course. Modern methods such as transformer architectures require large scale training data that most longitudinal panel studies lack. Here we introduce LifeSentence, a model for life-course reasoning that bridges large language models with longitudinal panel data. By representing each life event as a structured natural-language record and instruction-tuning a pretrained 24-billion-parameter language model across an 18-task evaluation taxonomy spanning prediction, robustness and reasoning, LifeSentence supplements panel data with distributional knowledge already encoded during pretraining. Trained on approximately 65,000 individuals from the German Socio-Economic Panel - roughly 45 times fewer than prior transformer-based approaches - LifeSentence outperforms classical and deep learning baselines across all task families, achieving a threefold improvement in joint event-and-timing prediction from best baselines and 91.2% Kendall's tau when reconstructing chronological order from timestamp-stripped event sets. Without explicit supervision, the model recovers documented patterns of social stratification, including the education premium, the gender wage gap and the motherhood penalty, from discrete event sequences alone. A natural-language interface further enables qualitatively new research queries, such as connecting an early-life history to a specified late-life endpoint, establishing LifeSentence as both a predictive tool and a probe for counterfactual exploration of human biographies.

Related papers

• Survival In-Context: Prior-fitted In-context Learning Tabular Foundation Model for Survival Analysis [19.308150844590916]
  Survival In-Context (SIC) is a prior-fitted in-context learning model for survival analysis.<n>SIC produces individualized survival prediction in a single forward pass.<n>SIC achieves competitive or superior performance compared to classical and deep survival models.
  arXiv  Detail & Related papers  (2026-03-31T09:22:52Z)
• Using Text-Based Life Trajectories from Swedish Register Data to Predict Residential Mobility with Pretrained Transformers [39.146761527401424]
  We convert register data from 6.9 million individuals (2001-2013) into semantically rich texts.<n>These life trajectories combine demographic information with annual changes in residence, work, education, income, and family circumstances.
  arXiv  Detail & Related papers  (2025-11-26T15:27:32Z)
• Personality Prediction from Life Stories using Language Models [12.851871085845499]
  In this study, we address the challenge of modeling long narrative interview where each exceeds 2000 tokens so as to predict Five-Factor Model (FFM) personality traits.<n>We propose a two-step approach: first, we extract contextual embeddings using sliding-window fine-tuning of pretrained language models; then, we apply Recurrent Neural Networks (RNNs) with attention mechanisms to integrate long-range dependencies and enhance interpretability.
  arXiv  Detail & Related papers  (2025-06-24T02:39:06Z)
• Using Sequences of Life-events to Predict Human Lives [16.77071145203099]
  We draw on the most comprehensive registry data in existence to examine the evolution and predictability of human lives. We create embeddings of life-events in a single vector space showing that this embedding space is robust and highly structured. Our models allow us to predict diverse outcomes ranging from early mortality to personality nuances, outperforming state-of-the-art models by a wide margin.
  arXiv  Detail & Related papers  (2023-06-05T16:19:48Z)
• Time Series Contrastive Learning with Information-Aware Augmentations [57.45139904366001]
  A key component of contrastive learning is to select appropriate augmentations imposing some priors to construct feasible positive samples. How to find the desired augmentations of time series data that are meaningful for given contrastive learning tasks and datasets remains an open question. We propose a new contrastive learning approach with information-aware augmentations, InfoTS, that adaptively selects optimal augmentations for time series representation learning.
  arXiv  Detail & Related papers  (2023-03-21T15:02:50Z)
• Few-shot Subgoal Planning with Language Models [58.11102061150875]
  We show that language priors encoded in pre-trained language models allow us to infer fine-grained subgoal sequences. In contrast to recent methods which make strong assumptions about subgoal supervision, our experiments show that language models can infer detailed subgoal sequences without any fine-tuning.
  arXiv  Detail & Related papers  (2022-05-28T01:03:30Z)
• Locally Typical Sampling [84.62530743899025]
  We show that today's probabilistic language generators fall short when it comes to producing coherent and fluent text.<n>We propose a simple and efficient procedure for enforcing this criterion when generating from probabilistic models.
  arXiv  Detail & Related papers  (2022-02-01T18:58:45Z)
• Adversarial Generative Grammars for Human Activity Prediction [141.43526239537502]
  We propose an adversarial generative grammar model for future prediction. Our grammar is designed so that it can learn production rules from the data distribution. Being able to select multiple production rules during inference leads to different predicted outcomes.
  arXiv  Detail & Related papers  (2020-08-11T17:47:53Z)
• Toward Better Storylines with Sentence-Level Language Models [54.91921545103256]
  We propose a sentence-level language model which selects the next sentence in a story from a finite set of fluent alternatives. We demonstrate the effectiveness of our approach with state-of-the-art accuracy on the unsupervised Story Cloze task.
  arXiv  Detail & Related papers  (2020-05-11T16:54:19Z)
• Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning [74.25168207651376]
  Fine-tuning pre-trained language models to downstream cross-lingual tasks has shown promising results. We leverage continual learning to preserve the cross-lingual ability of the pre-trained model when we fine-tune it to downstream tasks. Our methods achieve better performance than other fine-tuning baselines on the zero-shot cross-lingual part-of-speech tagging and named entity recognition tasks.
  arXiv  Detail & Related papers  (2020-04-29T14:07:18Z)
• Uncovering life-course patterns with causal discovery and survival analysis [5.627346969563955]
  We provide a novel approach to modelling life event choices and occurrence from a probabilistic perspective. Data comes from a survey conducted in Dortmund, Germany.
  arXiv  Detail & Related papers  (2020-01-30T15:30:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.