HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Series

• URL: http://arxiv.org/abs/2605.11130v2
• Date: Wed, 13 May 2026 15:10:18 GMT
• Title: HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Series
• Abstract summary: We introduce HEPA (Horizon-conditioned Event Predictive Architecture), built on two key principles.<n>A causal Transformer encoder is pretrained via a Joint-Embedding Predictive Architecture (JEPA)<n>We freeze the encoder and finetune only the predictor toward the target event, producing a monotonic survival cumulative distribution function (CDF) over horizons.
• Score: 1.592463731034439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Critical events in multivariate time series, from turbine failures to cardiac arrhythmias, demand accurate prediction, yet labeled data is scarce because such events are rare and costly to annotate. We introduce HEPA (Horizon-conditioned Event Predictive Architecture), built on two key principles. First, a causal Transformer encoder is pretrained via a Joint-Embedding Predictive Architecture (JEPA): a horizon-conditioned predictor learns to forecast future representations rather than future values, forcing the encoder to capture predictable temporal dynamics from unlabeled data alone. Second, we freeze the encoder and finetune only the predictor toward the target event, producing a monotonic survival cumulative distribution function (CDF) over horizons. With fixed architecture and optimiser hyperparameters across all benchmarks, HEPA handles water contamination, cyberattack detection, volatility regimes, and eight further event types across 11 domains, exceeding leading time-series architectures including PatchTST, iTransformer, MAE, and Chronos-2 on at least 10 of 14 benchmarks, with an order of magnitude fewer tuned parameters and, on lifecycle datasets, an order of magnitude less labeled data.

Related papers

• CF-JEPA: Mask-free forward prediction with asymmetric encoder utilization for time-series representation learning [3.526682160724688]
  Crop-based Forward JEPA is proposed as an innovative mask-free framework that replaces masking with multi-horizon forward prediction.<n>A strong asymmetry is identified between the online encoder and the exponential moving average (EMA) target encoder, both produced from a single training run.<n> CF-JEPA achieves the highest average accuracy and rank on UCR and UEA among self-supervised baselines.
  arXiv  Detail & Related papers  (2026-06-05T08:21:20Z)
• PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting [62.22445401483844]
  Existing methods are severely constrained by the bottleneck of compounding errors.<n>We propose a universal framework called -Cast-Corrector (Plug-and-Play Corrector)<n>Our method significantly enhances the long-term stability of coupled forecasting systems.
  arXiv  Detail & Related papers  (2026-05-09T13:12:33Z)
• IMPA-Net: Meteorology-Aware Multi-Scale Attention and Dynamic Loss for Extreme Convective Radar Nowcasting [2.405586180193259]
  Short-range prediction of convective precipitation from weather radar observations is essential for severe weather warnings.<n>We propose IMPA-Net, a deterministic 0-2 hour nowcasting framework that addresses limitations through meteorologically-informed designs at the input, architecture, and loss function levels.
  arXiv  Detail & Related papers  (2026-04-27T09:30:07Z)
• Time-Aware Prior Fitted Networks for Zero-Shot Forecasting with Exogenous Variables [59.37476887007663]
  We develop ApolloPFN, a prior-data fitted network (PFN) that is time-aware (unlike prior PFNs)<n>Our design introduces two major advances: (i) a synthetic data generation procedure tailored to resolve the failure modes that arise when PFNs are applied to time series; and (ii) time-aware architectural modifications that embed inductive biases needed to exploit the time series context.
  arXiv  Detail & Related papers  (2026-03-16T18:33:23Z)
• Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scaling [51.78972657142583]
  We introduce Timer-S1, a strong Mixture-of-Experts (MoE) time series foundation model with 8.3B total parameters, 0.75B activated parameters for each token, and a context length of 11.5K.<n>To overcome the scalability bottleneck in existing pre-trained time series foundation models, we perform Serial Scaling in three dimensions.
  arXiv  Detail & Related papers  (2026-03-05T04:13:57Z)
• EVEREST: An Evidential, Tail-Aware Transformer for Rare-Event Time-Series Forecasting [4.551615447454767]
  EVEREST is a transformer-based architecture for probabilistic rare-event forecasting.<n>It delivers calibrated predictions and tail-aware risk estimation.<n>It is applicable to high-stakes domains such as industrial monitoring, weather, and satellite diagnostics.
  arXiv  Detail & Related papers  (2026-01-26T23:15:20Z)
• A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting [81.73338008264115]
  Current approaches for time series forecasting, whether in the time or frequency domain, predominantly use deep learning models based on linear layers or transformers.<n>We propose FIRE, a unified frequency domain decomposition framework that provides a mathematical abstraction for diverse types of time series.<n>Fire consistently outperforms state-of-the-art models on long-term forecasting benchmarks.
  arXiv  Detail & Related papers  (2025-10-11T09:59:25Z)
• PFformer: A Position-Free Transformer Variant for Extreme-Adaptive Multivariate Time Series Forecasting [9.511600544581425]
  PFformer is a position-free Transformer-based model designed for single-target MTS forecasting.<n> PFformer integrates two novel embedding strategies: Enhanced Feature-based Embedding (EFE) and Auto-Encoder-based Embedding (AEE)
  arXiv  Detail & Related papers  (2025-02-27T22:21:27Z)
• Timer-XL: Long-Context Transformers for Unified Time Series Forecasting [67.83502953961505]
  We present Timer-XL, a causal Transformer for unified time series forecasting.<n>Based on large-scale pre-training, Timer-XL achieves state-of-the-art zero-shot performance.
  arXiv  Detail & Related papers  (2024-10-07T07:27:39Z)
• FATE: Focal-modulated Attention Encoder for Multivariate Time-series Forecasting [0.0]
  Climate stands as one of the most pressing global challenges of the twenty-first century, with far-reaching consequences such as rising sea levels, melting glaciers, and increasingly extreme weather patterns.<n> Accurate forecasting is critical for monitoring these phenomena and supporting mitigation strategies.<n>Recent data-driven models for time-series forecasting, including CNNs, RNNs, and attention-based transformers, have shown promise but struggle with dependencies and limited parallelization.<n>In this work, we present Modulated Attention Focal (FATE) for reliable time-series forecasting.
  arXiv  Detail & Related papers  (2024-08-21T04:40:18Z)
• CARD: Channel Aligned Robust Blend Transformer for Time Series Forecasting [50.23240107430597]
  We design a special Transformer, i.e., Channel Aligned Robust Blend Transformer (CARD for short), that addresses key shortcomings of CI type Transformer in time series forecasting. First, CARD introduces a channel-aligned attention structure that allows it to capture both temporal correlations among signals. Second, in order to efficiently utilize the multi-scale knowledge, we design a token blend module to generate tokens with different resolutions. Third, we introduce a robust loss function for time series forecasting to alleviate the potential overfitting issue.
  arXiv  Detail & Related papers  (2023-05-20T05:16:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.