NeuroMem-FHP: A Likelihood-Free Deep Learning Framework for Parameter Estimation of Fractional Hawkes Process

• URL: http://arxiv.org/abs/2607.11177v1
• Date: Mon, 13 Jul 2026 07:19:01 GMT
• Title: NeuroMem-FHP: A Likelihood-Free Deep Learning Framework for Parameter Estimation of Fractional Hawkes Process
• Abstract summary: We propose a framework for estimating the parameters of the fractional Hawkes process (FHP)<n>Two neural architectures, namely a Long Short-Term Memory (LSTM) network and a Transformer, are developed to estimate the model parameters.<n>Experiments show that both neural models significantly outperform the classical Maximum Likelihood Estimation (MLE) method.
• Score: 2.376995292379181
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In this paper, we propose deep learning based NeuroMem-FHP framework for estimating the parameters of the fractional Hawkes process (FHP), a self-exciting point process that captures long-range dependence through a fractional Mittag-Leffler excitation kernel. Two neural architectures, namely a Long Short-Term Memory (LSTM) network and a Transformer, are developed to estimate the model parameters $(μ,γ,α,β)$ directly from sequences of inter-arrival times without requiring computationally intensive likelihood optimization. Experiments on synthetic data that both neural models significantly outperform the classical Maximum Likelihood Estimation (MLE) method, with the Transformer achieving the highest estimation accuracy (MSE = $0.1634$), followed by the LSTM (MSE = $0.1752$), compared to MLE (MSE = $2.8032$). An ablation study further examines the effects of key hyperparameters on model performance. The proposed framework is also on two real-world high-frequency datasets, namely AAPL NBBO transaction data and Montgomery County 911 emergency call records. Using a predictive validation approach, event sequences simulated from the estimated parameters closely reproduce the empirical distribution, tail behavior, and temporal dependence structure of the observed data. These results demonstrate that Transformer-based parameter estimation provides an accurate and efficient alternative to conventional estimation techniques for FHP and offers a promising framework for modeling event-driven systems with long-memory dynamics.

Related papers

• Lecture notes on Machine Learning applications for global fits [0.0]
  This lecture notes provide a comprehensive framework for performing global statistical fits in high-energy physics using modern Machine Learning (ML) surrogates.<n>We begin by reviewing the statistical foundations of model building, including the likelihood function, Wilks' theorem, and profile likelihoods.<n>The notes detail a robust ML workflow including efficient generation of training data with active learning and Gaussian processes.
  arXiv  Detail & Related papers  (2026-04-08T18:53:02Z)
• NeuroMemFPP: A recurrent neural approach for memory-aware parameter estimation in fractional Poisson process [2.376995292379181]
  We propose a recurrent neural network (RNN)-based framework for estimating the parameters of the fractional Poisson process (FPP)<n>The Long Short-Term Memory (LSTM) network estimates the key parameters $>0$ and $in(0,1)$ from sequences of inter-arrival times.<n>Our experiments on synthetic data show that the proposed approach reduces the mean squared error (MSE) by about 55.3% compared to the traditional method of moments.
  arXiv  Detail & Related papers  (2025-12-05T17:14:07Z)
• Fast Likelihood-Free Parameter Estimation for Lévy Processes [0.0]
  We propose a fast and accurate method for L'evy parameter estimation using the neural Bayes estimation framework.<n>We show that NBE results in consistent estimators whose risk converges to the Bayes estimator under mild conditions.<n>We also investigate nearly a decade of high-frequency Bitcoin returns, requiring less than one minute to estimate parameters under the proposed approach.
  arXiv  Detail & Related papers  (2025-05-03T00:37:58Z)
• Multifidelity Simulation-based Inference for Computationally Expensive Simulators [7.065679767112407]
  We introduce MF-(TS)NPE, a multifidelity approach to neural posterior estimation that uses transfer learning to leverage inexpensive low-fidelity simulations.<n>We further improve simulation efficiency by introducing A-MF-TSNPE, a sequential variant that uses an acquisition function targeting the predictive uncertainty of the density estimator.
  arXiv  Detail & Related papers  (2025-02-12T13:59:22Z)
• Parameter Estimation of Long Memory Stochastic Processes with Deep Neural Networks [0.0]
  We present a purely deep neural network-based approach for estimating long memory parameters of time series models. Parameters, such as the Hurst exponent, are critical in characterizing the long-range dependence, roughness, and self-similarity of processes.
  arXiv  Detail & Related papers  (2024-10-03T03:14:58Z)
• Diffusion posterior sampling for simulation-based inference in tall data settings [53.17563688225137]
  Simulation-based inference ( SBI) is capable of approximating the posterior distribution that relates input parameters to a given observation. In this work, we consider a tall data extension in which multiple observations are available to better infer the parameters of the model. We compare our method to recently proposed competing approaches on various numerical experiments and demonstrate its superiority in terms of numerical stability and computational cost.
  arXiv  Detail & Related papers  (2024-04-11T09:23:36Z)
• Online Variational Sequential Monte Carlo [49.97673761305336]
  We build upon the variational sequential Monte Carlo (VSMC) method, which provides computationally efficient and accurate model parameter estimation and Bayesian latent-state inference. Online VSMC is capable of performing efficiently, entirely on-the-fly, both parameter estimation and particle proposal adaptation.
  arXiv  Detail & Related papers  (2023-12-19T21:45:38Z)
• Multi-Step Short-Term Wind Speed Prediction with Rank Pooling and Fast Fourier Transformation [0.0]
  Short-term wind speed prediction is essential for economical wind power utilization. The real-world wind speed data is typically intermittent and fluctuating, presenting great challenges to existing shallow models. We present a novel deep hybrid model for multi-step wind speed prediction, namely LR-FFT-RP-MLP/LSTM.
  arXiv  Detail & Related papers  (2022-11-23T14:02:52Z)
• FaDIn: Fast Discretized Inference for Hawkes Processes with General Parametric Kernels [82.53569355337586]
  This work offers an efficient solution to temporal point processes inference using general parametric kernels with finite support. The method's effectiveness is evaluated by modeling the occurrence of stimuli-induced patterns from brain signals recorded with magnetoencephalography (MEG) Results show that the proposed approach leads to an improved estimation of pattern latency than the state-of-the-art.
  arXiv  Detail & Related papers  (2022-10-10T12:35:02Z)
• Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm [62.997667081978825]
  We propose a computationally efficient and powerful Bayesian approach for sparse high-dimensional linear regression. Minimal prior assumptions on the parameters are used through the use of plug-in empirical Bayes estimates. The proposed approach is implemented in the R package probe.
  arXiv  Detail & Related papers  (2022-09-16T19:15:50Z)
• MoEfication: Conditional Computation of Transformer Models for Efficient Inference [66.56994436947441]
  Transformer-based pre-trained language models can achieve superior performance on most NLP tasks due to large parameter capacity, but also lead to huge computation cost. We explore to accelerate large-model inference by conditional computation based on the sparse activation phenomenon. We propose to transform a large model into its mixture-of-experts (MoE) version with equal model size, namely MoEfication.
  arXiv  Detail & Related papers  (2021-10-05T02:14:38Z)
• Transformer Hawkes Process [79.16290557505211]
  We propose a Transformer Hawkes Process (THP) model, which leverages the self-attention mechanism to capture long-term dependencies. THP outperforms existing models in terms of both likelihood and event prediction accuracy by a notable margin. We provide a concrete example, where THP achieves improved prediction performance for learning multiple point processes when incorporating their relational information.
  arXiv  Detail & Related papers  (2020-02-21T13:48:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.