Hawkes Process Based on Controlled Differential Equations

• URL: http://arxiv.org/abs/2305.07031v2
• Date: Thu, 18 May 2023 05:34:39 GMT
• Title: Hawkes Process Based on Controlled Differential Equations
• Authors: Minju Jo, Seungji Kook, Noseong Park
• Abstract summary: We present the concept of Hawkes process based on controlled differential equations (HP-CDE) In our experiments with 4 real-world datasets, our method outperforms existing methods by non-trivial margins.
• Score: 11.857457962241108
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Hawkes processes are a popular framework to model the occurrence of sequential events, i.e., occurrence dynamics, in several fields such as social diffusion. In real-world scenarios, the inter-arrival time among events is irregular. However, existing neural network-based Hawkes process models not only i) fail to capture such complicated irregular dynamics, but also ii) resort to heuristics to calculate the log-likelihood of events since they are mostly based on neural networks designed for regular discrete inputs. To this end, we present the concept of Hawkes process based on controlled differential equations (HP-CDE), by adopting the neural controlled differential equation (neural CDE) technology which is an analogue to continuous RNNs. Since HP-CDE continuously reads data, i) irregular time-series datasets can be properly treated preserving their uneven temporal spaces, and ii) the log-likelihood can be exactly computed. Moreover, as both Hawkes processes and neural CDEs are first developed to model complicated human behavioral dynamics, neural CDE-based Hawkes processes are successful in modeling such occurrence dynamics. In our experiments with 4 real-world datasets, our method outperforms existing methods by non-trivial margins.

Related papers

• Trajectory Flow Matching with Applications to Clinical Time Series Modeling [77.58277281319253]
  Trajectory Flow Matching (TFM) trains a Neural SDE in a simulation-free manner, bypassing backpropagation through the dynamics. We demonstrate improved performance on three clinical time series datasets in terms of absolute performance and uncertainty prediction.
  arXiv  Detail & Related papers  (2024-10-28T15:54:50Z)
• Physics-Informed Variational State-Space Gaussian Processes [23.57905861783904]
  We introduce a variational-temporal state-temporal GP that handles linear and non-linear physical constraints while achieving efficient linear-in-time costs. We demonstrate our methods in a range of synthetic and real-world settings and outperform the current state-of-the-art in both predictive and computational performance.
  arXiv  Detail & Related papers  (2024-09-20T20:12:11Z)
• Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems [2.170477444239546]
  We develop an approach that balances these two objectives: the Gaussian Process Switching Linear Dynamical System (gpSLDS) Our method builds on previous work modeling the latent state evolution via a differential equation whose nonlinear dynamics are described by a Gaussian process (GP-SDEs) Our approach resolves key limitations of the rSLDS such as artifactual oscillations in dynamics near discrete state boundaries, while also providing posterior uncertainty estimates of the dynamics.
  arXiv  Detail & Related papers  (2024-07-19T15:32:15Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• Cox-Hawkes: doubly stochastic spatiotemporal Poisson processes [2.6599014990168834]
  We develop a new class of inference Hawkes processes that can both trigger and clustering and behavior we provide an efficient method for performing inference. We show the efficacy and flexibility of our approach in experiments on simulated data and use our methods to uncover the trends in a dataset of reported crimes in the US.
  arXiv  Detail & Related papers  (2022-10-21T09:47:34Z)
• FaDIn: Fast Discretized Inference for Hawkes Processes with General Parametric Kernels [82.53569355337586]
  This work offers an efficient solution to temporal point processes inference using general parametric kernels with finite support. The method's effectiveness is evaluated by modeling the occurrence of stimuli-induced patterns from brain signals recorded with magnetoencephalography (MEG) Results show that the proposed approach leads to an improved estimation of pattern latency than the state-of-the-art.
  arXiv  Detail & Related papers  (2022-10-10T12:35:02Z)
• Dynamic Hawkes Processes for Discovering Time-evolving Communities' States behind Diffusion Processes [57.22860407362061]
  We propose a novel Hawkes process model that is able to capture the underlying dynamics of community states behind the diffusion processes. The proposed method, termed DHP, offers a flexible way to learn complex representations of the time-evolving communities' states.
  arXiv  Detail & Related papers  (2021-05-24T08:35:48Z)
• Neural ODE Processes [64.10282200111983]
  We introduce Neural ODE Processes (NDPs), a new class of processes determined by a distribution over Neural ODEs. We show that our model can successfully capture the dynamics of low-dimensional systems from just a few data-points.
  arXiv  Detail & Related papers  (2021-03-23T09:32:06Z)
• Modeling of Spatio-Temporal Hawkes Processes with Randomized Kernels [15.556686221927501]
  Inferring the dynamics of event processes hasly practical applications including crime prediction, and traffic forecasting. We introduce on social-temporal Hawkes processes that are commonly used due to their capability to capture excitations between event occurrences. We replace the spatial kernel calculations by randomized transformations and gradient descent to learn the process.
  arXiv  Detail & Related papers  (2020-03-07T22:21:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.