The statistical physics of discovering exogenous and endogenous factors
in a chain of events
- URL: http://arxiv.org/abs/2003.00659v1
- Date: Mon, 2 Mar 2020 04:55:41 GMT
- Title: The statistical physics of discovering exogenous and endogenous factors
in a chain of events
- Authors: Shinsuke Koyama and Shigeru Shinomoto
- Abstract summary: We develop a method for estimating such extrinsic and intrinsic factors from a single series of event-occurrence times.
The analysis is performed using a model that combines the inhomogeneous Poisson process and the Hawkes process.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Event occurrence is not only subject to the environmental changes, but is
also facilitated by the events that have occurred in a system. Here, we develop
a method for estimating such extrinsic and intrinsic factors from a single
series of event-occurrence times. The analysis is performed using a model that
combines the inhomogeneous Poisson process and the Hawkes process, which
represent exogenous fluctuations and endogenous chain-reaction mechanisms,
respectively. The model is fit to a given dataset by minimizing the free
energy, for which statistical physics and a path-integral method are utilized.
Because the process of event occurrence is stochastic, parameter estimation is
inevitably accompanied by errors, and it can ultimately occur that exogenous
and endogenous factors cannot be captured even with the best estimator. We
obtained four regimes categorized according to whether respective factors are
detected. By applying the analytical method to real time series of debate in a
social-networking service, we have observed that the estimated exogenous and
endogenous factors are close to the first comments and the follow-up comments,
respectively. This method is general and applicable to a variety of data, and
we have provided an application program, by which anyone can analyze any series
of event times.
Related papers
- Logistic-beta processes for dependent random probabilities with beta marginals [58.91121576998588]
We propose a novel process called the logistic-beta process, whose logistic transformation yields a process with common beta marginals.
It can model dependence on both discrete and continuous domains, such as space or time, and has a flexible dependence structure through correlation kernels.
We illustrate the benefits through nonparametric binary regression and conditional density estimation examples, both in simulation studies and in a pregnancy outcome application.
arXiv Detail & Related papers (2024-02-10T21:41:32Z) - Causal inference for the expected number of recurrent events in the
presence of a terminal event [0.0]
We study causal inference and efficient estimation for the expected number of recurrent events in the presence of a terminal event.
No absolute continuity assumption is made on the underlying probability distributions of failure, censoring, or the observed data.
arXiv Detail & Related papers (2023-06-28T21:31:25Z) - Semi-Parametric Inference for Doubly Stochastic Spatial Point Processes: An Approximate Penalized Poisson Likelihood Approach [3.085995273374333]
Doubly-stochastic point processes model the occurrence of events over a spatial domain as an inhomogeneous process conditioned on the realization of a random intensity function.
Existing implementations of doubly-stochastic spatial models are computationally demanding, often have limited theoretical guarantee, and/or rely on restrictive assumptions.
arXiv Detail & Related papers (2023-06-11T19:48:39Z) - Variational Neural Temporal Point Process [22.396329275957996]
A temporal point process is a process that predicts which type of events is likely to happen and when the event will occur.
We introduce the inference and the generative networks, and train a distribution of latent variable to deal with property on deep neural network.
We empirically demonstrate that our model can generalize the representations of various event types.
arXiv Detail & Related papers (2022-02-17T13:34:30Z) - Variance Minimization in the Wasserstein Space for Invariant Causal
Prediction [72.13445677280792]
In this work, we show that the approach taken in ICP may be reformulated as a series of nonparametric tests that scales linearly in the number of predictors.
Each of these tests relies on the minimization of a novel loss function that is derived from tools in optimal transport theory.
We prove under mild assumptions that our method is able to recover the set of identifiable direct causes, and we demonstrate in our experiments that it is competitive with other benchmark causal discovery algorithms.
arXiv Detail & Related papers (2021-10-13T22:30:47Z) - Discovering Latent Causal Variables via Mechanism Sparsity: A New
Principle for Nonlinear ICA [81.4991350761909]
Independent component analysis (ICA) refers to an ensemble of methods which formalize this goal and provide estimation procedure for practical application.
We show that the latent variables can be recovered up to a permutation if one regularizes the latent mechanisms to be sparse.
arXiv Detail & Related papers (2021-07-21T14:22:14Z) - BayesIMP: Uncertainty Quantification for Causal Data Fusion [52.184885680729224]
We study the causal data fusion problem, where datasets pertaining to multiple causal graphs are combined to estimate the average treatment effect of a target variable.
We introduce a framework which combines ideas from probabilistic integration and kernel mean embeddings to represent interventional distributions in the reproducing kernel Hilbert space.
arXiv Detail & Related papers (2021-06-07T10:14:18Z) - Counterfactual Inference of the Mean Outcome under a Convergence of
Average Logging Probability [5.596752018167751]
This paper considers estimating the mean outcome of an action from samples obtained in adaptive experiments.
In adaptive experiments, the probability of choosing an action is allowed to be sequentially updated based on past observations.
arXiv Detail & Related papers (2021-02-17T19:05:53Z) - Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
Inferring the parameters of a model based on experimental observations is central to the scientific method.
A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations.
We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
arXiv Detail & Related papers (2021-02-12T12:23:13Z) - Enabling Counterfactual Survival Analysis with Balanced Representations [64.17342727357618]
Survival data are frequently encountered across diverse medical applications, i.e., drug development, risk profiling, and clinical trials.
We propose a theoretically grounded unified framework for counterfactual inference applicable to survival outcomes.
arXiv Detail & Related papers (2020-06-14T01:15:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.