Online Centralized Non-parametric Change-point Detection via Graph-based
Likelihood-ratio Estimation
- URL: http://arxiv.org/abs/2301.03011v2
- Date: Thu, 12 Jan 2023 08:51:25 GMT
- Title: Online Centralized Non-parametric Change-point Detection via Graph-based
Likelihood-ratio Estimation
- Authors: Alejandro de la Concha and Argyris Kalogeratos and Nicolas Vayatis
- Abstract summary: Consider each node of a graph to be generating a data stream that is synchronized and observed at near real-time.
At a change-point $tau$, a change occurs at a subset of nodes $C$, which affects the probability distribution of their associated node streams.
We propose a novel kernel-based method to both detect $tau$ and localize $C$, based on the direct estimation of the likelihood-ratio between the post-change and the pre-change distributions of the node streams.
- Score: 77.81487285123147
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Consider each node of a graph to be generating a data stream that is
synchronized and observed at near real-time. At a change-point $\tau$, a change
occurs at a subset of nodes $C$, which affects the probability distribution of
their associated node streams. In this paper, we propose a novel kernel-based
method to both detect $\tau$ and localize $C$, based on the direct estimation
of the likelihood-ratio between the post-change and the pre-change
distributions of the node streams. Our main working hypothesis is the
smoothness of the likelihood-ratio estimates over the graph, i.e connected
nodes are expected to have similar likelihood-ratios. The quality of the
proposed method is demonstrated on extensive experiments on synthetic
scenarios.
Related papers
- GNN-LoFI: a Novel Graph Neural Network through Localized Feature-based
Histogram Intersection [51.608147732998994]
Graph neural networks are increasingly becoming the framework of choice for graph-based machine learning.
We propose a new graph neural network architecture that substitutes classical message passing with an analysis of the local distribution of node features.
arXiv Detail & Related papers (2024-01-17T13:04:23Z) - Backward and Forward Inference in Interacting Independent-Cascade
Processes: A Scalable and Convergent Message-Passing Approach [1.1470070927586018]
We study the problems of estimating the past and future evolutions of two diffusion processes that spread concurrently on a network.
We derive the exact joint probability of the initial state of the network and the observation-snapshot $mathcalO_n$.
arXiv Detail & Related papers (2023-10-29T20:03:38Z) - Collaborative likelihood-ratio estimation over graphs [55.98760097296213]
Graph-based Relative Unconstrained Least-squares Importance Fitting (GRULSIF)
We develop this idea in a concrete non-parametric method that we call Graph-based Relative Unconstrained Least-squares Importance Fitting (GRULSIF)
We derive convergence rates for our collaborative approach that highlights the role played by variables such as the number of available observations per node, the size of the graph, and how accurately the graph structure encodes the similarity between tasks.
arXiv Detail & Related papers (2022-05-28T15:37:03Z) - Data-heterogeneity-aware Mixing for Decentralized Learning [63.83913592085953]
We characterize the dependence of convergence on the relationship between the mixing weights of the graph and the data heterogeneity across nodes.
We propose a metric that quantifies the ability of a graph to mix the current gradients.
Motivated by our analysis, we propose an approach that periodically and efficiently optimize the metric.
arXiv Detail & Related papers (2022-04-13T15:54:35Z) - Online non-parametric change-point detection for heterogeneous data
streams observed over graph nodes [79.94639436527454]
We propose an online non-parametric method to infer $tau$ based on the direct estimation of the likelihood-ratio between the post-change and the pre-change distribution associated with the data stream of each node.
We demonstrate the quality of our method on synthetic experiments and real-world applications.
arXiv Detail & Related papers (2021-10-20T12:10:15Z) - Learning Representations using Spectral-Biased Random Walks on Graphs [18.369974607582584]
We study how much a probabilistic bias in this process affects the quality of the nodes picked by the process.
We succinctly capture this neighborhood as a probability measure based on the spectrum of the node's neighborhood subgraph represented as a normalized laplacian matrix.
We empirically evaluate our approach against several state-of-the-art node embedding techniques on a wide variety of real-world datasets.
arXiv Detail & Related papers (2020-05-19T20:42:43Z) - Fully Asynchronous Policy Evaluation in Distributed Reinforcement
Learning over Networks [14.636457985379746]
This paper proposes a emphfully asynchronous scheme for the policy evaluation problem of distributed reinforcement learning (DisRL) over directed peer-to-peer networks.
Without waiting for any other node of the network, each node can locally update its value function at any time by using (possibly delayed) information from its neighbors.
arXiv Detail & Related papers (2020-03-01T08:12:08Z) - Block-Approximated Exponential Random Graphs [77.4792558024487]
An important challenge in the field of exponential random graphs (ERGs) is the fitting of non-trivial ERGs on large graphs.
We propose an approximative framework to such non-trivial ERGs that result in dyadic independence (i.e., edge independent) distributions.
Our methods are scalable to sparse graphs consisting of millions of nodes.
arXiv Detail & Related papers (2020-02-14T11:42:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.