Ensemble Recognition in Reproducing Kernel Hilbert Spaces through
Aggregated Measurements
- URL: http://arxiv.org/abs/2112.14307v1
- Date: Tue, 28 Dec 2021 22:04:03 GMT
- Title: Ensemble Recognition in Reproducing Kernel Hilbert Spaces through
Aggregated Measurements
- Authors: Wei Miao, Jr-Shin Li
- Abstract summary: We study the problem of learning dynamical properties of ensemble systems from their collective behaviors using statistical approaches in reproducing kernel Hilbert space (RKHS)
We provide a framework to identify and cluster multiple ensemble systems through computing the maximum mean discrepancy (MMD) between their aggregated measurements in an RKHS.
We demonstrate that the proposed approaches can be extended to cluster multiple unknown ensembles in RKHS using their aggregated measurements.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we study the problem of learning dynamical properties of
ensemble systems from their collective behaviors using statistical approaches
in reproducing kernel Hilbert space (RKHS). Specifically, we provide a
framework to identify and cluster multiple ensemble systems through computing
the maximum mean discrepancy (MMD) between their aggregated measurements in an
RKHS, without any prior knowledge of the system dynamics of ensembles. Then,
leveraging on a gradient flow of the newly proposed notion of aggregated Markov
parameters, we present a systematic framework to recognize and identify an
ensemble systems using their linear approximations. Finally, we demonstrate
that the proposed approaches can be extended to cluster multiple unknown
ensembles in RKHS using their aggregated measurements. Numerical experiments
show that our approach is reliable and robust to ensembles with different types
of system dynamics.
Related papers
- Macroscopic theory of multipartite correlations in permutation-invariant open quantum systems [0.0]
We present a method to determine the macroscopic behavior of the steady-state multipartite mutual information between $N$ interacting units undergoing Markovian evolution.<n>We extend a conclusion previously drawn for classical systems that the extensive scaling of mutual information is either not possible for systems relaxing to fixed points of the mean-field dynamics or such scaling is not robust to perturbations of system dynamics.
arXiv Detail & Related papers (2025-06-27T11:00:15Z) - Two-dimensional correlation propagation dynamics with a cluster discrete phase-space method [0.0]
Nonequilibrium dynamics of highly-controlled quantum systems is a challenging issue in statistical physics.
We develop a discrete phase-space approach for general SU($N$) spin systems.
We numerically demonstrate that the cluster discrete truncated Wigner approximation can reproduce key results in a recent experiment.
arXiv Detail & Related papers (2024-04-29T11:08:44Z) - A VAE-based Framework for Learning Multi-Level Neural Granger-Causal
Connectivity [15.295157876811066]
This paper introduces a Variational Autoencoder based framework that jointly learns Granger-causal relationships amongst components in a collection of related-yet-heterogeneous dynamical systems.
The performance of the proposed framework is evaluated on several synthetic data settings and benchmarked against existing approaches designed for individual system learning.
arXiv Detail & Related papers (2024-02-25T16:11:32Z) - Response Theory via Generative Score Modeling [0.0]
We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Generalized Fluctuation-Dissipation Theorem (GFDT)
The methodology enables accurate estimation of system responses, including those with non-Gaussian statistics.
arXiv Detail & Related papers (2024-02-01T21:38:10Z) - Mixture of multilayer stochastic block models for multiview clustering [0.0]
We propose an original method for aggregating multiple clustering coming from different sources of information.
The identifiability of the model parameters is established and a variational Bayesian EM algorithm is proposed for the estimation of these parameters.
The method is utilized to analyze global food trading networks, leading to structures of interest.
arXiv Detail & Related papers (2024-01-09T17:15:47Z) - Causal Temporal Regime Structure Learning [49.77103348208835]
We introduce a new optimization-based method (linear) that concurrently learns the Directed Acyclic Graph (DAG) for each regime.
We conduct extensive experiments and show that our method consistently outperforms causal discovery models across various settings.
arXiv Detail & Related papers (2023-11-02T17:26:49Z) - Distributionally Robust Model-based Reinforcement Learning with Large
State Spaces [55.14361269378122]
Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment.
We study distributionally robust Markov decision processes with continuous state spaces under the widely used Kullback-Leibler, chi-square, and total variation uncertainty sets.
We propose a model-based approach that utilizes Gaussian Processes and the maximum variance reduction algorithm to efficiently learn multi-output nominal transition dynamics.
arXiv Detail & Related papers (2023-09-05T13:42:11Z) - Witnessing environment dimension through temporal correlations [0.0]
We compute non-trivial bounds for sequences involving a qubit system and a qubit environment.
Our results provide a numerically tractable method to determine bounds on multi-time probability distributions in open quantum system dynamics.
arXiv Detail & Related papers (2023-05-30T16:18:22Z) - Learning Personalized Models with Clustered System Identification [4.422315636150272]
We address the problem of learning linear system models from observing multiple trajectories from different system dynamics.
We present an algorithm where each system alternately estimates its cluster identity and performs an estimation of its dynamics.
arXiv Detail & Related papers (2023-04-03T22:06:49Z) - Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations [114.17826109037048]
Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning.
theoretical aspects, e.g., identifiability and properties of statistical estimation are still obscure.
This paper derives a sufficient condition for the identifiability of homogeneous linear ODE systems from a sequence of equally-spaced error-free observations sampled from a single trajectory.
arXiv Detail & Related papers (2022-10-12T06:46:38Z) - Structure-Preserving Learning Using Gaussian Processes and Variational
Integrators [62.31425348954686]
We propose the combination of a variational integrator for the nominal dynamics of a mechanical system and learning residual dynamics with Gaussian process regression.
We extend our approach to systems with known kinematic constraints and provide formal bounds on the prediction uncertainty.
arXiv Detail & Related papers (2021-12-10T11:09:29Z) - Kernel learning approaches for summarising and combining posterior
similarity matrices [68.8204255655161]
We build upon the notion of the posterior similarity matrix (PSM) in order to suggest new approaches for summarising the output of MCMC algorithms for Bayesian clustering models.
A key contribution of our work is the observation that PSMs are positive semi-definite, and hence can be used to define probabilistically-motivated kernel matrices.
arXiv Detail & Related papers (2020-09-27T14:16:14Z) - A Kernel-Based Approach to Non-Stationary Reinforcement Learning in
Metric Spaces [53.47210316424326]
KeRNS is an algorithm for episodic reinforcement learning in non-stationary Markov Decision Processes.
We prove a regret bound that scales with the covering dimension of the state-action space and the total variation of the MDP with time.
arXiv Detail & Related papers (2020-07-09T21:37:13Z) - Stable and consistent density-based clustering via multiparameter
persistence [77.34726150561087]
We consider the degree-Rips construction from topological data analysis.
We analyze its stability to perturbations of the input data using the correspondence-interleaving distance.
We integrate these methods into a pipeline for density-based clustering, which we call Persistable.
arXiv Detail & Related papers (2020-05-18T19:45:04Z) - ClusterVO: Clustering Moving Instances and Estimating Visual Odometry
for Self and Surroundings [54.33327082243022]
ClusterVO is a stereo Visual Odometry which simultaneously clusters and estimates the motion of both ego and surrounding rigid clusters/objects.
Unlike previous solutions relying on batch input or imposing priors on scene structure or dynamic object models, ClusterVO is online, general and thus can be used in various scenarios including indoor scene understanding and autonomous driving.
arXiv Detail & Related papers (2020-03-29T09:06:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.