Coarse-grained and emergent distributed parameter systems from data
- URL: http://arxiv.org/abs/2011.08138v2
- Date: Tue, 17 Nov 2020 02:32:05 GMT
- Title: Coarse-grained and emergent distributed parameter systems from data
- Authors: Hassan Arbabi, Felix P. Kemeth, Tom Bertalan and Ioannis Kevrekidis
- Abstract summary: We derivation of PDEs from computation system data.
In particular, we focus here on the use of manifold learning techniques.
We demonstrate each approach through an established PDE example.
- Score: 0.6117371161379209
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: We explore the derivation of distributed parameter system evolution laws (and
in particular, partial differential operators and associated partial
differential equations, PDEs) from spatiotemporal data. This is, of course, a
classical identification problem; our focus here is on the use of manifold
learning techniques (and, in particular, variations of Diffusion Maps) in
conjunction with neural network learning algorithms that allow us to attempt
this task when the dependent variables, and even the independent variables of
the PDE are not known a priori and must be themselves derived from the data.
The similarity measure used in Diffusion Maps for dependent coarse variable
detection involves distances between local particle distribution observations;
for independent variable detection we use distances between local short-time
dynamics. We demonstrate each approach through an illustrative established PDE
example. Such variable-free, emergent space identification algorithms connect
naturally with equation-free multiscale computation tools.
Related papers
- A hybrid FEM-PINN method for time-dependent partial differential equations [9.631238071993282]
We present a hybrid numerical method for solving evolution differential equations (PDEs) by merging the time finite element method with deep neural networks.
The advantages of such a hybrid formulation are twofold: statistical errors are avoided for the integral in the time direction, and the neural network's output can be regarded as a set of reduced spatial basis functions.
arXiv Detail & Related papers (2024-09-04T15:28:25Z) - Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - On the Trajectory Regularity of ODE-based Diffusion Sampling [79.17334230868693]
Diffusion-based generative models use differential equations to establish a smooth connection between a complex data distribution and a tractable prior distribution.
In this paper, we identify several intriguing trajectory properties in the ODE-based sampling process of diffusion models.
arXiv Detail & Related papers (2024-05-18T15:59:41Z) - Estimating the Distribution of Parameters in Differential Equations with Repeated Cross-Sectional Data [5.79648227233365]
In economy, politics, and biology, observation data points in the time series are often independently obtained.
Traditional methods for parameter estimation in differential equations have limitations in estimating the shape of parameter distributions.
We introduce a novel method, Estimation of.
EPD, providing accurate distribution of parameters without loss of data information.
arXiv Detail & Related papers (2024-04-23T10:01:43Z) - DynGMA: a robust approach for learning stochastic differential equations from data [13.858051019755283]
We introduce novel approximations to the transition density of the parameterized SDE.
Our method exhibits superior accuracy compared to baseline methods in learning the fully unknown drift diffusion functions.
It is capable of handling data with low time resolution and variable, even uncontrollable, time step sizes.
arXiv Detail & Related papers (2024-02-22T12:09:52Z) - HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly
Detection [2.253268952202213]
We propose a novel semi-supervised anomaly detection framework based on a heterogeneous feature network (HFN) for MTS.
We first combine the embedding similarity subgraph generated by sensor embedding and feature value similarity subgraph generated by sensor values to construct a time-series heterogeneous graph.
This approach fuses the state-of-the-art technologies of heterogeneous graph structure learning (HGSL) and representation learning.
arXiv Detail & Related papers (2022-11-01T05:01:34Z) - Differentiable Invariant Causal Discovery [106.87950048845308]
Learning causal structure from observational data is a fundamental challenge in machine learning.
This paper proposes Differentiable Invariant Causal Discovery (DICD) to avoid learning spurious edges and wrong causal directions.
Extensive experiments on synthetic and real-world datasets verify that DICD outperforms state-of-the-art causal discovery methods up to 36% in SHD.
arXiv Detail & Related papers (2022-05-31T09:29:07Z) - Equivariance Discovery by Learned Parameter-Sharing [153.41877129746223]
We study how to discover interpretable equivariances from data.
Specifically, we formulate this discovery process as an optimization problem over a model's parameter-sharing schemes.
Also, we theoretically analyze the method for Gaussian data and provide a bound on the mean squared gap between the studied discovery scheme and the oracle scheme.
arXiv Detail & Related papers (2022-04-07T17:59:19Z) - On the Kullback-Leibler divergence between pairwise isotropic
Gaussian-Markov random fields [93.35534658875731]
We derive expressions for the Kullback-Leibler divergence between two pairwise isotropic Gaussian-Markov random fields.
The proposed equation allows the development of novel similarity measures in image processing and machine learning applications.
arXiv Detail & Related papers (2022-03-24T16:37:24Z) - Decentralized Local Stochastic Extra-Gradient for Variational
Inequalities [125.62877849447729]
We consider distributed variational inequalities (VIs) on domains with the problem data that is heterogeneous (non-IID) and distributed across many devices.
We make a very general assumption on the computational network that covers the settings of fully decentralized calculations.
We theoretically analyze its convergence rate in the strongly-monotone, monotone, and non-monotone settings.
arXiv Detail & Related papers (2021-06-15T17:45:51Z) - Learning emergent PDEs in a learned emergent space [0.6157382820537719]
We learn predictive models in the form of partial differential equations (PDEs) for the collective description of a coupled-agent system.
We show that the collective dynamics on a slow manifold can be approximated through a learned model based on local "spatial" partial derivatives in the emergent coordinates.
The proposed approach thus integrates the automatic, data-driven extraction of emergent space coordinates parametrizing the agent dynamics.
arXiv Detail & Related papers (2020-12-23T15:17:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.