Ricci flow-guided autoencoders in learning time-dependent dynamics

• URL: http://arxiv.org/abs/2401.14591v8
• Date: Sun, 7 Jul 2024 06:10:41 GMT
• Title: Ricci flow-guided autoencoders in learning time-dependent dynamics
• Authors: Andrew Gracyk,
• Abstract summary: We present a manifold-based autoencoder method for learning dynamics in time, notably partial differential equations (PDEs) This can be accomplished by simulating Ricci flow in a physics-informed setting, and manifold quantities can be matched so that Ricci flow is empirically achieved. We present our method on a range of experiments consisting of PDE data that encompasses desirable characteristics such as periodicity and randomness.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a manifold-based autoencoder method for learning dynamics in time, notably partial differential equations (PDEs), in which the manifold latent space evolves according to Ricci flow. This can be accomplished by simulating Ricci flow in a physics-informed setting, and manifold quantities can be matched so that Ricci flow is empirically achieved. With our method, the manifold is discerned through the training procedure, while the latent evolution due to Ricci flow induces a more accommodating representation over static methods. We present our method on a range of experiments consisting of PDE data that encompasses desirable characteristics such as periodicity and randomness. By incorporating latent dynamics, we sustain a manifold latent representation for all values in the ambient PDE time interval. Furthermore, the dynamical manifold latent space facilitates qualities such as learning for out-of-distribution data, and robustness. We showcase our method by demonstrating these features.

Related papers

• Variational autoencoders with latent high-dimensional steady geometric flows for dynamics [0.0]
  We develop approaches to variational autoencoders (VAEs) for PDE-type ambient data with regularizing geometric latent dynamics. We redevelop the VAE framework such that manifold geometries, subject to our geometric flow, are learned in the intermediary latent space developed by encoders and decoders. We demonstrate, on our datasets of interest, our methods perform at least as well as the traditional VAE, and oftentimes better.
  arXiv  Detail & Related papers  (2024-10-14T04:07:45Z)
• Data-driven ODE modeling of the high-frequency complex dynamics of a fluid flow [0.0]
  We propose a novel method of modeling such dynamics, including the high-frequency intermittent behavior of a fluid flow. We construct an autonomous joint model composed of two parts: the first is an autonomous system of a base variable, and the other concerns the targeted variable being affected by a term. The constructed joint model succeeded in not only inferring a short trajectory but also reconstructing chaotic sets and statistical properties obtained from a long trajectory.
  arXiv  Detail & Related papers  (2024-09-01T09:06:32Z)
• On the Trajectory Regularity of ODE-based Diffusion Sampling [79.17334230868693]
  Diffusion-based generative models use differential equations to establish a smooth connection between a complex data distribution and a tractable prior distribution. In this paper, we identify several intriguing trajectory properties in the ODE-based sampling process of diffusion models.
  arXiv  Detail & Related papers  (2024-05-18T15:59:41Z)
• DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models [58.450152413700586]
  We introduce a soft absorbing state that facilitates the diffusion model in learning to reconstruct discrete mutations based on the underlying Gaussian space. We employ state-of-the-art ODE solvers within the continuous space to expedite the sampling process. Our proposed method effectively accelerates the training convergence by 4x and generates samples of similar quality 800x faster.
  arXiv  Detail & Related papers  (2023-10-09T15:29:10Z)
• A Geometric Perspective on Diffusion Models [57.27857591493788]
  We inspect the ODE-based sampling of a popular variance-exploding SDE. We establish a theoretical relationship between the optimal ODE-based sampling and the classic mean-shift (mode-seeking) algorithm.
  arXiv  Detail & Related papers  (2023-05-31T15:33:16Z)
• Free-Form Variational Inference for Gaussian Process State-Space Models [21.644570034208506]
  We propose a new method for inference in Bayesian GPSSMs. Our method is based on freeform variational inference via inducing Hamiltonian Monte Carlo. We show that our approach can learn transition dynamics and latent states more accurately than competing methods.
  arXiv  Detail & Related papers  (2023-02-20T11:34:16Z)
• Guaranteed Conservation of Momentum for Learning Particle-based Fluid Dynamics [96.9177297872723]
  We present a novel method for guaranteeing linear momentum in learned physics simulations. We enforce conservation of momentum with a hard constraint, which we realize via antisymmetrical continuous convolutional layers. In combination, the proposed method allows us to increase the physical accuracy of the learned simulator substantially.
  arXiv  Detail & Related papers  (2022-10-12T09:12:59Z)
• Manifold Interpolating Optimal-Transport Flows for Trajectory Inference [64.94020639760026]
  We present a method called Manifold Interpolating Optimal-Transport Flow (MIOFlow) MIOFlow learns, continuous population dynamics from static snapshot samples taken at sporadic timepoints. We evaluate our method on simulated data with bifurcations and merges, as well as scRNA-seq data from embryoid body differentiation, and acute myeloid leukemia treatment.
  arXiv  Detail & Related papers  (2022-06-29T22:19:03Z)
• Learning Effective SDEs from Brownian Dynamics Simulations of Colloidal Particles [0.0]
  We use Diffusion Maps (a manifold learning algorithm) to identify a set of useful latent observables. We show that the obtained variables and the learned dynamics accurately encode physics of the Brownian Dynamic Simulations. Our dimension reduction/reduced model identification approach can be easily ported to a broad class of particle systems dynamics experiments/models.
  arXiv  Detail & Related papers  (2022-04-30T14:58:25Z)
• A Kernel Learning Method for Backward SDE Filter [1.7035011973665108]
  We develop a kernel learning backward SDE filter method to propagate the state of a dynamical system based on its partial noisy observations. We introduce a kernel learning method to learn a continuous global approximation for the conditional probability density function of the target state. Numerical experiments demonstrate that the kernel learning backward SDE is highly effective and highly efficient.
  arXiv  Detail & Related papers  (2022-01-25T19:49:19Z)
• Dynamic Mode Decomposition in Adaptive Mesh Refinement and Coarsening Simulations [58.720142291102135]
  Dynamic Mode Decomposition (DMD) is a powerful data-driven method used to extract coherent schemes. This paper proposes a strategy to enable DMD to extract from observations with different mesh topologies and dimensions.
  arXiv  Detail & Related papers  (2021-04-28T22:14:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.