PolyNODE: Variable-dimension Neural ODEs on M-polyfolds

• URL: http://arxiv.org/abs/2602.15128v1
• Date: Mon, 16 Feb 2026 19:11:06 GMT
• Title: PolyNODE: Variable-dimension Neural ODEs on M-polyfolds
• Authors: Per Åhag, Alexander Friedrich, Fredrik Ohlsson, Viktor Vigren Näslund,
• Abstract summary: We introduce PolyNODEs, the first variable-dimensional flow-based model in geometric deep learning.<n>We demonstrate experimentally that our PolyNODE models can be trained to solve reconstruction tasks in these spaces.
• Score: 39.911832164395285
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Neural ordinary differential equations (NODEs) are geometric deep learning models based on dynamical systems and flows generated by vector fields on manifolds. Despite numerous successful applications, particularly within the flow matching paradigm, all existing NODE models are fundamentally constrained to fixed-dimensional dynamics by the intrinsic nature of the manifold's dimension. In this paper, we extend NODEs to M-polyfolds (spaces that can simultaneously accommodate varying dimensions and a notion of differentiability) and introduce PolyNODEs, the first variable-dimensional flow-based model in geometric deep learning. As an example application, we construct explicit M-polyfolds featuring dimensional bottlenecks and PolyNODE autoencoders based on parametrised vector fields that traverse these bottlenecks. We demonstrate experimentally that our PolyNODE models can be trained to solve reconstruction tasks in these spaces, and that latent representations of the input can be extracted and used to solve downstream classification tasks. The code used in our experiments is publicly available at https://github.com/turbotage/PolyNODE .

Related papers

• AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fields [14.219495227765671]
  We present AROMA, a framework designed to enhance the modeling of partial differential equations (PDEs) using local neural fields. Our flexible encoder-decoder architecture can obtain smooth latent representations of spatial physical fields from a variety of data types. By employing a diffusion-based formulation, we achieve greater stability and enable longer rollouts compared to conventional MSE training.
  arXiv  Detail & Related papers  (2024-06-04T10:12:09Z)
• Geometric Neural Diffusion Processes [55.891428654434634]
  We extend the framework of diffusion models to incorporate a series of geometric priors in infinite-dimension modelling. We show that with these conditions, the generative functional model admits the same symmetry.
  arXiv  Detail & Related papers  (2023-07-11T16:51:38Z)
• VTAE: Variational Transformer Autoencoder with Manifolds Learning [144.0546653941249]
  Deep generative models have demonstrated successful applications in learning non-linear data distributions through a number of latent variables. The nonlinearity of the generator implies that the latent space shows an unsatisfactory projection of the data space, which results in poor representation learning. We show that geodesics and accurate computation can substantially improve the performance of deep generative models.
  arXiv  Detail & Related papers  (2023-04-03T13:13:19Z)
• Solving High-Dimensional PDEs with Latent Spectral Models [74.1011309005488]
  We present Latent Spectral Models (LSM) toward an efficient and precise solver for high-dimensional PDEs. Inspired by classical spectral methods in numerical analysis, we design a neural spectral block to solve PDEs in the latent space. LSM achieves consistent state-of-the-art and yields a relative gain of 11.5% averaged on seven benchmarks.
  arXiv  Detail & Related papers  (2023-01-30T04:58:40Z)
• Data-driven modelling of nonlinear dynamics by polytope projections and memory [0.0]
  We present a numerical method to model dynamical systems from data. We project points from a Euclidean space to convex polytopes and represent these projected states of a system in new, lower-dimensional coordinates. We then introduce a specific nonlinear transformation to construct a model of the dynamics in the polytope and to transform back into the original state space.
  arXiv  Detail & Related papers  (2021-12-13T15:49:36Z)
• Continuous normalizing flows on manifolds [0.342658286826597]
  We describe how the recently introduced Neural ODEs and continuous normalizing flows can be extended to arbitrary smooth manifold. We propose a general methodology for parameterizing vector fields on these spaces and demonstrate how gradient-based learning can be performed.
  arXiv  Detail & Related papers  (2021-03-14T15:35:19Z)
• A Differential Geometry Perspective on Orthogonal Recurrent Models [56.09491978954866]
  We employ tools and insights from differential geometry to offer a novel perspective on orthogonal RNNs. We show that orthogonal RNNs may be viewed as optimizing in the space of divergence-free vector fields. Motivated by this observation, we study a new recurrent model, which spans the entire space of vector fields.
  arXiv  Detail & Related papers  (2021-02-18T19:39:22Z)
• ResNet-LDDMM: Advancing the LDDMM Framework Using Deep Residual Networks [86.37110868126548]
  In this work, we make use of deep residual neural networks to solve the non-stationary ODE (flow equation) based on a Euler's discretization scheme. We illustrate these ideas on diverse registration problems of 3D shapes under complex topology-preserving transformations.
  arXiv  Detail & Related papers  (2021-02-16T04:07:13Z)
• Neural Manifold Ordinary Differential Equations [46.25832801867149]
  We introduce Neural Manifold Ordinary Differential Equations, which enables the construction of Manifold Continuous Normalizing Flows (MCNFs) MCNFs require only local geometry and compute probabilities with continuous change of variables. We find that leveraging continuous manifold dynamics produces a marked improvement for both density estimation and downstream tasks.
  arXiv  Detail & Related papers  (2020-06-18T03:24:58Z)
• Neural Ordinary Differential Equations on Manifolds [0.342658286826597]
  Recently normalizing flows in Euclidean space based on Neural ODEs show great promise, yet suffer the same limitations. We show how vector fields provide a general framework for parameterizing a flexible class of invertible mapping on these spaces.
  arXiv  Detail & Related papers  (2020-06-11T17:56:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.