Grassmann Manifold Flows for Stable Shape Generation

• URL: http://arxiv.org/abs/2211.02900v3
• Date: Mon, 4 Dec 2023 21:08:15 GMT
• Title: Grassmann Manifold Flows for Stable Shape Generation
• Abstract summary: We present a novel approach in which we establish the theoretical foundations for learning distributions on the Grassmann manifold. Our approach facilitates more robust generation by effectively eliminating the influence of extraneous transformations. The proposed method significantly outperformed state-of-the-art methods in terms of the log-likelihood or evidence lower bound.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recently, studies on machine learning have focused on methods that use symmetry implicit in a specific manifold as an inductive bias. Grassmann manifolds provide the ability to handle fundamental shapes represented as shape spaces, enabling stable shape analysis. In this paper, we present a novel approach in which we establish the theoretical foundations for learning distributions on the Grassmann manifold via continuous normalization flows, with the explicit goal of generating stable shapes. Our approach facilitates more robust generation by effectively eliminating the influence of extraneous transformations, such as rotations and inversions, through learning and generating within a Grassmann manifold designed to accommodate the essential shape information of the object. The experimental results indicated that the proposed method could generate high-quality samples by capturing the data structure. Furthermore, the proposed method significantly outperformed state-of-the-art methods in terms of the log-likelihood or evidence lower bound. The results obtained are expected to stimulate further research in this field, leading to advances for stable shape generation and analysis.

Related papers

• GeodesicNVS: Probability Density Geodesic Flow Matching for Novel View Synthesis [54.39598154430305]
  We propose a Data-to-Data Flow Matching framework that learns deterministic transformations directly between paired views.<n>PDG-FM constrains flow trajectories using geodesic interpolants derived from probability density metrics of pretrained diffusion models.<n>These results highlight the advantages of incorporating data-dependent geometric regularization into deterministic flow matching for consistent novel view generation.
  arXiv  Detail & Related papers  (2026-03-01T09:30:11Z)
• Probing the Geometry of Diffusion Models with the String Method [13.771271465889432]
  We introduce a framework based on the string method that computes continuous paths between samples by evolving curves under the learned score function.<n> operating on pretrained models without retraining, our approach interpolates between three regimes.<n>For image diffusion models, MEPs contain high-likelihood but unrealistic ''cartoon'' images, confirming prior observations that likelihood maxima appear unrealistic.<n>For protein structure prediction, our method computes transition pathways between metastable conformers directly from models trained on static structures.
  arXiv  Detail & Related papers  (2026-02-25T17:10:59Z)
• Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data [4.681760167323748]
  We introduce a framework for learning a probabilistic generative model and the underlying, nonlinear data manifold directly from corrupted observations.<n>We establish theoretical guarantees showing that, under appropriate geometric regularization and measurement conditions, the learned model recovers the underlying data distribution up to a controllable error and yields a smooth, bi-Lipschitz manifold parametrization.
  arXiv  Detail & Related papers  (2026-01-26T17:51:52Z)
• Guiding diffusion models to reconstruct flow fields from sparse data [25.34099672176622]
  We introduce a novel sampling method for diffusion models that enables the reconstruction of high-fidelity samples.<n>Our method consistently outperforms other diffusion-based methods in predicting the fluid's structure.<n>This study underscores the remarkable potential of diffusion models in reconstructing flow field data.
  arXiv  Detail & Related papers  (2025-10-22T19:01:50Z)
• When and how can inexact generative models still sample from the data manifold? [2.4664553878979185]
  Despite learning errors in the score function or the drift vector field, the generated samples appear to shift emphalong the support of the data distribution but not emphaway from it.<n>We show that the alignment of the top Lyapunov vectors with the tangent spaces along the boundary of the data manifold leads to robustness.
  arXiv  Detail & Related papers  (2025-08-11T03:24:34Z)
• Flows and Diffusions on the Neural Manifold [0.0]
  Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling.<n>We extend these advances to weight space learning by leveraging recent techniques to incorporate structural priors derived from optimization dynamics.
  arXiv  Detail & Related papers  (2025-07-14T02:26:06Z)
• Provable Maximum Entropy Manifold Exploration via Diffusion Models [58.89696361871563]
  Exploration is critical for solving real-world decision-making problems such as scientific discovery.<n>We introduce a novel framework that casts exploration as entropy over approximate data manifold implicitly defined by a pre-trained diffusion model.<n>We develop an algorithm based on mirror descent that solves the exploration problem as sequential fine-tuning of a pre-trained diffusion model.
  arXiv  Detail & Related papers  (2025-06-18T11:59:15Z)
• Geometry aware inference of steady state PDEs using Equivariant Neural Fields representations [0.0]
  We introduce enf2enf, an encoder--decoder methodology for predicting steady-state Partial Differential Equations. Our method supports real time inference and zero-shot super-resolution, enabling efficient training on low-resolution meshes.
  arXiv  Detail & Related papers  (2025-04-24T08:30:32Z)
• A precise asymptotic analysis of learning diffusion models: theory and insights [37.30894159200853]
  We consider the problem of learning a flow or diffusion-based generative model parametrized by a two-layer auto-encoder. We derive a tight characterization of low-dimensional projections of the distribution of samples generated by the learned model.
  arXiv  Detail & Related papers  (2025-01-07T16:56:40Z)
• Pullback Flow Matching on Data Manifolds [10.187244125099479]
  Pullback Flow Matching (PFM) is a framework for generative modeling on data manifold. We demonstrate PFM's effectiveness through applications in synthetic, data dynamics and protein sequence data, generating novel proteins with specific properties. This method shows strong potential for drug discovery and materials science, where generating novel samples with specific properties is of great interest.
  arXiv  Detail & Related papers  (2024-10-06T16:41:26Z)
• Categorical Flow Matching on Statistical Manifolds [12.646272756981672]
  We introduce a flow-matching framework on the manifold of parameterized probability measures inspired by information geometry. We develop an efficient training and sampling algorithm that overcomes numerical stability with a diffeomorphism between manifold. We manifest that SFM can learn more complex patterns on the statistical manifold where existing models often fail due to strong prior assumptions.
  arXiv  Detail & Related papers  (2024-05-26T05:50:39Z)
• Diffusion posterior sampling for simulation-based inference in tall data settings [53.17563688225137]
  Simulation-based inference ( SBI) is capable of approximating the posterior distribution that relates input parameters to a given observation. In this work, we consider a tall data extension in which multiple observations are available to better infer the parameters of the model. We compare our method to recently proposed competing approaches on various numerical experiments and demonstrate its superiority in terms of numerical stability and computational cost.
  arXiv  Detail & Related papers  (2024-04-11T09:23:36Z)
• Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes [57.396578974401734]
  We introduce a principled framework for building a generative diffusion process on general manifold. Instead of following the denoising approach of previous diffusion models, we construct a diffusion process using a mixture of bridge processes. We develop a geometric understanding of the mixture process, deriving the drift as a weighted mean of tangent directions to the data points.
  arXiv  Detail & Related papers  (2023-10-11T06:04:40Z)
• A stable deep adversarial learning approach for geological facies generation [32.97208255533144]
  Deep generative learning is a promising approach to overcome the limitations of traditional geostatistical simulation models. This research aims to investigate the application of generative adversarial networks and deep variational inference for conditionally meandering channels in underground volumes.
  arXiv  Detail & Related papers  (2023-05-12T14:21:14Z)
• Latent Traversals in Generative Models as Potential Flows [113.4232528843775]
  We propose to model latent structures with a learned dynamic potential landscape. Inspired by physics, optimal transport, and neuroscience, these potential landscapes are learned as physically realistic partial differential equations. Our method achieves both more qualitatively and quantitatively disentangled trajectories than state-of-the-art baselines.
  arXiv  Detail & Related papers  (2023-04-25T15:53:45Z)
• GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation [102.85440102147267]
  We propose a novel generative model named GeoDiff for molecular conformation prediction. We show that GeoDiff is superior or comparable to existing state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-06T09:47:01Z)
• Learning Neural Generative Dynamics for Molecular Conformation Generation [89.03173504444415]
  We study how to generate molecule conformations (textiti.e., 3D structures) from a molecular graph. We propose a novel probabilistic framework to generate valid and diverse conformations given a molecular graph.
  arXiv  Detail & Related papers  (2021-02-20T03:17:58Z)
• Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
  Inferring the parameters of a model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations. We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
  arXiv  Detail & Related papers  (2021-02-12T12:23:13Z)
• Data driven Dirichlet sampling on manifolds [0.0]
  The proposed strategy allows to completely respect the underlying manifold around which data is observed, and to do massive samplings with low computational effort. This can be very helpful, for instance, in neural networks training process, as well as in uncertainty analysis and optimization.
  arXiv  Detail & Related papers  (2020-12-29T11:19:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.