A Theory of Speciation in Generative Diffusion Models on Compact Riemannian Manifolds

• URL: http://arxiv.org/abs/2608.23798v2
• Date: Wed, 26 Aug 2026 16:39:22 GMT
• Title: A Theory of Speciation in Generative Diffusion Models on Compact Riemannian Manifolds
• Abstract summary: Speciation in generative diffusion models denotes the emergence of distinct stable branches during denoising.<n>We go beyond existing theoretical descriptions, which usually identify speciation with a symmetric pitchfork bifurcation.<n>A chart-based intrinsic score-learning scheme based on neural networks contrasts the theoretically predicted transitions on prototypal.
• Score: 0.05729426778193397
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Speciation in generative diffusion models denotes the emergence of distinct stable branches during denoising, through which initially undifferentiated trajectories progressively commit to different data classes. In this work we develop an intrinsic theory of speciation for diffusion models supported on compact Riemannian manifolds: the aim is to go beyond existing theoretical descriptions, which usually identify speciation with a symmetric pitchfork bifurcation and assume to work in a large-dimensional space. We characterize speciation by bifurcations of the critical points of the evolving probability density. A spectral heat-kernel representation makes explicit the role of the manifold geometry, while Poincaré-Hopf and Morse theory impose global constraints on the number and type of score equilibria and reveal topologically-imposed geometrical modes. For mixtures of heat kernels, we prove that generic speciation events have a one-dimensional critical kernel and admit an A2 fold normal form; pitchforks and simultaneous multidirectional transitions arise from nongeneric symmetric configurations. We derive geometry-dependent estimates of speciation times for bimodal mixtures and Riemannian regular simplices. We further establish structural stability of nondegenerate folds under score perturbations and show that the first-order time shift is determined solely by the component of the score error along the critical direction. The theory is illustrated on the sphere using mixtures of von Mises-Fisher distributions, where pitchfork and saddle-node bifurcations, topological modes, and hierarchical multiple speciations are observed. Finally, a chart-based intrinsic score-learning scheme based on neural networks contrasts the theoretically predicted transitions on prototypal and more complex datasets.

Related papers

• Continuum field theory of matchgate tensor network ensembles [36.94429692322632]
  We develop a continuum description for random ensembles of two-dimensional fermionic matchgate tensor networks.<n>As a diagnostic of the resulting universal physics, we analyze disorder-averaged moments of fermionic two-point functions.<n>We show that disorder drives universal long-distance behavior governed by a nonlinear sigma-model of symmetry class D with a topological term.
  arXiv  Detail & Related papers  (2026-03-06T12:15:35Z)
• Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generation [56.361076943802594]
  CanonFlow achieves state-of-the-art performance on the challenging GEOM-DRUG dataset, and the advantage remains large in few-step generation.
  arXiv  Detail & Related papers  (2026-02-16T18:58:55Z)
• DEGMC: Denoising Diffusion Models Based on Riemannian Equivariant Group Morphological Convolutions [4.185301436243608]
  We address two major issues in recent Denoising Diffusion Probabilistic Models (DDPM)<n>We introduce a geometric approach combined with an equivariance property of the more general Euclidean group.<n> Experimental results on the MNIST, RotoMNIST, and CIFAR-10 datasets show noticeable improvements compared to the baseline DDPM model.
  arXiv  Detail & Related papers  (2026-02-10T19:13:47Z)
• Parallel Complex Diffusion for Scalable Time Series Generation [50.01609741902786]
  PaCoDi is a spectral-native architecture that decouples generative modeling in the frequency domain.<n>We show that PaCoDi outperforms existing baselines in both generation quality and inference speed.
  arXiv  Detail & Related papers  (2026-02-10T14:31:53Z)
• Theory of Speciation Transitions in Diffusion Models with General Class Structure [5.939780039158003]
  Diffusion models generate data by reversing a diffusion process, transforming noise into structured samples drawn from a target distribution.<n>Recent theoretical work has shown that this backward dynamics can undergo sharp qualitative transitions, known as speciation transitions.<n>We develop a general theory of speciation in diffusion models that applies to arbitrary target distributions admitting well-defined classes.
  arXiv  Detail & Related papers  (2026-02-04T10:35:47Z)
• Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction [54.95522167029998]
  This article is a self-contained primer on diffusion over general state spaces.<n>We develop the discrete-time view (forward noising via Markov kernels and learned reverse dynamics) alongside its continuous-time limits.<n>A common variational treatment yields the ELBO that underpins standard training losses.
  arXiv  Detail & Related papers  (2025-12-04T18:55:36Z)
• Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion [8.389423957434818]
  We analyze the spectrum of eigenvalues of the Jacobian of the score function, whose discontinuities (gaps) reveal the presence and dimensionality of distinct sub-manifolds.<n>Our analysis reveals the existence of three distinct qualitative phases during the generative process.
  arXiv  Detail & Related papers  (2024-10-08T10:55:40Z)
• Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysis [56.442307356162864]
  We study the theoretical aspects of score-based discrete diffusion models under the Continuous Time Markov Chain (CTMC) framework.<n>We introduce a discrete-time sampling algorithm in the general state space $[S]d$ that utilizes score estimators at predefined time points.<n>Our convergence analysis employs a Girsanov-based method and establishes key properties of the discrete score function.
  arXiv  Detail & Related papers  (2024-10-03T09:07:13Z)
• Topological Obstructions and How to Avoid Them [22.45861345237023]
  We show that local optima can arise due to singularities or an incorrect degree or winding number. We propose a new flow-based model that maps data points to multimodal distributions over geometric spaces.
  arXiv  Detail & Related papers  (2023-12-12T18:56:14Z)
• Geometric Neural Diffusion Processes [55.891428654434634]
  We extend the framework of diffusion models to incorporate a series of geometric priors in infinite-dimension modelling. We show that with these conditions, the generative functional model admits the same symmetry.
  arXiv  Detail & Related papers  (2023-07-11T16:51:38Z)
• A Unifying and Canonical Description of Measure-Preserving Diffusions [60.59592461429012]
  A complete recipe of measure-preserving diffusions in Euclidean space was recently derived unifying several MCMC algorithms into a single framework. We develop a geometric theory that improves and generalises this construction to any manifold.
  arXiv  Detail & Related papers  (2021-05-06T17:36:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.