Three-Body Scattering for Generative Modeling
- URL: http://arxiv.org/abs/2607.18198v1
- Date: Mon, 20 Jul 2026 17:38:12 GMT
- Title: Three-Body Scattering for Generative Modeling
- Abstract summary: We show that a proper distributional energy can induce sample-level motion and provide direct regression supervision for a one-step generator.<n>Three-Body Scattering Modeling for generation turns the energy distance into a constant-size per-projectile interaction.<n>We provide a design map relating diffusion-related supervision, Drift-like dynamics, and GAN-like objectives.
- Score: 17.851305398372794
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Modern generative models typically rely on an adversarial critic, a prescribed noise-to-data path, or an autoregressive factorization. Instead, we show that a proper distributional energy can induce sample-level motion and provide direct regression supervision for a one-step generator. Three-Body Scattering Modeling (TBSM) for generation turns the energy distance into a constant-size per-projectile interaction: each projectile is attracted toward one real source and repelled from one independently generated source. Conditioned on the projectile and its condition, its expectation equals the $2$-Wasserstein gradient-flow velocity of $\frac12D_E^2(P_θ,Q)$. A batch of $B$ frozen-target events yields $O(B)$ sample-level losses, each using one reference for its condition instead of the minibatch-wide all-pairs field used by methods such as Drifting Models. Tracking this conditional expectation online can reduce field noise. Using scattering in frozen image features, TBSM trains one-step generators on ImageNet-256, achieving FID${}=2.23$ with pixel-space PixelDiT-XL and FID${}=1.63$ with latent-space DiT-XL at NFE${}=1$. We provide a design map relating diffusion-related supervision, Drift-like dynamics, and GAN-like objectives. These results establish tracked scattering as a route to high-dimensional one-step generation. Code: https://github.com/sp12138/TBSM.
Related papers
- Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors [51.56484100374058]
Autoregressive models accumulate error over long rollouts, yet at deployment there is no ground truth to measure it against.<n>We train a single conditional latent diffusion model that steps a dynamical system forward or backward in time via a direction flag.<n>We show that this bidirectionality supplies a measurement-free test-time error signal.
arXiv Detail & Related papers (2026-08-01T13:49:46Z) - Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference [60.82875447631739]
We introduce FAV, Few-step Generative Models Alignment via Sample-based Variational Inference.<n>FAV cast alignment as sampling from a reward-tilted distribution anchored to a reference distribution.<n>We evaluate FAV on two domains: robotics manipulation and image generator alignment.
arXiv Detail & Related papers (2026-05-26T05:02:49Z) - Stitched Value Model for Diffusion Alignment [76.52330634059528]
Diffusion- or flow-based generative models must be aligned with task-specific rewards, such as prompt fidelity or aesthetic preference.<n>Here, we propose StitchVM, a model stitching framework that efficiently transfers reward models pretrained for clean images to the noisy latent regime.<n>We show that this approach yields improvements across a broad range of downstream steering and post-training methods.
arXiv Detail & Related papers (2026-05-19T13:02:50Z) - Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series [0.0]
We give a precise definition of discrete scale equivariance for 1D causal networks.<n>We prove that dyadic dilation commutes with any dilated-convolution stack whose kernel weights are shared across levels.<n>On 30 years of S&P 500 daily log-returns, SE-WaveNet samples reproduce the empirical scaling-collapse diagnostic on the Allan-Variance top-25 universe.
arXiv Detail & Related papers (2026-05-17T18:21:30Z) - Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation [50.55853275866995]
Real-time interactive video generation requires low-latency, streaming, and controllable rollout.<n>In this paper, we study a more aggressive setting: frame-wise autoregression with only 1--2 sampling steps.<n>We propose textbfCausal Forcing++, a principled and scalable pipeline.
arXiv Detail & Related papers (2026-05-14T17:46:36Z) - One-Step Generative Modeling via Wasserstein Gradient Flows [56.266175641614986]
W-Flow is a framework for training a generator that transforms samples from a simple reference distribution into samples from a target data distribution in a single step.<n>We set a new state of the art for one-step ImageNet 256$times$256 generation, achieving 1.29 FID, with improved mode coverage and domain transfer.
arXiv Detail & Related papers (2026-05-12T08:29:44Z) - Language Modeling with Hyperspherical Flows [12.083218729202963]
Recent Flow Language Models (FLMs) apply continuous flows to language, transporting noise to data with a deterministic ODE.<n>$mathbbS$-FLM generates sequences by rotating vectors in $mathbbSd-1$ along a velocity field learned with cross-entropy.<n>$mathbbS$-FLM substantially improves continuous flow language models on large-vocabulary reasoning.
arXiv Detail & Related papers (2026-05-11T18:32:32Z) - Duality Models: An Embarrassingly Simple One-step Generation Paradigm [46.10673908377537]
"One input, one output" paradigm enforces a partition of the training budget.<n> allocating sufficient samples to the multi-step objective leaves the few-step generation undertrained.<n>We propose Duality Models (DuMo) via a "one input, dual output" paradigm.
arXiv Detail & Related papers (2026-02-04T17:16:22Z) - PINGS: Physics-Informed Neural Network for Fast Generative Sampling [0.0]
We introduce PINGS, a framework that amortizes diffusion sampling by training a physics-informed network to approximate reverse-time probability-flow dynamics.<n>As a proof of concept, we learn a direct map from a 3D standard normal to a non-Gaussian Gaussian Mixture Model (GMM)<n>PINGS frames generative sampling as a PINN-style residual problem with endpoint anchoring, yielding a white-box, differentiable map with NFE = 1.
arXiv Detail & Related papers (2025-09-14T14:22:33Z) - A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models [45.60426164657739]
We develop non-asymptotic convergence theory for a diffusion-based sampler.
We prove that $d/varepsilon$ are sufficient to approximate the target distribution to within $varepsilon$ total-variation distance.
Our results also characterize how $ell$ score estimation errors affect the quality of the data generation processes.
arXiv Detail & Related papers (2024-08-05T09:02:24Z) - Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative
Models [49.81937966106691]
We develop a suite of non-asymptotic theory towards understanding the data generation process of diffusion models.
In contrast to prior works, our theory is developed based on an elementary yet versatile non-asymptotic approach.
arXiv Detail & Related papers (2023-06-15T16:30:08Z) - Poisson Flow Generative Models [9.843778728210427]
"Poisson flow" generative model maps a uniform distribution on a high-dimensional hemisphere into any data distribution.
PFGM achieves current state-of-the-art performance among the normalizing flow models on CIFAR-10.
arXiv Detail & Related papers (2022-09-22T17:26:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.