Hierarchical Flow Matching for 3D Point Cloud Generation

• URL: http://arxiv.org/abs/2608.05557v1
• Date: Thu, 06 Aug 2026 03:23:49 GMT
• Title: Hierarchical Flow Matching for 3D Point Cloud Generation
• Abstract summary: Existing flow-based methods rely on continuous normalizing flows (CNFs) that demand expensive ODE solving and trace estimation during training.<n>We propose Hierarchical Flow Matching (HFM) that extends flow matching to bilevel structure for unconditional 3D point cloud generation.<n>The resulting straight OT paths enable efficient sampling with as few as 15 Euler steps per flow, while the structured latent space supports downstream tasks including classification.
• Score: 3.451986888321395
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generating high-quality 3D point clouds requires capturing both global shape topology and local geometric details. Existing flow-based methods rely on continuous normalizing flows (CNFs) that demand expensive ODE solving and trace estimation during training, while diffusion models require hundreds of iterative denoising steps. Moreover, most approaches adopt single-level generation directly in point space, disregarding the hierarchical structure natural to 3D shapes. We propose Hierarchical Flow Matching (HFM) that extends flow matching to bilevel structure for unconditional 3D point cloud generation. HFM decomposes the task into two levels via optimal-transport flow matching: a \textit{Latent Flow Matching} models the global shape manifold in a compact latent space, and a \textit{Conditional Point Flow Matching} reconstructs detailed point clouds conditioned on the latent code. Both flows are trained with simple MSE regression losses. The resulting straight OT paths enable efficient sampling with as few as 15 Euler steps per flow, while the structured latent space supports downstream tasks including classification. Extensive experiments on ShapeNet and ModelNet benchmarks demonstrate that HFM achieves competitive or even best performance compared with prior state-of-the-art methods.

Related papers

• Attention-Guided Flow-Matching for Sparse 3D Geological Generation [7.734651455015875]
  3D-GeoFlow is the first Attention-Guided Continuous Flow Matching framework tailored for sparse multimodal geological modeling.<n>By reformulating discrete categorical generation as a simulation-free, continuous vector field regression, our model establishes stable, deterministic optimal transport paths.<n>To validate our framework, we curated a large-scale multimodal dataset comprising 2,200 procedurally generated 3D geological cases.
  arXiv  Detail & Related papers  (2026-04-07T07:02:53Z)
• ATATA: One Algorithm to Align Them All [74.76451498236437]
  We suggest a new multi-modal algorithm for joint inference of paired structurally aligned samples with Rectified Flow models.<n>We show the applicability of our method to the domains of image, video, and 3D shape generation using state-of-the-art baselines and evaluate it against both editing-based and joint inference-based competing approaches.
  arXiv  Detail & Related papers  (2026-01-16T11:11:33Z)
• PUFM++: Point Cloud Upsampling via Enhanced Flow Matching [15.738247394527024]
  PUFM++ is an enhanced flow-matching framework for reconstructing point clouds from sparse, noisy, and partial observations.<n>We introduce a two-stage flow-matching strategy that first learns a direct, straight-path flow from sparse inputs to dense targets, and then refines it using noise-perturbed samples to approximate the terminal marginal distribution better.<n>Experiments on synthetic benchmarks and real-world scans show that PUFM++ sets a new state of the art in point cloud upsampling.
  arXiv  Detail & Related papers  (2025-12-24T06:30:42Z)
• Improving Progressive Generation with Decomposable Flow Matching [50.63174319509629]
  Decomposable Flow Matching (DFM) is a simple and effective framework for the progressive generation of visual media.<n>On Imagenet-1k 512px, DFM achieves 35.2% improvements in FDD scores over the base architecture and 26.4% over the best-performing baseline.
  arXiv  Detail & Related papers  (2025-06-24T17:58:02Z)
• Not-So-Optimal Transport Flows for 3D Point Cloud Generation [58.164908756416615]
  Learning generative models of 3D point clouds is one of the fundamental problems in 3D generative learning.<n>In this paper, we analyze the recently proposed equivariant OT flows that learn permutation invariant generative models for point-based molecular data.<n>We show that our proposed model outperforms prior diffusion- and flow-based approaches on a wide range of unconditional generation and shape completion.
  arXiv  Detail & Related papers  (2025-02-18T02:37:34Z)
• INRFlow: Flow Matching for INRs in Ambient Space [6.911507447184487]
  Flow matching models can be trained in two stages: first, a data compressor is trained, and in a subsequent training stage a flow matching generative model is trained in the latent space of the data compressor.<n>This two-stage paradigm sets obstacles for unifying models across data domains.<n>We introduce INRFlow, a domain-agnostic approach to learn flow matching transformers directly in ambient space.
  arXiv  Detail & Related papers  (2024-12-05T01:00:07Z)
• Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulations [1.1932047172700866]
  This paper presents a methodology to learn surrogate models of steady state fluid dynamics simulations on meshed domains. The proposed models can be applied directly to unstructured domains for different flow conditions. Remarkably, the method can perform inference five order of magnitude faster than the high fidelity solver on the RANS transonic airfoil dataset.
  arXiv  Detail & Related papers  (2024-07-29T11:48:44Z)
• Consistency Flow Matching: Defining Straight Flows with Velocity Consistency [97.28511135503176]
  We introduce Consistency Flow Matching (Consistency-FM), a novel FM method that explicitly enforces self-consistency in the velocity field. Preliminary experiments demonstrate that our Consistency-FM significantly improves training efficiency by converging 4.4x faster than consistency models.
  arXiv  Detail & Related papers  (2024-07-02T16:15:37Z)
• Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows [0.0]
  We extend L2LFlows to simulate showers with a 9-times larger profile in the lateral direction. We introduce convolutional layers and U-Net-type connections, move from masked autoregressive flows to coupling layers.
  arXiv  Detail & Related papers  (2024-05-30T18:25:19Z)
• Let-It-Flow: Simultaneous Optimization of 3D Flow and Object Clustering [2.763111962660262]
  We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences. We propose a novel clustering approach that allows for combination of overlapping soft clusters as well as non-overlapping rigid clusters. Our method especially excels in resolving flow in complicated dynamic scenes with multiple independently moving objects close to each other.
  arXiv  Detail & Related papers  (2024-04-12T10:04:03Z)
• StarNet: Style-Aware 3D Point Cloud Generation [82.30389817015877]
  StarNet is able to reconstruct and generate high-fidelity and even 3D point clouds using a mapping network. Our framework achieves comparable state-of-the-art performance on various metrics in the point cloud reconstruction and generation tasks.
  arXiv  Detail & Related papers  (2023-03-28T08:21:44Z)
• PU-Flow: a Point Cloud Upsampling Networkwith Normalizing Flows [58.96306192736593]
  We present PU-Flow, which incorporates normalizing flows and feature techniques to produce dense points uniformly distributed on the underlying surface. Specifically, we formulate the upsampling process as point in a latent space, where the weights are adaptively learned from local geometric context. We show that our method outperforms state-of-the-art deep learning-based approaches in terms of reconstruction quality, proximity-to-surface accuracy, and computation efficiency.
  arXiv  Detail & Related papers  (2021-07-13T07:45:48Z)
• Go with the Flows: Mixtures of Normalizing Flows for Point Cloud Generation and Reconstruction [98.38585659305325]
  normalizing flows (NFs) have demonstrated state-of-the-art performance on modeling 3D point clouds. This work enhances their representational power by applying mixtures of NFs to point clouds.
  arXiv  Detail & Related papers  (2021-06-06T14:25:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.