Inferring Hybrid Neural Fluid Fields from Videos

• URL: http://arxiv.org/abs/2312.06561v1
• Date: Mon, 11 Dec 2023 17:46:25 GMT
• Title: Inferring Hybrid Neural Fluid Fields from Videos
• Authors: Hong-Xing Yu, Yang Zheng, Yuan Gao, Yitong Deng, Bo Zhu, Jiajun Wu
• Abstract summary: We study recovering fluid density and velocity from sparse multiview videos. Existing neural dynamic reconstruction methods rely on optical flows. We propose hybrid neural fluid fields (HyFluid) to jointly infer fluid density and velocity fields.
• Score: 29.796181173910963
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study recovering fluid density and velocity from sparse multiview videos. Existing neural dynamic reconstruction methods predominantly rely on optical flows; therefore, they cannot accurately estimate the density and uncover the underlying velocity due to the inherent visual ambiguities of fluid velocity, as fluids are often shapeless and lack stable visual features. The challenge is further pronounced by the turbulent nature of fluid flows, which calls for properly designed fluid velocity representations. To address these challenges, we propose hybrid neural fluid fields (HyFluid), a neural approach to jointly infer fluid density and velocity fields. Specifically, to deal with visual ambiguities of fluid velocity, we introduce a set of physics-based losses that enforce inferring a physically plausible velocity field, which is divergence-free and drives the transport of density. To deal with the turbulent nature of fluid velocity, we design a hybrid neural velocity representation that includes a base neural velocity field that captures most irrotational energy and a vortex particle-based velocity that models residual turbulent velocity. We show that our method enables recovering vortical flow details. Our approach opens up possibilities for various learning and reconstruction applications centered around 3D incompressible flow, including fluid re-simulation and editing, future prediction, and neural dynamic scene composition. Project website: https://kovenyu.com/HyFluid/

Related papers

• Hybrid Neural-MPM for Interactive Fluid Simulations in Real-Time [57.30651532625017]
  We present a novel hybrid method that integrates numerical simulation, neural physics, and generative control.<n>Our system demonstrates robust performance across diverse 2D/3D scenarios, material types, and obstacle interactions.<n>We promise to release both models and data upon acceptance.
  arXiv  Detail & Related papers  (2025-05-25T01:27:18Z)
• Physics-informed neural networks for hidden boundary detection and flow field reconstruction [0.0]
  This study presents a physics-informed neural network (PINN) framework designed to infer the presence, shape, and motion of static or moving solid boundaries. The framework is validated across diverse scenarios, including incompressible Navier-Stokes and compressible Euler flows. The proposed method exhibits robustness and versatility, highlighting its potential for applications when only limited experimental or numerical data are available.
  arXiv  Detail & Related papers  (2025-03-31T13:30:46Z)
• Fluid Simulation on Neural Flow Maps [23.5602305386658]
  We introduce Neural Flow Maps, a novel simulation method bridging the emerging paradigm of implicit neural representations with fluid simulation based on the theory of flow maps. We demonstrate the efficacy of our neural fluid simulation in a variety of challenging simulation scenarios, including leapfrogging vortices, colliding vortices, vortex reconnections, as well as vortex generation from moving obstacles and density differences.
  arXiv  Detail & Related papers  (2023-12-22T12:13:19Z)
• HelmFluid: Learning Helmholtz Dynamics for Interpretable Fluid Prediction [66.38369833561039]
  HelmFluid is an accurate and interpretable predictor for fluid. Inspired by Helmholtz theorem, we design a HelmDynamics block to learn Helmholtz dynamics. By embedding the HelmDynamics block into a Multiscale Multihead Integral Architecture, HelmFluid can integrate learned Helmholtz dynamics along temporal dimension in multiple spatial scales.
  arXiv  Detail & Related papers  (2023-10-16T16:38:32Z)
• Forecasting subcritical cylinder wakes with Fourier Neural Operators [58.68996255635669]
  We apply a state-of-the-art operator learning technique to forecast the temporal evolution of experimentally measured velocity fields. We find that FNOs are capable of accurately predicting the evolution of experimental velocity fields throughout the range of Reynolds numbers tested.
  arXiv  Detail & Related papers  (2023-01-19T20:04:36Z)
• PhysDiff: Physics-Guided Human Motion Diffusion Model [101.1823574561535]
  Existing motion diffusion models largely disregard the laws of physics in the diffusion process. PhysDiff incorporates physical constraints into the diffusion process. Our approach achieves state-of-the-art motion quality and improves physical plausibility drastically.
  arXiv  Detail & Related papers  (2022-12-05T18:59:52Z)
• Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data [73.8970871148949]
  High-fidelity reconstruction of fluids from sparse multiview RGB videos remains a formidable challenge. Existing solutions either assume knowledge of obstacles and lighting, or only focus on simple fluid scenes without obstacles or complex lighting. We present the first method to reconstruct dynamic fluid by leveraging the governing physics (ie, Navier -Stokes equations) in an end-to-end optimization.
  arXiv  Detail & Related papers  (2022-06-14T03:38:08Z)
• NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural Radiance Fields [65.07940731309856]
  Deep learning has shown great potential for modeling the physical dynamics of complex particle systems such as fluids. In this paper, we consider a partially observable scenario known as fluid dynamics grounding. We propose a differentiable two-stage network named NeuroFluid. It is shown to reasonably estimate the underlying physics of fluids with different initial shapes, viscosity, and densities.
  arXiv  Detail & Related papers  (2022-03-03T15:13:29Z)
• Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D [4.981834139548193]
  In this work, we present significant extensions to a recently proposed deep learning framework, which addresses the aforementioned challenges in 2D. We go from 2D to 3D and propose an efficient architecture to cope with the high demands of 3D grids in terms of memory and computational complexity. Our method indicates strong improvements in terms of accuracy, speed and generalization capabilities over current 3D NN-based fluid models.
  arXiv  Detail & Related papers  (2020-12-22T09:21:40Z)
• Ultrafast viscosity measurement with ballistic optical tweezers [55.41644538483948]
  Noninvasive viscosity measurements require integration times of seconds. We demonstrate a four orders-of-magnitude improvement in speed, down to twenty microseconds. We achieve this using the instantaneous velocity of a trapped particle in an optical tweezer.
  arXiv  Detail & Related papers  (2020-06-29T00:09:40Z)
• Learning Incompressible Fluid Dynamics from Scratch -- Towards Fast, Differentiable Fluid Models that Generalize [7.707887663337803]
  Recent deep learning based approaches promise vast speed-ups but do not generalize to new fluid domains. We propose a novel physics-constrained training approach that generalizes to new fluid domains. We present an interactive real-time demo to show the speed and generalization capabilities of our trained models.
  arXiv  Detail & Related papers  (2020-06-15T20:59:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.