Learning Vortex Dynamics for Fluid Inference and Prediction
- URL: http://arxiv.org/abs/2301.11494v1
- Date: Fri, 27 Jan 2023 02:10:05 GMT
- Title: Learning Vortex Dynamics for Fluid Inference and Prediction
- Authors: Yitong Deng, Hong-Xing Yu, Jiajun Wu, Bo Zhu
- Abstract summary: We propose a novel machine learning method based on differentiable vortex particles to infer and predict fluid dynamics from a single video.
We devise a novel differentiable vortex particle system in conjunction with their learnable, vortex-to-velocity dynamics mapping to effectively capture and represent the complex flow features in a reduced space.
- Score: 25.969713036393895
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a novel machine learning method based on differentiable vortex
particles to infer and predict fluid dynamics from a single video. The key
design of our system is a particle-based latent space to encapsulate the
hidden, Lagrangian vortical evolution underpinning the observable, Eulerian
flow phenomena. We devise a novel differentiable vortex particle system in
conjunction with their learnable, vortex-to-velocity dynamics mapping to
effectively capture and represent the complex flow features in a reduced space.
We further design an end-to-end training pipeline to directly learn and
synthesize simulators from data, that can reliably deliver future video
rollouts based on limited observation. The value of our method is twofold:
first, our learned simulator enables the inference of hidden physics quantities
(e.g. velocity field) purely from visual observation, to be used for motion
analysis; secondly, it also supports future prediction, constructing the input
video's sequel along with its future dynamics evolution. We demonstrate our
method's efficacy by comparing quantitatively and qualitatively with a range of
existing methods on both synthetic and real-world videos, displaying improved
data correspondence, visual plausibility, and physical integrity.
Related papers
- KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter [49.85369344101118]
We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering.
Our key idea is to model the dynamic radiance field as a dynamic system whose temporally varying states are estimated based on two sources of knowledge: observations and predictions.
Our KFD-NeRF demonstrates similar or even superior performance within comparable computational time and state-of-the-art view synthesis performance with thorough training.
arXiv Detail & Related papers (2024-07-18T05:48:24Z) - AdaOcc: Adaptive Forward View Transformation and Flow Modeling for 3D Occupancy and Flow Prediction [56.72301849123049]
We present our solution for the Vision-Centric 3D Occupancy and Flow Prediction track in the nuScenes Open-Occ dataset challenge at CVPR 2024.
Our innovative approach involves a dual-stage framework that enhances 3D occupancy and flow predictions by incorporating adaptive forward view transformation and flow modeling.
Our method combines regression with classification to address scale variations in different scenes, and leverages predicted flow to warp current voxel features to future frames, guided by future frame ground truth.
arXiv Detail & Related papers (2024-07-01T16:32:15Z) - Latent Intuitive Physics: Learning to Transfer Hidden Physics from A 3D Video [58.043569985784806]
We introduce latent intuitive physics, a transfer learning framework for physics simulation.
It can infer hidden properties of fluids from a single 3D video and simulate the observed fluid in novel scenes.
We validate our model in three ways: (i) novel scene simulation with the learned visual-world physics, (ii) future prediction of the observed fluid dynamics, and (iii) supervised particle simulation.
arXiv Detail & Related papers (2024-06-18T16:37:44Z) - Inverse Dynamics Pretraining Learns Good Representations for Multitask
Imitation [66.86987509942607]
We evaluate how such a paradigm should be done in imitation learning.
We consider a setting where the pretraining corpus consists of multitask demonstrations.
We argue that inverse dynamics modeling is well-suited to this setting.
arXiv Detail & Related papers (2023-05-26T14:40:46Z) - GotFlow3D: Recurrent Graph Optimal Transport for Learning 3D Flow Motion
in Particle Tracking [11.579751282152841]
Flow visualization technologies such as particle tracking velocimetry (PTV) are broadly used in understanding the all-pervasiveness three-dimensional (3D) turbulent flow from nature and industrial processes.
Despite the advances in 3D acquisition techniques, the developed motion estimation algorithms in particle tracking remain great challenges of large particle displacements, dense particle distributions and high computational cost.
By introducing a novel deep neural network based on recurrent Graph Optimal Transport, we present an end-to-end solution to learn the 3D fluid flow motion from double-frame particle sets.
arXiv Detail & Related papers (2022-10-31T02:05:58Z) - Physics-informed Reinforcement Learning for Perception and Reasoning
about Fluids [0.0]
We propose a physics-informed reinforcement learning strategy for fluid perception and reasoning from observations.
We develop a method for the tracking (perception) and analysis (reasoning) of any previously unseen liquid whose free surface is observed with a commodity camera.
arXiv Detail & Related papers (2022-03-11T07:01:23Z) - NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural
Radiance Fields [65.07940731309856]
Deep learning has shown great potential for modeling the physical dynamics of complex particle systems such as fluids.
In this paper, we consider a partially observable scenario known as fluid dynamics grounding.
We propose a differentiable two-stage network named NeuroFluid.
It is shown to reasonably estimate the underlying physics of fluids with different initial shapes, viscosity, and densities.
arXiv Detail & Related papers (2022-03-03T15:13:29Z) - Dominant motion identification of multi-particle system using deep
learning from video [0.0]
In this work, we provide a deep-learning framework that extracts relevant information from real-world videos of highly systems.
We demonstrate this approach on videos of confined multi-agent/particle systems of ants, termites, fishes.
Furthermore, we explore how these seemingly diverse systems have predictable underlying behavior.
arXiv Detail & Related papers (2021-04-26T17:10:56Z) - Focus of Attention Improves Information Transfer in Visual Features [80.22965663534556]
This paper focuses on unsupervised learning for transferring visual information in a truly online setting.
The computation of the entropy terms is carried out by a temporal process which yields online estimation of the entropy terms.
In order to better structure the input probability distribution, we use a human-like focus of attention model.
arXiv Detail & Related papers (2020-06-16T15:07:25Z) - Neural Vortex Method: from Finite Lagrangian Particles to Infinite
Dimensional Eulerian Dynamics [16.563723810812807]
We propose a novel learning-based framework, the Neural Vortex Method (NVM)
NVM builds a neural-network description of the Lagrangian vortex structures and their interaction dynamics.
By embedding these two networks with a vorticity-to-velocity Poisson solver, we can predict the accurate fluid dynamics.
arXiv Detail & Related papers (2020-06-07T15:12:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.