Unsupervised Learning of Particle Image Velocimetry
- URL: http://arxiv.org/abs/2007.14487v1
- Date: Tue, 28 Jul 2020 21:08:37 GMT
- Title: Unsupervised Learning of Particle Image Velocimetry
- Authors: Mingrui Zhang and Matthew D. Piggott
- Abstract summary: Deep learning has inspired new approaches to tackle the Particle Image Velocimetry problem.
It is difficult to collect reliable ground truth data in large-scale, real-world scenarios.
We present here what we believe to be the first work which takes an unsupervised learning based approach to tackle PIV problems.
- Score: 6.69579674554491
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Particle Image Velocimetry (PIV) is a classical flow estimation problem which
is widely considered and utilised, especially as a diagnostic tool in
experimental fluid dynamics and the remote sensing of environmental flows.
Recently, the development of deep learning based methods has inspired new
approaches to tackle the PIV problem. These supervised learning based methods
are driven by large volumes of data with ground truth training information.
However, it is difficult to collect reliable ground truth data in large-scale,
real-world scenarios. Although synthetic datasets can be used as alternatives,
the gap between the training set-ups and real-world scenarios limits
applicability. We present here what we believe to be the first work which takes
an unsupervised learning based approach to tackle PIV problems. The proposed
approach is inspired by classic optical flow methods. Instead of using ground
truth data, we make use of photometric loss between two consecutive image
frames, consistency loss in bidirectional flow estimates and spatial smoothness
loss to construct the total unsupervised loss function. The approach shows
significant potential and advantages for fluid flow estimation. Results
presented here demonstrate that our method outputs competitive results compared
with classical PIV methods as well as supervised learning based methods for a
broad PIV dataset, and even outperforms these existing approaches in some
difficult flow cases. Codes and trained models are available at
https://github.com/erizmr/UnLiteFlowNet-PIV.
Related papers
- Diffusion-Based Particle-DETR for BEV Perception [94.88305708174796]
Bird-Eye-View (BEV) is one of the most widely-used scene representations for visual perception in Autonomous Vehicles (AVs)
Recent diffusion-based methods offer a promising approach to uncertainty modeling for visual perception but fail to effectively detect small objects in the large coverage of the BEV.
Here, we address this problem by combining the diffusion paradigm with current state-of-the-art 3D object detectors in BEV.
arXiv Detail & Related papers (2023-12-18T09:52:14Z) - Diffusion Generative Flow Samplers: Improving learning signals through
partial trajectory optimization [87.21285093582446]
Diffusion Generative Flow Samplers (DGFS) is a sampling-based framework where the learning process can be tractably broken down into short partial trajectory segments.
Our method takes inspiration from the theory developed for generative flow networks (GFlowNets)
arXiv Detail & Related papers (2023-10-04T09:39:05Z) - Taming Contrast Maximization for Learning Sequential, Low-latency,
Event-based Optical Flow [18.335337530059867]
Event cameras have gained significant traction since they open up new avenues for low-latency and low-power solutions to complex computer vision problems.
To unlock these solutions, it is necessary to develop algorithms that can leverage the unique nature of event data.
In this work, we propose a novel self-supervised learning pipeline for the estimation of event-based optical flow.
arXiv Detail & Related papers (2023-03-09T12:37:33Z) - Minimizing the Accumulated Trajectory Error to Improve Dataset
Distillation [151.70234052015948]
We propose a novel approach that encourages the optimization algorithm to seek a flat trajectory.
We show that the weights trained on synthetic data are robust against the accumulated errors perturbations with the regularization towards the flat trajectory.
Our method, called Flat Trajectory Distillation (FTD), is shown to boost the performance of gradient-matching methods by up to 4.7%.
arXiv Detail & Related papers (2022-11-20T15:49:11Z) - Guaranteed Conservation of Momentum for Learning Particle-based Fluid
Dynamics [96.9177297872723]
We present a novel method for guaranteeing linear momentum in learned physics simulations.
We enforce conservation of momentum with a hard constraint, which we realize via antisymmetrical continuous convolutional layers.
In combination, the proposed method allows us to increase the physical accuracy of the learned simulator substantially.
arXiv Detail & Related papers (2022-10-12T09:12:59Z) - Semi-Supervised Learning of Optical Flow by Flow Supervisor [16.406213579356795]
We propose a practical fine tuning method to adapt a pretrained model to a target dataset without ground truth flows.
This design is aimed at stable convergence and better accuracy over conventional self-supervision methods.
We achieve meaningful improvements over state-of-the-art optical flow models on Sintel and KITTI benchmarks.
arXiv Detail & Related papers (2022-07-21T06:11:52Z) - Learning to Estimate and Refine Fluid Motion with Physical Dynamics [9.258258917049845]
We propose an unsupervised learning based prediction-correction scheme for fluid flow estimation.
An estimate is first given by a PDE-constrained optical flow predictor, which is then refined by a physical based corrector.
The proposed approach can generalize to complex real-world fluid scenarios where ground truth information is effectively unknowable.
arXiv Detail & Related papers (2022-06-21T15:46:49Z) - Occlusion-aware Unsupervised Learning of Depth from 4-D Light Fields [50.435129905215284]
We present an unsupervised learning-based depth estimation method for 4-D light field processing and analysis.
Based on the basic knowledge of the unique geometry structure of light field data, we explore the angular coherence among subsets of the light field views to estimate depth maps.
Our method can significantly shrink the performance gap between the previous unsupervised method and supervised ones, and produce depth maps with comparable accuracy to traditional methods with obviously reduced computational cost.
arXiv Detail & Related papers (2021-06-06T06:19:50Z) - DEALIO: Data-Efficient Adversarial Learning for Imitation from
Observation [57.358212277226315]
In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator.
Recent methods based on adversarial imitation learning have led to state-of-the-art performance on IfO problems, but they typically suffer from high sample complexity due to a reliance on data-inefficient, model-free reinforcement learning algorithms.
This issue makes them impractical to deploy in real-world settings, where gathering samples can incur high costs in terms of time, energy, and risk.
We propose a more data-efficient IfO algorithm
arXiv Detail & Related papers (2021-03-31T23:46:32Z) - Neural Particle Image Velocimetry [4.416484585765027]
We introduce a convolutional neural network adapted to the problem, namely Volumetric Correspondence Network (VCN)
The network is thoroughly trained and tested on a dataset containing both synthetic and real flow data.
Our analysis indicates that the proposed approach provides improved efficiency also keeping accuracy on par with other state-of-the-art methods in the field.
arXiv Detail & Related papers (2021-01-28T12:03:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.