Learning to swim efficiently in a nonuniform flow field

• URL: http://arxiv.org/abs/2212.11482v1
• Date: Thu, 22 Dec 2022 04:51:47 GMT
• Title: Learning to swim efficiently in a nonuniform flow field
• Authors: Krongtum Sankaewtong, John J. Molina, Matthew S. Turner and Ryoichi Yamamoto
• Abstract summary: Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. We study how local and non-local information can be used to train a swimmer to achieve particular swimming tasks.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. They can then navigate in response to these signals. We analyse this navigation by combining deep reinforcement learning with direct numerical simulations to resolve the hydrodynamics. We study how local and non-local information can be used to train a swimmer to achieve particular swimming tasks in a non-uniform flow field, in particular a zig-zag shear flow. The swimming tasks are (1) learning how to swim in the vorticity direction, (2) the shear-gradient direction, and (3) the shear flow direction. We find that access to lab frame information on the swimmer's instantaneous orientation is all that is required in order to reach the optimal policy for (1,2). However, information on both the translational and rotational velocities seem to be required to achieve (3). Inspired by biological microorganisms we also consider the case where the swimmers sense local information, i.e. surface hydrodynamic forces, together with a signal direction. This might correspond to gravity or, for micro-organisms with light sensors, a light source. In this case, we show that the swimmer can reach a comparable level of performance as a swimmer with access to lab frame variables. We also analyse the role of different swimming modes, i.e. pusher, puller, and neutral swimmers.

Related papers

• Deep reinforcement learning for tracking a moving target in jellyfish-like swimming [16.727471388063893]
  We develop a deep reinforcement learning method for training a jellyfish-like swimmer to track a moving target in a two-dimensional flow. We employ a deep Q-network (DQN) that takes the swimmer's geometry and dynamic parameters as inputs, and outputs actions which are the forces applied to the swimmer.
  arXiv  Detail & Related papers  (2024-09-13T13:29:46Z)
• Emergence of Chemotactic Strategies with Multi-Agent Reinforcement Learning [1.9253333342733674]
  We investigate whether reinforcement learning can provide insights into biological systems when trained to perform chemotaxis. We run simulations covering a range of agent shapes, sizes, and swim speeds to determine if the physical constraints on biological swimmers, namely Brownian motion, lead to regions where reinforcement learners' training fails. We find that RL agents can perform chemotaxis as soon as it is physically possible and, in some cases, even before the active swimming overpowers the environment.
  arXiv  Detail & Related papers  (2024-04-02T14:42:52Z)
• Learning to Predict Navigational Patterns from Partial Observations [63.04492958425066]
  This paper presents the first self-supervised learning (SSL) method for learning to infer navigational patterns in real-world environments from partial observations only. We demonstrate how to infer global navigational patterns by fitting a maximum likelihood graph to the DSLP field. Experiments show that our SSL model outperforms two SOTA supervised lane graph prediction models on the nuScenes dataset.
  arXiv  Detail & Related papers  (2023-04-26T02:08:46Z)
• How to Track and Segment Fish without Human Annotations: A Self-Supervised Deep Learning Approach [3.0516727053033392]
  Training deep neural networks (DNNs) for fish tracking and segmentation requires high-quality labels. We propose an unsupervised approach that relies on spatial and temporal variations in video data to generate noisy pseudo-ground-truth labels. Our framework consists of three stages: (1) an optical flow model generates the pseudo labels using spatial and temporal consistency between frames, (2) a self-supervised model refines the pseudo-labels incrementally, and (3) a segmentation network uses the refined labels for training.
  arXiv  Detail & Related papers  (2022-08-23T01:01:27Z)
• Learning-based estimation of in-situ wind speed from underwater acoustics [58.293528982012255]
  We introduce a deep learning approach for the retrieval of wind speed time series from underwater acoustics. Our approach bridges data assimilation and learning-based frameworks to benefit both from prior physical knowledge and computational efficiency.
  arXiv  Detail & Related papers  (2022-08-18T15:27:40Z)
• Position fixing with cold atom gravity gradiometers [56.45088569868981]
  We propose a position fixing method for autonomous navigation using partial gravity gradient solutions from cold atom interferometers. Using standard open source global gravity databases, we show stable navigation solutions for trajectories of over 1000km.
  arXiv  Detail & Related papers  (2022-04-11T16:42:32Z)
• Simultaneous boundary shape estimation and velocity field de-noising in Magnetic Resonance Velocimetry using Physics-informed Neural Networks [70.7321040534471]
  Magnetic resonance velocimetry (MRV) is a non-invasive technique widely used in medicine and engineering to measure the velocity field of a fluid. Previous studies have required the shape of the boundary (for example, a blood vessel) to be known a priori. We present a physics-informed neural network that instead uses the noisy MRV data alone to infer the most likely boundary shape and de-noised velocity field.
  arXiv  Detail & Related papers  (2021-07-16T12:56:09Z)
• Learning Efficient Navigation in Vortical Flow Fields [6.585044528359311]
  We apply a novel Reinforcement Learning algorithm to steer a fixed-speed swimmer through an unsteady two-dimensional flow field. The algorithm entails inputting environmental cues into a deep neural network that determines the swimmer's actions. A velocity sensing approach outperformed a bio-mimetic vorticity sensing approach by nearly two-fold in success rate.
  arXiv  Detail & Related papers  (2021-02-21T07:25:03Z)
• Learning to swim in potential flow [17.146927368452598]
  We propose a simple model of a three-link fish swimming in a potential flow environment. We arrive at optimal shape changes for two swimming tasks. Although the fish has no direct control over the drift itself, it learns to take advantage of the presence of moderate drift to reach its target.
  arXiv  Detail & Related papers  (2020-09-30T06:31:27Z)
• A Data Scientist's Guide to Streamflow Prediction [55.22219308265945]
  We focus on the element of hydrologic rainfall--runoff models and their application to forecast floods and predict streamflow. This guide aims to help interested data scientists gain an understanding of the problem, the hydrologic concepts involved, and the details that come up along the way.
  arXiv  Detail & Related papers  (2020-06-05T08:04:37Z)
• Pedestrian orientation dynamics from high-fidelity measurements [65.06084067891364]
  We propose a novel measurement method based on a deep neural architecture that we train on the basis of generic physical properties of the motion of pedestrians. We show that our method is capable of estimating orientation with an error as low as 7.5 degrees. This tool opens up new possibilities in the studies of human crowd dynamics where orientation is key.
  arXiv  Detail & Related papers  (2020-01-14T07:08:31Z)
• Towards Automated Swimming Analytics Using Deep Neural Networks [28.167294398293297]
  Methods for creating a system to automate the collection of swimming analytics are considered in this paper. The result is a guide to the creation of a comprehensive collection of swimming data suitable for training swimmer detection and tracking systems.
  arXiv  Detail & Related papers  (2020-01-13T18:06:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.