Learning to swim in potential flow

• URL: http://arxiv.org/abs/2009.14280v2
• Date: Mon, 7 Dec 2020 23:59:01 GMT
• Title: Learning to swim in potential flow
• Authors: Yusheng Jiao, Feng Ling, Sina Heydari, Nicolas Heess, Josh Merel and Eva Kanso
• Abstract summary: We propose a simple model of a three-link fish swimming in a potential flow environment. We arrive at optimal shape changes for two swimming tasks. Although the fish has no direct control over the drift itself, it learns to take advantage of the presence of moderate drift to reach its target.
• Score: 17.146927368452598
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fish swim by undulating their bodies. These propulsive motions require coordinated shape changes of a body that interacts with its fluid environment, but the specific shape coordination that leads to robust turning and swimming motions remains unclear. To address the problem of underwater motion planning, we propose a simple model of a three-link fish swimming in a potential flow environment and we use model-free reinforcement learning for shape control. We arrive at optimal shape changes for two swimming tasks: swimming in a desired direction and swimming towards a known target. This fish model belongs to a class of problems in geometric mechanics, known as driftless dynamical systems, which allow us to analyze the swimming behavior in terms of geometric phases over the shape space of the fish. These geometric methods are less intuitive in the presence of drift. Here, we use the shape space analysis as a tool for assessing, visualizing, and interpreting the control policies obtained via reinforcement learning in the absence of drift. We then examine the robustness of these policies to drift-related perturbations. Although the fish has no direct control over the drift itself, it learns to take advantage of the presence of moderate drift to reach its target.

Related papers

• AI-Enhanced Automatic Design of Efficient Underwater Gliders [60.45821679800442]
  Building an automated design framework is challenging due to the complexities of representing glider shapes and the high computational costs associated with modeling complex solid-fluid interactions. We introduce an AI-enhanced automated computational framework designed to overcome these limitations by enabling the creation of underwater robots with non-trivial hull shapes. Our approach involves an algorithm that co-optimizes both shape and control signals, utilizing a reduced-order geometry representation and a differentiable neural-network-based fluid surrogate model.
  arXiv  Detail & Related papers  (2025-04-30T23:55:44Z)
• Fine Tuning Swimming Locomotion Learned from Mosquito Larvae [0.9349784561232036]
  In prior research, we analyzed the backwards swimming motion of mosquito larvae, parameterized it, and replicated it in a Computational Fluid Dynamics (CFD) model. In this project, we further optimize this copied solution for the model of the swimmer.
  arXiv  Detail & Related papers  (2024-11-16T06:54:43Z)
• Deep reinforcement learning for tracking a moving target in jellyfish-like swimming [16.727471388063893]
  We develop a deep reinforcement learning method for training a jellyfish-like swimmer to track a moving target in a two-dimensional flow. We employ a deep Q-network (DQN) that takes the swimmer's geometry and dynamic parameters as inputs, and outputs actions which are the forces applied to the swimmer.
  arXiv  Detail & Related papers  (2024-09-13T13:29:46Z)
• CLOAF: CoLlisiOn-Aware Human Flow [90.21089550719488]
  CLOAF exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate body self-intersections. Being differentiable, CLOAF can be used to fine-tune pose and shape estimation baselines to improve their overall performance.
  arXiv  Detail & Related papers  (2024-03-14T02:38:09Z)
• Learning Inverse Kinodynamics for Autonomous Vehicle Drifting [0.0]
  We learn the kinodynamic model of a small autonomous vehicle, and observe the effect it has on motion planning, specifically autonomous drifting. Our approach is able to learn a kinodynamic model for high-speed circular navigation, and is able to avoid obstacles on an autonomous drift at high speed by correcting an executed curvature for loose drifts.
  arXiv  Detail & Related papers  (2024-02-22T19:24:56Z)
• Learning to Transfer In-Hand Manipulations Using a Greedy Shape Curriculum [79.6027464700869]
  We show that natural and robust in-hand manipulation of simple objects in a dynamic simulation can be learned from a high quality motion capture example. We propose a simple greedy curriculum search algorithm that can successfully apply to a range of objects such as a teapot, bunny, bottle, train, and elephant.
  arXiv  Detail & Related papers  (2023-03-14T17:08:19Z)
• Learning to swim efficiently in a nonuniform flow field [0.0]
  Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. We study how local and non-local information can be used to train a swimmer to achieve particular swimming tasks.
  arXiv  Detail & Related papers  (2022-12-22T04:51:47Z)
• DeepMLS: Geometry-Aware Control Point Deformation [76.51312491336343]
  We introduce DeepMLS, a space-based deformation technique, guided by a set of displaced control points. We leverage the power of neural networks to inject the underlying shape geometry into the deformation parameters. Our technique facilitates intuitive piecewise smooth deformations, which are well suited for manufactured objects.
  arXiv  Detail & Related papers  (2022-01-05T23:55:34Z)
• Learning swimming escape patterns under energy constraints [6.014777261874645]
  Flow simulations have identified escape patterns consistent with those observed in natural larval swimmers. We deploy reinforcement learning to discover swimmer escape patterns under energy constraints.
  arXiv  Detail & Related papers  (2021-05-03T11:58:37Z)
• Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motion [63.18340058854517]
  We present an alternative method for end-to-end scene flow learning by joint estimation of non-rigid residual flow and ego-motion flow for dynamic 3D scenes. We extend the supervised framework with self-supervisory signals based on the temporal consistency property of a point cloud sequence.
  arXiv  Detail & Related papers  (2020-09-22T11:39:19Z)
• Contact and Human Dynamics from Monocular Video [73.47466545178396]
  Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors. We present a physics-based method for inferring 3D human motion from video sequences that takes initial 2D and 3D pose estimates as input.
  arXiv  Detail & Related papers  (2020-07-22T21:09:11Z)
• Domain Adaptive Adversarial Learning Based on Physics Model Feedback for Underwater Image Enhancement [10.143025577499039]
  We propose a new robust adversarial learning framework via physics model based feedback control and domain adaptation mechanism for enhancing underwater images. A new method for simulating underwater-like training dataset from RGB-D data by underwater image formation model is proposed. Final enhanced results on synthetic and real underwater images demonstrate the superiority of the proposed method.
  arXiv  Detail & Related papers  (2020-02-20T07:50:00Z)
• Predicting the Physical Dynamics of Unseen 3D Objects [65.49291702488436]
  We focus on predicting the dynamics of 3D objects on a plane that have just been subjected to an impulsive force. Our approach can generalize to object shapes and initial conditions that were unseen during training. Our model can support training with data from both a physics engine or the real world.
  arXiv  Detail & Related papers  (2020-01-16T06:27:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.