Learning swimming escape patterns under energy constraints

• URL: http://arxiv.org/abs/2105.00771v1
• Date: Mon, 3 May 2021 11:58:37 GMT
• Title: Learning swimming escape patterns under energy constraints
• Authors: Ioannis Mandralis, Pascal Weber, Guido Novati, Petros Koumoutsakos
• Abstract summary: Flow simulations have identified escape patterns consistent with those observed in natural larval swimmers. We deploy reinforcement learning to discover swimmer escape patterns under energy constraints.
• Score: 6.014777261874645
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent with those observed in natural larval swimmers. However, these patterns have been limited by the specification of a particular cost function and depend on a prescribed functional form of the body motion. Here, we deploy reinforcement learning to discover swimmer escape patterns under energy constraints. The identified patterns include the C-start mechanism, in addition to more energetically efficient escapes. We find that maximizing distance with limited energy requires swimming via short bursts of accelerating motion interlinked with phases of gliding. The present, data efficient, reinforcement learning algorithm results in an array of patterns that reveal practical flow optimization principles for efficient swimming and the methodology can be transferred to the control of aquatic robotic devices operating under energy constraints.

Related papers

• AI-Enhanced Automatic Design of Efficient Underwater Gliders [60.45821679800442]
  Building an automated design framework is challenging due to the complexities of representing glider shapes and the high computational costs associated with modeling complex solid-fluid interactions. We introduce an AI-enhanced automated computational framework designed to overcome these limitations by enabling the creation of underwater robots with non-trivial hull shapes. Our approach involves an algorithm that co-optimizes both shape and control signals, utilizing a reduced-order geometry representation and a differentiable neural-network-based fluid surrogate model.
  arXiv  Detail & Related papers  (2025-04-30T23:55:44Z)
• Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control [16.319698848279966]
  We present Diffuse-CLoC, a guided diffusion framework for physics-based look-ahead control. It enables intuitive, steerable, and physically realistic motion generation.
  arXiv  Detail & Related papers  (2025-03-14T18:42:29Z)
• Deep reinforcement learning for tracking a moving target in jellyfish-like swimming [16.727471388063893]
  We develop a deep reinforcement learning method for training a jellyfish-like swimmer to track a moving target in a two-dimensional flow. We employ a deep Q-network (DQN) that takes the swimmer's geometry and dynamic parameters as inputs, and outputs actions which are the forces applied to the swimmer.
  arXiv  Detail & Related papers  (2024-09-13T13:29:46Z)
• Unfolding Time: Generative Modeling for Turbulent Flows in 4D [49.843505326598596]
  This work introduces a 4D generative diffusion model and a physics-informed guidance technique that enables the generation of realistic sequences of flow states. Our findings indicate that the proposed method can successfully sample entire subsequences from the turbulent manifold. This advancement opens doors for the application of generative modeling in analyzing the temporal evolution of turbulent flows.
  arXiv  Detail & Related papers  (2024-06-17T10:21:01Z)
• Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations [53.797896854533384]
  Class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming. We introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively.
  arXiv  Detail & Related papers  (2024-03-20T02:58:45Z)
• VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation [78.92147339883137]
  We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
  arXiv  Detail & Related papers  (2022-05-02T19:49:53Z)
• Fast Aquatic Swimmer Optimization with Differentiable Projective Dynamics and Neural Network Hydrodynamic Models [23.480913364381664]
  Aquatic locomotion is a classic fluid-structure interaction (FSI) problem of interest to biologists and engineers. We present a novel, fully differentiable hybrid approach to FSI that combines a 2D numerical simulation for the deformable solid structure of the swimmer. We demonstrate the computational efficiency and differentiability of our hybrid simulator on a 2D carangiform swimmer.
  arXiv  Detail & Related papers  (2022-03-30T15:21:44Z)
• Optimizing Airborne Wind Energy with Reinforcement Learning [0.0]
  Reinforcement Learning is a technique that learns to associate observations with profitable actions without requiring prior knowledge of the system. We show that in a simulated environment Reinforcement Learning finds an efficient way to control a kite so that it can tow a vehicle for long distances.
  arXiv  Detail & Related papers  (2022-03-27T10:28:16Z)
• Next Steps: Learning a Disentangled Gait Representation for Versatile Quadruped Locomotion [69.87112582900363]
  Current planners are unable to vary key gait parameters continuously while the robot is in motion. In this work we address this limitation by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, foot step height and full stance duration.
  arXiv  Detail & Related papers  (2021-12-09T10:02:02Z)
• DiffAqua: A Differentiable Computational Design Pipeline for Soft Underwater Swimmers with Shape Interpolation [31.857848904652222]
  We present a differentiable pipeline for co-designing a soft swimmer's geometry and controller. Our pipeline unlocks gradient-based algorithms for discovering novel swimmer designs. We demonstrate the efficacy of our method on various design problems such as fast, stable, and energy-efficient swimming.
  arXiv  Detail & Related papers  (2021-04-02T01:18:15Z)
• Learning to swim in potential flow [17.146927368452598]
  We propose a simple model of a three-link fish swimming in a potential flow environment. We arrive at optimal shape changes for two swimming tasks. Although the fish has no direct control over the drift itself, it learns to take advantage of the presence of moderate drift to reach its target.
  arXiv  Detail & Related papers  (2020-09-30T06:31:27Z)
• Wave Propagation of Visual Stimuli in Focus of Attention [77.4747032928547]
  Fast reactions to changes in the surrounding visual environment require efficient attention mechanisms to reallocate computational resources to most relevant locations in the visual field. We present a biologically-plausible model of focus of attention that exhibits effectiveness and efficiency exhibited by foveated animals.
  arXiv  Detail & Related papers  (2020-06-19T09:33:21Z)
• Learn to cycle: Time-consistent feature discovery for action recognition [83.43682368129072]
  Generalizing over temporal variations is a prerequisite for effective action recognition in videos. We introduce Squeeze Re Temporal Gates (SRTG), an approach that favors temporal activations with potential variations. We show consistent improvement when using SRTPG blocks, with only a minimal increase in the number of GFLOs.
  arXiv  Detail & Related papers  (2020-06-15T09:36:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.