Stonefish: Supporting Machine Learning Research in Marine Robotics

• URL: http://arxiv.org/abs/2502.11887v1
• Date: Mon, 17 Feb 2025 15:13:41 GMT
• Title: Stonefish: Supporting Machine Learning Research in Marine Robotics
• Authors: Michele Grimaldi, Patryk Cieslak, Eduardo Ochoa, Vibhav Bharti, Hayat Rajani, Ignacio Carlucho, Maria Koskinopoulou, Yvan R. Petillot, Nuno Gracias,
• Abstract summary: This paper highlights recent enhancements to the Stonefish simulator, an open-source platform supporting development and testing of marine robotics solutions.<n>Key updates include a suite of additional sensors, as well as, visual light communication, support for tethered operations, improved thruster modelling, more flexible hydrodynamics, and enhanced sonar accuracy.
• Score: 5.021710505685786
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Simulations are highly valuable in marine robotics, offering a cost-effective and controlled environment for testing in the challenging conditions of underwater and surface operations. Given the high costs and logistical difficulties of real-world trials, simulators capable of capturing the operational conditions of subsea environments have become key in developing and refining algorithms for remotely-operated and autonomous underwater vehicles. This paper highlights recent enhancements to the Stonefish simulator, an advanced open-source platform supporting development and testing of marine robotics solutions. Key updates include a suite of additional sensors, such as an event-based camera, a thermal camera, and an optical flow camera, as well as, visual light communication, support for tethered operations, improved thruster modelling, more flexible hydrodynamics, and enhanced sonar accuracy. These developments and an automated annotation tool significantly bolster Stonefish's role in marine robotics research, especially in the field of machine learning, where training data with a known ground truth is hard or impossible to collect.

Related papers

• AI-Enhanced Automatic Design of Efficient Underwater Gliders [60.45821679800442]
  Building an automated design framework is challenging due to the complexities of representing glider shapes and the high computational costs associated with modeling complex solid-fluid interactions. We introduce an AI-enhanced automated computational framework designed to overcome these limitations by enabling the creation of underwater robots with non-trivial hull shapes. Our approach involves an algorithm that co-optimizes both shape and control signals, utilizing a reduced-order geometry representation and a differentiable neural-network-based fluid surrogate model.
  arXiv  Detail & Related papers  (2025-04-30T23:55:44Z)
• Learning Underwater Active Perception in Simulation [51.205673783866146]
  Turbidity can jeopardise the whole mission as it may prevent correct visual documentation of the inspected structures. Previous works have introduced methods to adapt to turbidity and backscattering. We propose a simple yet efficient approach to enable high-quality image acquisition of assets in a broad range of water conditions.
  arXiv  Detail & Related papers  (2025-04-23T06:48:38Z)
• Unreal Robotics Lab: A High-Fidelity Robotics Simulator with Advanced Physics and Rendering [4.760567755149477]
  This paper presents a novel simulation framework that integrates the Unreal Engine's advanced rendering capabilities with MuJoCo's high-precision physics simulation. Our approach enables realistic robotic perception while maintaining accurate physical interactions. We benchmark visual navigation and SLAM methods within our framework, demonstrating its utility for testing real-world robustness in controlled yet diverse scenarios.
  arXiv  Detail & Related papers  (2025-04-19T01:54:45Z)
• Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation [50.34179054785646]
  We present Taccel, a high-performance simulation platform that integrates IPC and ABD to model robots, tactile sensors, and objects with both accuracy and unprecedented speed. Taccel provides precise physics simulation and realistic tactile signals while supporting flexible robot-sensor configurations through user-friendly APIs. These capabilities position Taccel as a powerful tool for scaling up tactile robotics research and development.
  arXiv  Detail & Related papers  (2025-04-17T12:57:11Z)
• Deep Learning-Enhanced Visual Monitoring in Hazardous Underwater Environments with a Swarm of Micro-Robots [8.38975683806005]
  monitoring and exploration of extreme environments, such as underwater storage facilities, is costly, labor-intensive and hazardous. We propose a novel approach that integrates a multi-temporal deep learning network for coordinate prediction, and image reassembly. Results demonstrate very high coordinate prediction accuracy and plausible image assembly, indicating the real-world applicability of our approach.
  arXiv  Detail & Related papers  (2025-03-04T16:19:06Z)
• Underwater Soft Fin Flapping Motion with Deep Neural Network Based Surrogate Model [0.31457219084519]
  This study presents a novel framework for precise force control of fin-actuated underwater robots by integrating a deep neural network (DNN)-based surrogate model with reinforcement learning (RL)<n>To address the complex interactions with the underwater environment and the high experimental costs, a surrogate model acts as a simulator for enabling efficient training for the RL agent.
  arXiv  Detail & Related papers  (2025-02-05T12:57:53Z)
• Towards an Autonomous Surface Vehicle Prototype for Artificial Intelligence Applications of Water Quality Monitoring [68.41400824104953]
  This paper presents a vehicle prototype that addresses the use of Artificial Intelligence algorithms and enhanced sensing techniques for water quality monitoring. The vehicle is fully equipped with high-quality sensors to measure water quality parameters and water depth. By means of a stereo-camera, it also can detect and locate macro-plastics in real environments.
  arXiv  Detail & Related papers  (2024-10-08T10:35:32Z)
• Learning Adaptive Hydrodynamic Models Using Neural ODEs in Complex Conditions [9.392180262607921]
  Reinforcement learning-based quadruped robots excel across various terrains but still lack the ability to swim in water. This paper presents the development and evaluation of a data-driven hydrodynamic model for amphibious quadruped robots.
  arXiv  Detail & Related papers  (2024-10-01T08:18:36Z)
• ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics [14.935296890629795]
  Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits. Current monitoring strategies often rely on destructive methods. We propose a novel pipeline using stable diffusion to augment a collected real dataset with realistic synthetic data.
  arXiv  Detail & Related papers  (2024-09-11T04:31:09Z)
• Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks [93.38375271826202]
  We present a method to improve generalization and robustness to distribution shifts in sim-to-real visual quadrotor navigation tasks. We first build a simulator by integrating Gaussian splatting with quadrotor flight dynamics, and then, train robust navigation policies using Liquid neural networks. In this way, we obtain a full-stack imitation learning protocol that combines advances in 3D Gaussian splatting radiance field rendering, programming of expert demonstration training data, and the task understanding capabilities of Liquid networks.
  arXiv  Detail & Related papers  (2024-06-21T13:48:37Z)
• Aquatic Navigation: A Challenging Benchmark for Deep Reinforcement Learning [53.3760591018817]
  We propose a new benchmarking environment for aquatic navigation using recent advances in the integration between game engines and Deep Reinforcement Learning. Specifically, we focus on PPO, one of the most widely accepted algorithms, and we propose advanced training techniques. Our empirical evaluation shows that a well-designed combination of these ingredients can achieve promising results.
  arXiv  Detail & Related papers  (2024-05-30T23:20:23Z)
• Reinforcement-learning robotic sailboats: simulator and preliminary results [0.37918614538294315]
  This work focuses on the main challenges and problems in developing a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds, considering using Reinforcement Learning (RL) agents for autonomous navigation and control.
  arXiv  Detail & Related papers  (2024-01-16T09:04:05Z)
• Autoencoding a Soft Touch to Learn Grasping from On-land to Underwater [17.27917150366665]
  This study investigates the transferability of grasping knowledge from on-land to underwater via a vision-based soft robotic finger. A high-framerate camera captures the whole-body deformations while a soft robotic finger interacts with physical objects on-land and underwater. Results show that the trained SVAE model learned a series of latent representations of the soft mechanics transferrable from land to water.
  arXiv  Detail & Related papers  (2023-08-16T17:07:37Z)
• Deep Learning for Real Time Satellite Pose Estimation on Low Power Edge TPU [58.720142291102135]
  In this paper we propose a pose estimation software exploiting neural network architectures. We show how low power machine learning accelerators could enable Artificial Intelligence exploitation in space.
  arXiv  Detail & Related papers  (2022-04-07T08:53:18Z)
• Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
  A fully-autonomous aerial robot for high-speed object grasping has been proposed. As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface. Our approach has been validated in a challenging international competition and has shown outstanding results.
  arXiv  Detail & Related papers  (2021-12-10T11:49:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.