OceanMAE: A Foundation Model for Ocean Remote Sensing

• URL: http://arxiv.org/abs/2604.08171v1
• Date: Thu, 09 Apr 2026 12:29:41 GMT
• Title: OceanMAE: A Foundation Model for Ocean Remote Sensing
• Abstract summary: Ocean remote sensing is essential for applications such as bathymetry estimation, seabed characterization, marine litter detection, and ecosystem monitoring.<n>We propose OceanMAE, an ocean-specific masked autoencoder that extends standard MAE pre-training by integrating multispectral Sentinel-2 observations with physically meaningful ocean descriptors during self-supervised learning.<n>Experiments show that OceanMAE yields the strongest gains on marine segmentation, while bathymetry benefits are competitive and task-dependent.
• Score: 7.641383692351135
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurate ocean mapping is essential for applications such as bathymetry estimation, seabed characterization, marine litter detection, and ecosystem monitoring. However, ocean remote sensing (RS) remains constrained by limited labeled data and by the reduced transferability of models pre-trained mainly on land-dominated Earth observation imagery. In this paper, we propose OceanMAE, an ocean-specific masked autoencoder that extends standard MAE pre-training by integrating multispectral Sentinel-2 observations with physically meaningful ocean descriptors during self-supervised learning. By incorporating these auxiliary ocean features, OceanMAE is designed to learn more informative and ocean-aware latent representations from large- scale unlabeled data. To transfer these representations to downstream applications, we further employ a modified UNet-based framework for marine segmentation and bathymetry estimation. Pre-trained on the Hydro dataset, OceanMAE is evaluated on MADOS and MARIDA for marine pollutant and debris segmentation, and on MagicBathyNet for bathymetry regression. The experiments show that OceanMAE yields the strongest gains on marine segmentation, while bathymetry benefits are competitive and task-dependent. In addition, an ablation against a standard MAE on MARIDA indicates that incorporating auxiliary ocean descriptors during pre-training improves downstream segmentation quality. These findings highlight the value of physically informed and domain-aligned self-supervised pre- training for ocean RS. Code and weights are publicly available at https://git.tu-berlin.de/joanna.stamer/SSLORS2.

Related papers

• OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models [57.19693589926157]
  OceanPile is a large-scale multimodal corpus designed for ocean foundation models.<n>It comprises three key components: OceanCorpus, OceanInstruction, and OceanBenchmark.<n>All datasets are publicly released to advance the field of marine artificial intelligence.
  arXiv  Detail & Related papers  (2026-04-25T14:53:37Z)
• OceanSAR-2: A Universal Feature Extractor for SAR Ocean Observation [55.978228064498865]
  We present OceanSAR-2, the second generation of our foundation model for SAR-based ocean observation.<n>Building on our earlier release, which pioneered self-supervised learning on Sentinel-1 Wave Mode data, OceanSAR-2 relies on improved SSL training and dynamic data curation strategies.
  arXiv  Detail & Related papers  (2026-01-12T10:20:43Z)
• MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignment [56.88334234553316]
  We introduce textbfMARIS (underlineMarine Open-Vocabulary underlineInstance underlineSegmentation), the first large-scale fine-grained benchmark for underwater Open-Vocabulary (OV) segmentation.<n>Our framework consistently outperforms existing OV baselines both In-Domain and Cross-Domain setting.
  arXiv  Detail & Related papers  (2025-10-17T07:50:58Z)
• OceanGym: A Benchmark Environment for Underwater Embodied Agents [69.56465775825275]
  OceanGym is the first comprehensive benchmark for ocean underwater embodied agents.<n>It is designed to advance AI in one of the most demanding real-world environments.<n>By providing a high-fidelity, rigorously designed platform, OceanGym establishes a testbed for developing robust embodied AI.
  arXiv  Detail & Related papers  (2025-09-30T17:09:32Z)
• A Sentinel-3 foundation model for ocean colour [8.571925606193703]
  We describe a new foundation model using the Prithvi-EO Vision Transformer architecture which has been pre-trained to reconstruct data from the Sentinel-3 Ocean and Land Colour Instrument (OLCI)<n>We evaluate the model by fine-tuning on two downstream marine earth observation tasks.<n>We conclude that this new generation of geospatial AI models has the potential to provide more robust, data-driven insights into ocean ecosystems and their role in global climate processes.
  arXiv  Detail & Related papers  (2025-09-25T15:00:38Z)
• OKG-LLM: Aligning Ocean Knowledge Graph with Observation Data via LLMs for Global Sea Surface Temperature Prediction [70.48962924608033]
  This work presents the first systematic effort to construct an Ocean Knowledge Graph (OKG) specifically designed to represent diverse ocean knowledge for SST prediction.<n>We develop a graph embedding network to learn the comprehensive semantic and structural knowledge within the OKG, capturing both the unique characteristics of individual sea regions and the complex correlations between them. Finally, we align the learned knowledge with fine-grained numerical SST data and leverage a pre-trained LLM to model SST patterns for accurate prediction.
  arXiv  Detail & Related papers  (2025-07-31T02:06:03Z)
• MarineDet: Towards Open-Marine Object Detection [13.58409623192008]
  Open-marine object detection (OMOD for short) is required to detect diverse and unseen marine objects, performing categorization and localization simultaneously. We formulate a joint visual-text semantic space through pre-training and then perform marine-specific training to achieve in-air-to-marine knowledge transfer. experimental results demonstrate the superior performance of MarineDet over existing generalist and specialist object detection algorithms.
  arXiv  Detail & Related papers  (2023-10-03T10:13:42Z)
• OceanBench: The Sea Surface Height Edition [5.307677318971956]
  Ocean satellite data presents challenges for information extraction due to their sparsity and irregular sampling, signal complexity, and noise. Machine learning (ML) techniques have demonstrated their capabilities in dealing with large-scale, complex signals. OceanBench is a unifying framework that provides standardized processing steps that comply with domain-expert standards.
  arXiv  Detail & Related papers  (2023-09-27T12:00:40Z)
• Large-scale Detection of Marine Debris in Coastal Areas with Sentinel-2 [3.6842260407632903]
  Efforts to quantify marine pollution are often conducted with sparse and expensive beach surveys. Satellite data of coastal areas is readily available and can be leveraged to detect aggregations of marine debris containing plastic litter. We present a detector for marine debris built on a deep segmentation model that outputs a probability for marine debris at the pixel level.
  arXiv  Detail & Related papers  (2023-07-05T17:38:48Z)
• 1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results [152.54137779547068]
  This report summarizes the main findings of the individual subchallenges and introduces a new benchmark, called SeaDronesSee Object Detection v2. The datasets, evaluation code and the leaderboard are publicly available at https://seadronessee.cs.uni-tuebingen.de/macvi.
  arXiv  Detail & Related papers  (2022-11-24T09:59:13Z)
• SALT: Sea lice Adaptive Lattice Tracking -- An Unsupervised Approach to Generate an Improved Ocean Model [72.3183990520267]
  We propose SALT: Sea lice Adaptive Lattice Tracking approach for efficient estimation of sea lice dispersion and distribution. Specifically, an adaptive spatial mesh is generated by merging nodes in the lattice graph of the Ocean Model based on local ocean properties. The proposed SALT technique shows promise for enhancing proactive aquaculture management through predictive modelling of sea lice infestation pressure maps in a changing climate.
  arXiv  Detail & Related papers  (2021-06-24T17:29:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.