OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models

• URL: http://arxiv.org/abs/2605.00877v1
• Date: Sat, 25 Apr 2026 14:53:37 GMT
• Title: OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
• Abstract summary: OceanPile is a large-scale multimodal corpus designed for ocean foundation models.<n>It comprises three key components: OceanCorpus, OceanInstruction, and OceanBenchmark.<n>All datasets are publicly released to advance the field of marine artificial intelligence.
• Score: 57.19693589926157
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The vast and underexplored ocean plays a critical role in regulating global climate and supporting marine biodiversity, yet artificial intelligence has so far delivered limited impact in this domain due to a fundamental data bottleneck. Specifically, ocean data are highly fragmented across disparate sources and inherently exhibit multi-modal, high-noise, and weakly labeled characteristics, lacking unified schemas and semantic alignment. Although Multimodal Large Language Models (MLLMs) have achieved remarkable success in general domains, their application to ocean science remains severely constrained by the absence of large-scale, well-aligned multimodal datasets tailored to marine environments. To bridge this gap, we introduce OceanPile, a large-scale multimodal corpus designed for ocean foundation models. It comprises three key components: OceanCorpus, a unified collection integrating sonar data, underwater imagery, marine science visuals, and scientific text from diverse authoritative sources; OceanInstruction, a high-quality instruction dataset synthesized via a novel pipeline guided by a hierarchical Ocean Concept Knowledge Graph; and OceanBenchmark, a manually curated evaluation benchmark for rigorous assessment. We establish a multi-stage quality control process to ensure scientific validity and alignment across modalities. Experimental validation demonstrates significant performance improvements for models trained on our data. All datasets are publicly released to advance the field of marine artificial intelligence and empower domain-specific MLLMs.

Related papers

• Compass: Navigating Global Marine Lead Data Integration through Expert-Guided LLM Agent [55.77954024801206]
  Marine lead (Pb) and its isotopes are critical tracers for ocean circulation and anthropogenic pollution.<n>Manual extraction is unscalable, while general-purpose Large Language Models (LLMs) lack the necessary domain-specific knowledge.<n>We introduce an expert-guided adaptation approach that enables LLMs to perform rigorous scientific data extraction without fine-tuning.
  arXiv  Detail & Related papers  (2026-05-28T14:06:25Z)
• Exploring the Underwater World Segmentation without Extra Training [55.291219073365546]
  We introduce textbfAquaOV255, the first large-scale and fine-grained underwater segmentation dataset.<n>We also present textbfEarth2Ocean, a training-free OV segmentation framework.
  arXiv  Detail & Related papers  (2025-11-11T07:22:56Z)
• OceanGym: A Benchmark Environment for Underwater Embodied Agents [69.56465775825275]
  OceanGym is the first comprehensive benchmark for ocean underwater embodied agents.<n>It is designed to advance AI in one of the most demanding real-world environments.<n>By providing a high-fidelity, rigorously designed platform, OceanGym establishes a testbed for developing robust embodied AI.
  arXiv  Detail & Related papers  (2025-09-30T17:09:32Z)
• A Sentinel-3 foundation model for ocean colour [8.571925606193703]
  We describe a new foundation model using the Prithvi-EO Vision Transformer architecture which has been pre-trained to reconstruct data from the Sentinel-3 Ocean and Land Colour Instrument (OLCI)<n>We evaluate the model by fine-tuning on two downstream marine earth observation tasks.<n>We conclude that this new generation of geospatial AI models has the potential to provide more robust, data-driven insights into ocean ecosystems and their role in global climate processes.
  arXiv  Detail & Related papers  (2025-09-25T15:00:38Z)
• Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection [54.1960918379255]
  Neptune-X is a data-centric generative-selection framework for maritime object detection.<n>X-to-Maritime is a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes.<n>Our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy.
  arXiv  Detail & Related papers  (2025-09-25T04:59:02Z)
• mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data [71.352883755806]
  Multimodal embedding models have gained significant attention for their ability to map data from different modalities, such as text and images, into a unified representation space.<n>However, the limited labeled multimodal data often hinders embedding performance.<n>Recent approaches have leveraged data synthesis to address this problem, yet the quality of synthetic data remains a critical bottleneck.
  arXiv  Detail & Related papers  (2025-02-12T15:03:33Z)
• OceanGPT: A Large Language Model for Ocean Science Tasks [37.053614694078014]
  We introduce OceanGPT, the first-ever large language model in the ocean domain, which is expert in various ocean science tasks. We also propose OceanGPT, a novel framework to automatically obtain a large volume of ocean domain instruction data. We construct the first oceanography benchmark, OceanBench, to evaluate the capabilities of LLMs in the ocean domain.
  arXiv  Detail & Related papers  (2023-10-03T13:17:35Z)
• OceanBench: The Sea Surface Height Edition [5.307677318971956]
  Ocean satellite data presents challenges for information extraction due to their sparsity and irregular sampling, signal complexity, and noise. Machine learning (ML) techniques have demonstrated their capabilities in dealing with large-scale, complex signals. OceanBench is a unifying framework that provides standardized processing steps that comply with domain-expert standards.
  arXiv  Detail & Related papers  (2023-09-27T12:00:40Z)
• AI-GOMS: Large AI-Driven Global Ocean Modeling System [3.635120568177384]
  Ocean modeling is a powerful tool for simulating the physical, chemical, and biological processes of the ocean. Here, we present AI-GOMS, a large AI-driven global ocean modeling system, for accurate and efficient global ocean daily prediction.
  arXiv  Detail & Related papers  (2023-08-06T15:59:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.