ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs
- URL: http://arxiv.org/abs/2605.07338v1
- Date: Fri, 08 May 2026 06:42:55 GMT
- Title: ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs
- Abstract summary: Shellfish biodiversity is a severe threat to coastal ecosystems.<n>ShellfishNet is a comprehensive image benchmark dataset for real-world ecological monitoring constraints.
- Score: 5.457526757904208
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The decline of global shellfish biodiversity poses a severe threat to coastal ecosystems. Although artificial intelligence (AI) technologies show potential for automated ecological monitoring, existing marine benthic datasets often lack adaptation to the complexities of real underwater environments (e.g., variable lighting conditions and diverse species postures), posing challenges for the robust generalization of vision models in practical ecological monitoring. To address this problem, we construct ShellfishNet, a comprehensive image benchmark dataset designed specifically for real-world ecological monitoring constraints. Comprising 8,691 images across 32 taxa, this dataset includes a curated subset annotated with descriptive captions. It is constructed through field photography and web scraping, encompassing samples from complex real-world environments. Based on this benchmark, we systematically evaluate 80 representative neural network models, including Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), State Space Models (SSMs), and Self-Supervised Learning (SSL) methods. Furthermore, we evaluate the performance of fine-grained visual categorization (FGVC) models and investigate the image captioning capabilities of several mainstream multimodal large language models (MLLMs). Meanwhile, we introduce image corruption benchmark tests to simulate common underwater degradation scenarios (turbidity, severe weather) and assess the robustness of vision models, enabling trustworthy decisions on ecological protection in the wild. ShellfishNet is dedicated to providing a data foundation and a model-evaluation benchmark for the intelligent monitoring of benthic organisms.
Related papers
- Robustness Verification of an Autonomous Underwater Vehicle-based Plankton Classifier [1.5749416770494706]
Assessment of planktonic standing stocks and microorganism structures is critical for understanding upper ocean biological processes.<n>Current AI methods often lack robustness in dynamic, unstructured environments.<n>We propose a novel robustness verification framework for in-situ plankton classifiers based on reachability analysis.
arXiv Detail & Related papers (2026-07-05T18:32:59Z) - Deep Learning Models for Coral Bleaching Classification in Multi-Condition Underwater Image Datasets [0.0]
Coral reefs support numerous marine organisms and are an important source of coastal protection from storms and floods.<n>This study presents a novel machine-learning-based coral bleaching classification system based on a diverse global dataset.<n>We benchmarked and compared three state-of-the-art models: Residual Neural Network (ResNet), Vision Transformer (ViT), and Convolutional Neural Network (CNN)
arXiv Detail & Related papers (2025-10-24T06:13:15Z) - UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding [54.16709436340606]
Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding.<n>Underwater imagery presents unique challenges including severe light attenuation, color distortion, and suspended particle scattering.<n>We introduce UWBench, a benchmark specifically designed for underwater vision-language understanding.
arXiv Detail & Related papers (2025-10-21T03:32:15Z) - FishDet-M: A Unified Large-Scale Benchmark for Robust Fish Detection and CLIP-Guided Model Selection in Diverse Aquatic Visual Domains [1.3791394805787949]
FishDet-M is the largest unified benchmark for fish detection, comprising 13 publicly available datasets spanning diverse aquatic environments.<n>All data are harmonized using COCO-style annotations with both bounding boxes and segmentation masks.<n>FishDet-M establishes a standardized and reproducible platform for evaluating object detection in complex aquatic scenes.
arXiv Detail & Related papers (2025-07-23T18:32:01Z) - REOBench: Benchmarking Robustness of Earth Observation Foundation Models [48.24281482353377]
REOBench is the first comprehensive benchmark for evaluating the robustness of Earth observation foundation models.<n>We conduct a systematic evaluation of a broad range of models trained using masked image modeling, contrastive learning, and vision-language pre-training paradigms.<n>Results reveal that existing Earth observation foundation models experience significant performance degradation when exposed to input corruptions.
arXiv Detail & Related papers (2025-05-22T15:34:50Z) - Real-time Seafloor Segmentation and Mapping [0.0]
Posidonia oceanica meadows are a species of seagrass highly dependent on rocks for their survival and conservation.<n>Deep learning-based semantic segmentation and visual automated monitoring systems have shown promise in a variety of applications.<n>This paper introduces a framework that combines machine learning and computer vision techniques to enable an autonomous underwater vehicle (AUV) to inspect the boundaries of Posidonia oceanica meadows autonomously.
arXiv Detail & Related papers (2025-04-14T22:49:08Z) - Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments [57.59857784298534]
We propose an integrated pipeline that combines Visual Place Recognition (VPR), feature matching, and image segmentation on video-derived images.<n>This method enables robust identification of revisited areas, estimation of rigid transformations, and downstream analysis of ecosystem changes.
arXiv Detail & Related papers (2025-03-06T05:13:19Z) - DAMamba: Vision State Space Model with Dynamic Adaptive Scan [51.81060691414399]
State space models (SSMs) have recently garnered significant attention in computer vision.<n>We propose Dynamic Adaptive Scan (DAS), a data-driven method that adaptively allocates scanning orders and regions.<n>Based on DAS, we propose the vision backbone DAMamba, which significantly outperforms current state-of-the-art vision Mamba models in vision tasks.
arXiv Detail & Related papers (2025-02-18T08:12:47Z) - PIGUIQA: A Physical Imaging Guided Perceptual Framework for Underwater Image Quality Assessment [59.9103803198087]
We propose a Physical Imaging Guided perceptual framework for Underwater Image Quality Assessment (UIQA)<n>By leveraging underwater radiative transfer theory, we integrate physics-based imaging estimations to establish quantitative metrics for these distortions.<n>The proposed model accurately predicts image quality scores and achieves state-of-the-art performance.
arXiv Detail & Related papers (2024-12-20T03:31:45Z) - Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation [41.94295877935867]
We propose a resilient, scalable solution for image and video analysis in marine applications.<n>We validate this approach through a preliminary application in classifying fish from video onboard fishing vessels.
arXiv Detail & Related papers (2024-12-03T08:34:42Z) - Towards Evaluating the Robustness of Visual State Space Models [63.14954591606638]
Vision State Space Models (VSSMs) have demonstrated remarkable performance in visual perception tasks.
However, their robustness under natural and adversarial perturbations remains a critical concern.
We present a comprehensive evaluation of VSSMs' robustness under various perturbation scenarios.
arXiv Detail & Related papers (2024-06-13T17:59:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.