IceBench: A Benchmark for Deep Learning based Sea Ice Type Classification

• URL: http://arxiv.org/abs/2503.17877v1
• Date: Sat, 22 Mar 2025 23:14:50 GMT
• Title: IceBench: A Benchmark for Deep Learning based Sea Ice Type Classification
• Authors: Samira Alkaee Taleghan, Andrew P. Barrett, Walter N. Meier, Farnoush Banaei-Kashani,
• Abstract summary: We introduce IceBench, a comprehensive benchmarking framework for sea ice type classification.<n>IceBench is open-source and allows for convenient integration and evaluation of other sea ice type classification methods.<n>We conduct an in-depth comparative study on representative models to assess their strengths and limitations.
• Score: 1.2499537119440243
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Sea ice plays a critical role in the global climate system and maritime operations, making timely and accurate classification essential. However, traditional manual methods are time-consuming, costly, and have inherent biases. Automating sea ice type classification addresses these challenges by enabling faster, more consistent, and scalable analysis. While both traditional and deep learning approaches have been explored, deep learning models offer a promising direction for improving efficiency and consistency in sea ice classification. However, the absence of a standardized benchmark and comparative study prevents a clear consensus on the best-performing models. To bridge this gap, we introduce \textit{IceBench}, a comprehensive benchmarking framework for sea ice type classification. Our key contributions are threefold: First, we establish the IceBench benchmarking framework which leverages the existing AI4Arctic Sea Ice Challenge dataset as a standardized dataset, incorporates a comprehensive set of evaluation metrics, and includes representative models from the entire spectrum of sea ice type classification methods categorized in two distinct groups, namely, pixel-based classification methods and patch-based classification methods. IceBench is open-source and allows for convenient integration and evaluation of other sea ice type classification methods; hence, facilitating comparative evaluation of new methods and improving reproducibility in the field. Second, we conduct an in-depth comparative study on representative models to assess their strengths and limitations, providing insights for both practitioners and researchers. Third, we leverage IceBench for systematic experiments addressing key research questions on model transferability across seasons (time) and locations (space), data downscaling, and preprocessing strategies.

Related papers

• Assessing Foundation Models for Sea Ice Type Segmentation in Sentinel-1 SAR Imagery [2.255599116578844]
  This study evaluates ten foundation models (FMs) for sea ice type segmentation using Sentinel-1 imagery. Among the selected models, Prithvi-600M outperforms the baseline models, while CROMA achieves a very similar performance in F1-score.
  arXiv  Detail & Related papers  (2025-03-28T15:21:08Z)
• Preview-based Category Contrastive Learning for Knowledge Distillation [53.551002781828146]
  We propose a novel preview-based category contrastive learning method for knowledge distillation (PCKD) It first distills the structural knowledge of both instance-level feature correspondence and the relation between instance features and category centers. It can explicitly optimize the category representation and explore the distinct correlation between representations of instances and categories.
  arXiv  Detail & Related papers  (2024-10-18T03:31:00Z)
• SelEx: Self-Expertise in Fine-Grained Generalized Category Discovery [55.72840638180451]
  Generalized Category Discovery aims to simultaneously uncover novel categories and accurately classify known ones. Traditional methods, which lean heavily on self-supervision and contrastive learning, often fall short when distinguishing between fine-grained categories. We introduce a novel concept called self-expertise', which enhances the model's ability to recognize subtle differences and uncover unknown categories.
  arXiv  Detail & Related papers  (2024-08-26T15:53:50Z)
• Partial Label Learning with Focal Loss for Sea Ice Classification Based on Ice Charts [2.0270474485799017]
  We present a novel GeoAI approach to training sea ice classification by formalizing it as a partial label learning task with explicit confidence scores. We treat the polygon-level labels as candidate partial labels, assign the corresponding ice concentrations as confidence scores to each label, and integrate them with focal loss to train a Convolutional Neural Network (CNN) Our proposed approach leads to enhanced performance for sea ice classification in Sentinel-1 dual-polarized SAR images, improving classification accuracy (from 87% to 92%) and weighted average F-1 score (from 90% to 93%) compared to the conventional training approach.
  arXiv  Detail & Related papers  (2024-06-05T22:49:30Z)
• Region-level labels in ice charts can produce pixel-level segmentation for Sea Ice types [12.480532138980834]
  We present a weakly supervised learning method for sea ice classification with lower-resolution labels from expert-annotated ice charts. Our method outperforms the fully supervised U-Net benchmark in both mapping resolution and class-wise accuracy.
  arXiv  Detail & Related papers  (2024-05-16T21:54:33Z)
• Unicorn: U-Net for Sea Ice Forecasting with Convolutional Neural Ordinary Differential Equations [6.4020980835163765]
  This paper introduces a novel deep architecture named Unicorn, designed to forecast weekly sea ice. Our model integrates multiple time series images within its architecture to enhance its forecasting performance.
  arXiv  Detail & Related papers  (2024-05-07T01:17:06Z)
• Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discovery [49.1865089933055]
  We propose a novel, efficient and self-supervised method capable of discovering previously unknown categories at test time. A salient feature of our approach is the assignment of minimum length category codes to individual data instances. Experimental evaluations, bolstered by state-of-the-art benchmark comparisons, testify to the efficacy of our solution.
  arXiv  Detail & Related papers  (2023-10-30T17:45:32Z)
• Learning Classifiers of Prototypes and Reciprocal Points for Universal Domain Adaptation [79.62038105814658]
  Universal Domain aims to transfer the knowledge between datasets by handling two shifts: domain-shift and categoryshift. Main challenge is correctly distinguishing the unknown target samples while adapting the distribution of known class knowledge from source to target. Most existing methods approach this problem by first training the target adapted known and then relying on the single threshold to distinguish unknown target samples.
  arXiv  Detail & Related papers  (2022-12-16T09:01:57Z)
• Data-Driven Short-Term Daily Operational Sea Ice Regional Forecasting [52.77986479871782]
  Global warming made the Arctic available for marine operations and created demand for reliable operational sea ice forecasts. In this work, we investigate the performance of the U-Net model trained in two regimes for predicting sea ice for up to the next 10 days. We show that this deep learning model can outperform simple baselines by a significant margin and improve its quality by using additional weather data and training on multiple regions.
  arXiv  Detail & Related papers  (2022-10-17T09:14:35Z)
• Self-Supervised Class Incremental Learning [51.62542103481908]
  Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot discern old class data clearly from the new. In this paper, we explore the performance of Self-Supervised representation learning in Class Incremental Learning (SSCIL) for the first time.
  arXiv  Detail & Related papers  (2021-11-18T06:58:19Z)
• Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction [24.55780949103687]
  Sea subsurface temperature is affected by global warming in climate change. Existing research is commonly based on either physics-based numerical models or data based models. We propose a novel framework based on generative adversarial network (GAN) combined with numerical model to predict sea subsurface temperature.
  arXiv  Detail & Related papers  (2021-11-04T23:46:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.