Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone
- URL: http://arxiv.org/abs/2608.11883v1
- Date: Wed, 12 Aug 2026 10:09:53 GMT
- Title: Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone
- Abstract summary: Multimodal satellite imagery provides complementary information for Earth Observation.<n> accurately combining heterogeneous sensors remains challenging in dynamic environments.<n>Fast-changing regions, such as the Antarctic marginal ice zone, cannot fully exploit multimodal information.<n>This paper presents a novel architecture based on mutual information warping to align multi-satellite scenes.
- Score: 2.0216691631625276
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Multimodal satellite imagery provides complementary information for Earth Observation, but accurately combining heterogeneous sensors remains challenging in dynamic environments. Fast-changing regions, such as the Antarctic marginal ice zone, cannot fully exploit multimodal information from different satellite sensors because surface features move between image acquisitions. This spatial and temporal mismatch challenges effective perceptual grounding, violating the assumption of pixel-level correspondence that underpins most multimodal reasoning and downstream classification pipelines. Antarctic sea ice provides a challenging benchmark due to the rapid, heterogeneous drift of individual ice floes and the differing responses of sea ice to radar, visible and thermal sensing modalities. Accurate, dense supervision of sea ice remains scarce because generating pixel-wise labels requires time-consuming expert interpretation of noisy data, leading to historical reliance on coarse-resolution maritime ice charts for model training. This paper presents a novel architecture based on mutual information warping to align multi-satellite (Sentinel-1 and MODIS platforms) multimodal (visible, thermal, radar) satellite scenes. To demonstrate the approach, we introduce a sparse expert-labeled dataset of 2,088 pixel-wise annotations (7,046 expert point classifications) located at the ice-water margin interface across 43 scenes. Our results demonstrate that spatially grounding and aligning modalities prior to segmentation improves classification accuracy, and enables accurate, dense sea ice segmentation from sparse point-wise supervision.
Related papers
- A Rapid GeoSAM-Based Workflow for Multi-Temporal Glacier Delineation: Case Study from Svalbard [51.56484100374058]
We present a GeoSAM-based, semi-automatic workflow for rapid glacier delineation from Sentinel-2 imagery.<n>Results show that the approach produces spatially coherent and temporally consistent outlines for major glacier bodies.<n>The reliance on derived RGB imagery makes the method flexible and transferable to other optical datasets.
arXiv Detail & Related papers (2025-12-28T09:42:01Z) - Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection [54.1960918379255]
Neptune-X is a data-centric generative-selection framework for maritime object detection.<n>X-to-Maritime is a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes.<n>Our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy.
arXiv Detail & Related papers (2025-09-25T04:59:02Z) - Modeling Heterogeneity across Varying Spatial Extents: Discovering Linkages between Sea Ice Retreat and Ice Shelve Melt in the Antarctic [0.08181515205451795]
This study explores the linkages between sea ice retreat and Antarctic ice shelf (AIS) melt.<n>Traditional models treat sea ice and AIS as separate systems. It limits their ability to capture localized linkages and cascading feedback.<n>Our analysis shows how sea ice retreat evolves over an oceanic grid and progresses toward ice shelves-establishing a direct linkage.
arXiv Detail & Related papers (2025-06-18T17:19:07Z) - Assessing Foundation Models for Sea Ice Type Segmentation in Sentinel-1 SAR Imagery [2.255599116578844]
This study evaluates ten foundation models (FMs) for sea ice type segmentation using Sentinel-1 imagery.<n>Among the selected models, Prithvi-600M outperforms the baseline models, while CROMA achieves a very similar performance in F1-score.
arXiv Detail & Related papers (2025-03-28T15:21:08Z) - Homography Guided Temporal Fusion for Road Line and Marking Segmentation [73.47092021519245]
Road lines and markings are frequently occluded in the presence of moving vehicles, shadow, and glare.
We propose a Homography Guided Fusion (HomoFusion) module to exploit temporally-adjacent video frames for complementary cues.
We show that exploiting available camera intrinsic data and ground plane assumption for cross-frame correspondence can lead to a light-weight network with significantly improved performances in speed and accuracy.
arXiv Detail & Related papers (2024-04-11T10:26:40Z) - Unsupervised Landmark Discovery Using Consistency Guided Bottleneck [63.624186864522315]
We introduce a consistency-guided bottleneck in an image reconstruction-based pipeline.
We propose obtaining pseudo-supervision via forming landmark correspondence across images.
The consistency then modulates the uncertainty of the discovered landmarks in the generation of adaptive heatmaps.
arXiv Detail & Related papers (2023-09-19T10:57:53Z) - View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
This paper proposes a fine-grained self-localization method for outdoor robotics.
The proposed method addresses limitations in existing cross-view localization methods.
It is the first sparse visual-only method that enhances perception in dynamic environments.
arXiv Detail & Related papers (2023-08-16T02:51:52Z) - DeepAqua: Self-Supervised Semantic Segmentation of Wetland Surface Water
Extent with SAR Images using Knowledge Distillation [44.99833362998488]
We present DeepAqua, a self-supervised deep learning model that eliminates the need for manual annotations during the training phase.
We exploit cases where optical- and radar-based water masks coincide, enabling the detection of both open and vegetated water surfaces.
Experimental results show that DeepAqua outperforms other unsupervised methods by improving accuracy by 7%, Intersection Over Union by 27%, and F1 score by 14%.
arXiv Detail & Related papers (2023-05-02T18:06:21Z) - AMD-HookNet for Glacier Front Segmentation [17.60067480799222]
knowledge on changes in glacier calving front positions is important for assessing the status of glaciers.
Deep learning-based methods have shown great potential for glacier calving front delineation from optical and radar satellite imagery.
We propose Attention-Multi-hooking-Deep-supervision HookNet (AMD-HookNet), a novel glacier calving front segmentation framework.
arXiv Detail & Related papers (2023-02-06T12:39:40Z) - SALT: Sea lice Adaptive Lattice Tracking -- An Unsupervised Approach to
Generate an Improved Ocean Model [72.3183990520267]
We propose SALT: Sea lice Adaptive Lattice Tracking approach for efficient estimation of sea lice dispersion and distribution.
Specifically, an adaptive spatial mesh is generated by merging nodes in the lattice graph of the Ocean Model based on local ocean properties.
The proposed SALT technique shows promise for enhancing proactive aquaculture management through predictive modelling of sea lice infestation pressure maps in a changing climate.
arXiv Detail & Related papers (2021-06-24T17:29:42Z) - Deep Tiered Image Segmentation For Detecting Internal Ice Layers in
Radar Imagery [8.09102093271587]
Ground-penetrating radar is able to collect observations of the internal structure of snow and ice.
Recent work has developed automatic techniques for finding the boundaries between the ice and the bedrock.
We propose a novel deep neural network for solving a general class of tiered segmentation problems.
arXiv Detail & Related papers (2020-10-08T01:13:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.