H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain
Adaptation and Label Refinement
- URL: http://arxiv.org/abs/2010.05309v1
- Date: Sun, 11 Oct 2020 18:35:03 GMT
- Title: H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain
Adaptation and Label Refinement
- Authors: Peri Akiva, Matthew Purri, Kristin Dana, Beth Tellman, Tyler Anderson
- Abstract summary: This work presents H2O-Network, a self supervised deep learning method to segment floods from satellites and aerial imagery.
H2O-Network learns to synthesize signals highly correlative with water presence as a domain adaptation step for semantic segmentation in high resolution satellite imagery.
We demonstrate that H2O-Net outperforms the state-of-the-art semantic segmentation methods on satellite imagery by 10% and 12% pixel accuracy and mIoU respectively.
- Score: 6.577064131678387
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate flood detection in near real time via high resolution, high latency
satellite imagery is essential to prevent loss of lives by providing quick and
actionable information. Instruments and sensors useful for flood detection are
only available in low resolution, low latency satellites with region re-visit
periods of up to 16 days, making flood alerting systems that use such
satellites unreliable. This work presents H2O-Network, a self supervised deep
learning method to segment floods from satellites and aerial imagery by
bridging domain gap between low and high latency satellite and coarse-to-fine
label refinement. H2O-Net learns to synthesize signals highly correlative with
water presence as a domain adaptation step for semantic segmentation in high
resolution satellite imagery. Our work also proposes a self-supervision
mechanism, which does not require any hand annotation, used during training to
generate high quality ground truth data. We demonstrate that H2O-Net
outperforms the state-of-the-art semantic segmentation methods on satellite
imagery by 10% and 12% pixel accuracy and mIoU respectively for the task of
flood segmentation. We emphasize the generalizability of our model by
transferring model weights trained on satellite imagery to drone imagery, a
highly different sensor and domain.
Related papers
- Weakly-supervised Camera Localization by Ground-to-satellite Image Registration [52.54992898069471]
We propose a weakly supervised learning strategy for ground-to-satellite image registration.
It derives positive and negative satellite images for each ground image.
We also propose a self-supervision strategy for cross-view image relative rotation estimation.
arXiv Detail & Related papers (2024-09-10T12:57:16Z) - Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions [48.529493393948435]
The visible-light camera has emerged as an essential imaging sensor for marine surface vessels in intelligent waterborne transportation systems.
The visual imaging quality inevitably suffers from several kinds of degradations under complex weather conditions.
We develop a general-purpose multi-scene visibility enhancement method to restore degraded images captured under different weather conditions.
arXiv Detail & Related papers (2024-09-02T23:46:27Z) - SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models [3.839322642354617]
We propose a novel diffusion-based fusion algorithm called textbfSatDiffMoE.
Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images.
Experimental results show that our proposed SatDiffMoE method achieves superior performance for the satellite image super-resolution tasks.
arXiv Detail & Related papers (2024-06-14T17:58:28Z) - EvaNet: Elevation-Guided Flood Extent Mapping on Earth Imagery (Extended Version) [11.820388725641312]
EvaNet is an elevation-guided segmentation model based on the encoder-decoder architecture.
It works as a perfect drop-in replacement for U-Net in existing solutions to flood extent mapping.
arXiv Detail & Related papers (2024-04-27T14:10:09Z) - Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
This paper seeks transferable prior knowledge from detector-friendly images.
It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps.
Our method with higher speeds and less parameters still performs better than transformer-based detectors.
arXiv Detail & Related papers (2023-08-24T12:32:46Z) - Cross-Geography Generalization of Machine Learning Methods for
Classification of Flooded Regions in Aerial Images [3.9921541182631253]
This work proposes two approaches for identifying flooded regions in UAV aerial images.
The first approach utilizes texture-based unsupervised segmentation to detect flooded areas.
The second uses an artificial neural network on the texture features to classify images as flooded and non-flooded.
arXiv Detail & Related papers (2022-10-04T13:11:44Z) - Towards Daily High-resolution Inundation Observations using Deep
Learning and EO [0.0]
Constantly remote sensing presents a cost-effective solution for synoptic flood monitoring.
Satellites do offer timely inundation information when they cover an ongoing flood event, but they are limited by their resolution in terms of their ability to monitor flood evolution at various scales.
Data from satellites, such as the Copernicus Sentinels, which have high spatial and low temporal resolution, with data from NASA SMAP and GPM missions could yield high-resolution flood inundation at a daily scale.
arXiv Detail & Related papers (2022-08-10T14:04:50Z) - SatMAE: Pre-training Transformers for Temporal and Multi-Spectral
Satellite Imagery [74.82821342249039]
We present SatMAE, a pre-training framework for temporal or multi-spectral satellite imagery based on Masked Autoencoder (MAE)
To leverage temporal information, we include a temporal embedding along with independently masking image patches across time.
arXiv Detail & Related papers (2022-07-17T01:35:29Z) - Attentive Dual Stream Siamese U-net for Flood Detection on
Multi-temporal Sentinel-1 Data [0.0]
We propose a flood detection network using bi-temporal SAR acquisitions.
The proposed segmentation network has an encoder-decoder architecture with two Siamese encoders for pre and post-flood images.
The network outperformed the existing state-of-the-art (uni-temporal) flood detection method by 6% IOU.
arXiv Detail & Related papers (2022-04-20T10:56:39Z) - Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional
Pixel Synthesis [66.50914391487747]
We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery.
We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting.
arXiv Detail & Related papers (2021-06-22T02:16:24Z) - Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of
Satellite Images [54.44842669325082]
This work proposes to bridge the gap between image quality and the price by improving the image quality via super-resolution (SR)
We design an SR framework that analyzes the regional information content on each patch of the low-resolution image.
We show substantial decrease in inference time while achieving similar performance to that of existing deep SR methods.
arXiv Detail & Related papers (2020-08-03T13:55:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.