Toward Foundation Models for Earth Monitoring: Generalizable Deep Learning Models for Natural Hazard Segmentation

• URL: http://arxiv.org/abs/2301.09318v3
• Date: Thu, 1 Jun 2023 12:37:41 GMT
• Title: Toward Foundation Models for Earth Monitoring: Generalizable Deep Learning Models for Natural Hazard Segmentation
• Authors: Johannes Jakubik, Michal Muszynski, Michael V\"ossing, Niklas K\"uhl, Thomas Brunschwiler
• Abstract summary: Near real-time mapping of natural hazards is an emerging priority for disaster relief, risk management, and informing governmental policy decisions. Recent methods to achieve near real-time mapping increasingly leverage deep learning (DL) We propose a methodology to significantly improve the generalizability of DL natural hazards mappers based on pre-training on a suitable pre-task.
• Score: 0.47725505365135473
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Climate change results in an increased probability of extreme weather events that put societies and businesses at risk on a global scale. Therefore, near real-time mapping of natural hazards is an emerging priority for the support of natural disaster relief, risk management, and informing governmental policy decisions. Recent methods to achieve near real-time mapping increasingly leverage deep learning (DL). However, DL-based approaches are designed for one specific task in a single geographic region based on specific frequency bands of satellite data. Therefore, DL models used to map specific natural hazards struggle with their generalization to other types of natural hazards in unseen regions. In this work, we propose a methodology to significantly improve the generalizability of DL natural hazards mappers based on pre-training on a suitable pre-task. Without access to any data from the target domain, we demonstrate this improved generalizability across four U-Net architectures for the segmentation of unseen natural hazards. Importantly, our method is invariant to geographic differences and differences in the type of frequency bands of satellite data. By leveraging characteristics of unlabeled images from the target domain that are publicly available, our approach is able to further improve the generalization behavior without fine-tuning. Thereby, our approach supports the development of foundation models for earth monitoring with the objective of directly segmenting unseen natural hazards across novel geographic regions given different sources of satellite imagery.

Related papers

• Transferable Adversarial Attacks on SAM and Its Downstream Models [87.23908485521439]
  This paper explores the feasibility of adversarial attacking various downstream models fine-tuned from the segment anything model (SAM) To enhance the effectiveness of the adversarial attack towards models fine-tuned on unknown datasets, we propose a universal meta-initialization (UMI) algorithm.
  arXiv  Detail & Related papers  (2024-10-26T15:04:04Z)
• Mapping Land Naturalness from Sentinel-2 using Deep Contextual and Geographical Priors [1.4528189330418977]
  We develop a multi-modal supervised deep learning framework to map land naturalness on the continuum of modern human pressure. Our framework improves the model's predictive performance in mapping land naturalness from Sentinel-2 data.
  arXiv  Detail & Related papers  (2024-06-27T16:17:33Z)
• Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model [17.016411785224317]
  We present DAVI (Disaster Assessment with VIsion foundation model), which overcomes domain disparities and detects structural damage without requiring ground-truth labels of the target region. DAVI integrates task-specific knowledge from a model trained on source regions with an image segmentation foundation model to generate pseudo labels of possible damage in the target region. It then employs a two-stage refinement process, targeting both the pixel and overall image, to more accurately pinpoint changes in disaster-struck areas.
  arXiv  Detail & Related papers  (2024-06-12T09:21:28Z)
• A General Purpose Neural Architecture for Geospatial Systems [142.43454584836812]
  We present a roadmap towards the construction of a general-purpose neural architecture (GPNA) with a geospatial inductive bias. We envision how such a model may facilitate cooperation between members of the community.
  arXiv  Detail & Related papers  (2022-11-04T09:58:57Z)
• Deep face recognition with clustering based domain adaptation [57.29464116557734]
  We propose a new clustering-based domain adaptation method designed for face recognition task in which the source and target domain do not share any classes. Our method effectively learns the discriminative target feature by aligning the feature domain globally, and, at the meantime, distinguishing the target clusters locally.
  arXiv  Detail & Related papers  (2022-05-27T12:29:11Z)
• Activation Regression for Continuous Domain Generalization with Applications to Crop Classification [48.795866501365694]
  Geographic variance in satellite imagery impacts the ability of machine learning models to generalise to new regions. We model geographic generalisation in medium resolution Landsat-8 satellite imagery as a continuous domain adaptation problem. We develop a dataset spatially distributed across the entire continental United States.
  arXiv  Detail & Related papers  (2022-04-14T15:41:39Z)
• Region-Based Semantic Factorization in GANs [67.90498535507106]
  We present a highly efficient algorithm to factorize the latent semantics learned by Generative Adversarial Networks (GANs) concerning an arbitrary image region. Through an appropriately defined generalized Rayleigh quotient, we solve such a problem without any annotations or training. Experimental results on various state-of-the-art GAN models demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2022-02-19T17:46:02Z)
• Handling Distribution Shifts on Graphs: An Invariance Perspective [78.31180235269035]
  We formulate the OOD problem on graphs and develop a new invariant learning approach, Explore-to-Extrapolate Risk Minimization (EERM) EERM resorts to multiple context explorers that are adversarially trained to maximize the variance of risks from multiple virtual environments. We prove the validity of our method by theoretically showing its guarantee of a valid OOD solution.
  arXiv  Detail & Related papers  (2022-02-05T02:31:01Z)
• Deep Learning Methods for Daily Wildfire Danger Forecasting [6.763972119525753]
  Wildfire forecasting is of paramount importance for disaster risk reduction and environmental sustainability. We approach daily fire danger prediction as a machine learning task, using historical Earth observation data from the last decade to predict fire danger. Our DL-based proof-concept provides national-scale daily fire danger maps at a much spatial higher resolution than existing operational solutions.
  arXiv  Detail & Related papers  (2021-11-04T10:39:12Z)
• Geographic ratemaking with spatial embeddings [0.3211619859724084]
  Insurance companies with high exposures in a territory typically have a competitive advantage. Relying on geographic losses is problematic for areas where past loss data is unavailable. This paper presents a method based on data (instead of smoothing historical insurance claim losses) to construct a geographic ratemaking model.
  arXiv  Detail & Related papers  (2021-04-26T20:09:45Z)
• RiskOracle: A Minute-level Citywide Traffic Accident Forecasting Framework [12.279252772816216]
  Real-time traffic accident forecasting is increasingly important for public safety and urban management. Previous works on accident forecasting are often performed on hour levels, utilizing existed neural networks with static region-wise correlations taken into account. We propose a novel framework RiskOracle, to improve the prediction granularity to minute levels.
  arXiv  Detail & Related papers  (2020-02-19T07:18:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.