Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fields

• URL: http://arxiv.org/abs/2203.10640v1
• Date: Sun, 20 Mar 2022 20:37:03 GMT
• Title: Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fields
• Authors: Ronan Fablet, Bertrand Chapron
• Abstract summary: A variety of satellite sensors deliver observation data with different sampling patterns due satellite orbits and/or their sensitivity to atmospheric conditions. Here, we investigate how end-to-end learning schemes provide new means to address multimodal inversion problems. We show how this scheme can successfully extract relevant information from satellite-derived sea surface temperature images and enhance the reconstruction of sea surface currents issued from satellite altimetry data.
• Score: 40.33123267556167
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For numerous earth observation applications, one may benefit from various satellite sensors to address the reconstruction of some process or information of interest. A variety of satellite sensors deliver observation data with different sampling patterns due satellite orbits and/or their sensitivity to atmospheric conditions (e.g., clour cover, heavy rains,...). Beyond the ability to account for irregularly-sampled observations, the definition of model-driven inversion methods is often limited to specific case-studies where one can explicitly derive a physical model to relate the different observation sources. Here, we investigate how end-to-end learning schemes provide new means to address multimodal inversion problems. The proposed scheme combines a variational formulation with trainable observation operators, {\em a priori} terms and solvers. Through an application to space oceanography, we show how this scheme can successfully extract relevant information from satellite-derived sea surface temperature images and enhance the reconstruction of sea surface currents issued from satellite altimetry data.

Related papers

• Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Views [5.146618378243241]
  We propose a novel pipeline to generate geospecifc views that maximally respect the weak geometry and texture from multi-view satellite images. Our method directly predicts ground-view images at geolocation by using a comprehensive set of information from the satellite image. We demonstrate our pipeline is the first to generate close-to-real and geospecific ground views merely based on satellite images.
  arXiv  Detail & Related papers  (2024-07-10T21:51:50Z)
• Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observation [48.66623377464203]
  Our novel approach introduces the Dynamic One-For-All (DOFA) model, leveraging the concept of neural plasticity in brain science. This dynamic hypernetwork, adjusting to different wavelengths, enables a single versatile Transformer jointly trained on data from five sensors to excel across 12 distinct Earth observation tasks.
  arXiv  Detail & Related papers  (2024-03-22T17:11:47Z)
• A Bionic Data-driven Approach for Long-distance Underwater Navigation with Anomaly Resistance [59.21686775951903]
  Various animals exhibit accurate navigation using environment cues. Inspired by animal navigation, this work proposes a bionic and data-driven approach for long-distance underwater navigation. The proposed approach uses measured geomagnetic data for the navigation, and requires no GPS systems or geographical maps.
  arXiv  Detail & Related papers  (2024-02-06T13:20:56Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields [46.72819846541652]
  We propose a framework based on Vari Data Assimilation and Deep Learning concepts. This framework is applied to recover rich-in-time, high-resolution information on sea surface wind speed.
  arXiv  Detail & Related papers  (2023-12-14T13:40:39Z)
• Diffusion Models for Earth Observation Use-cases: from cloud removal to urban change detection [31.572818380518914]
  This work proposes and analyses three use cases which demonstrate the potential of diffusion-based approaches for satellite image data. Namely, we tackle cloud removal and inpainting, dataset generation for change-detection tasks, and urban replanning.
  arXiv  Detail & Related papers  (2023-11-10T18:24:25Z)
• Super-Resolution of BVOC Emission Maps Via Domain Adaptation [17.819699053848197]
  SuperResolution (SR) methods based on Deep Learning (DL) have been proposed, leveraging data from numerical simulations for their training process. In our work, we aim at super-resolving low resolution emission maps derived from satellite observations by leveraging the information of emission maps obtained through numerical simulations. We investigate the effectiveness of Domain Adaptation (DA) strategies at different stages by systematically varying the number of simulated and observed emissions used.
  arXiv  Detail & Related papers  (2023-06-22T10:59:15Z)
• VTAE: Variational Transformer Autoencoder with Manifolds Learning [144.0546653941249]
  Deep generative models have demonstrated successful applications in learning non-linear data distributions through a number of latent variables. The nonlinearity of the generator implies that the latent space shows an unsatisfactory projection of the data space, which results in poor representation learning. We show that geodesics and accurate computation can substantially improve the performance of deep generative models.
  arXiv  Detail & Related papers  (2023-04-03T13:13:19Z)
• Predicting Landsat Reflectance with Deep Generative Fusion [2.867517731896504]
  Public satellite missions are commonly bound to a trade-off between spatial and temporal resolution. This hinders their potential to assist vegetation monitoring or humanitarian actions. We probe the potential of deep generative models to produce high-resolution optical imagery by fusing products with different spatial and temporal characteristics.
  arXiv  Detail & Related papers  (2020-11-09T21:06:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.