CoDEx: Combining Domain Expertise for Spatial Generalization in Satellite Image Analysis

• URL: http://arxiv.org/abs/2504.19737v1
• Date: Mon, 28 Apr 2025 12:33:39 GMT
• Title: CoDEx: Combining Domain Expertise for Spatial Generalization in Satellite Image Analysis
• Authors: Abhishek Kuriyal, Elliot Vincent, Mathieu Aubry, Loic Landrieu,
• Abstract summary: We propose a novel domain-generalization framework for satellite images.<n>We train one expert model per training domain, while learning experts' similarity and encouraging similar experts to be consistent.<n>A model selection module then identifies the most suitable experts for a given test sample and aggregates their predictions.
• Score: 20.904517823908783
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Global variations in terrain appearance raise a major challenge for satellite image analysis, leading to poor model performance when training on locations that differ from those encountered at test time. This remains true even with recent large global datasets. To address this challenge, we propose a novel domain-generalization framework for satellite images. Instead of trying to learn a single generalizable model, we train one expert model per training domain, while learning experts' similarity and encouraging similar experts to be consistent. A model selection module then identifies the most suitable experts for a given test sample and aggregates their predictions. Experiments on four datasets (DynamicEarthNet, MUDS, OSCD, and FMoW) demonstrate consistent gains over existing domain generalization and adaptation methods. Our code is publicly available at https://github.com/Abhishek19009/CoDEx.

Related papers

• Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities [88.398085358514]
  Contrastive Deepfake Embeddings (CoDE) is a novel embedding space specifically designed for deepfake detection. CoDE is trained via contrastive learning by additionally enforcing global-local similarities.
  arXiv  Detail & Related papers  (2024-07-29T18:00:10Z)
• GM-DF: Generalized Multi-Scenario Deepfake Detection [49.072106087564144]
  Existing face forgery detection usually follows the paradigm of training models in a single domain. In this paper, we elaborately investigate the generalization capacity of deepfake detection models when jointly trained on multiple face forgery detection datasets.
  arXiv  Detail & Related papers  (2024-06-28T17:42:08Z)
• Adaptive Test-Time Personalization for Federated Learning [51.25437606915392]
  We introduce a novel setting called test-time personalized federated learning (TTPFL) In TTPFL, clients locally adapt a global model in an unsupervised way without relying on any labeled data during test-time. We propose a novel algorithm called ATP to adaptively learn the adaptation rates for each module in the model from distribution shifts among source domains.
  arXiv  Detail & Related papers  (2023-10-28T20:42:47Z)
• Self-supervised Domain-agnostic Domain Adaptation for Satellite Images [18.151134198549574]
  We propose an self-supervised domain-agnostic domain adaptation (SS(DA)2) method to perform domain adaptation without such a domain definition. We first design a contrastive generative adversarial loss to train a generative network to perform image-to-image translation between any two satellite image patches. Then, we improve the generalizability of the downstream models by augmenting the training data with different testing spectral characteristics.
  arXiv  Detail & Related papers  (2023-09-20T07:37:23Z)
• Test-Time Style Shifting: Handling Arbitrary Styles in Domain Generalization [22.099003320482392]
  In domain generalization (DG), the target domain is unknown when the model is being trained. We propose test-time style shifting, which shifts the style of the test sample to the nearest source domain. We also propose style balancing, which provides a great platform for maximizing the advantage of test-time style shifting.
  arXiv  Detail & Related papers  (2023-06-08T03:26:16Z)
• When Neural Networks Fail to Generalize? A Model Sensitivity Perspective [82.36758565781153]
  Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario, namely Single Domain Generalization (Single-DG) We empirically ascertain a property of a model that correlates strongly with its generalization that we coin as "model sensitivity" We propose a novel strategy of Spectral Adversarial Data Augmentation (SADA) to generate augmented images targeted at the highly sensitive frequencies.
  arXiv  Detail & Related papers  (2022-12-01T20:15:15Z)
• Diversified Dynamic Routing for Vision Tasks [36.199659460868496]
  We propose a novel architecture where each layer is composed of a set of experts. In our method, the model is explicitly trained to solve the challenge of finding relevant partitioning of the data. We conduct several experiments on semantic segmentation on Cityscapes and object detection and instance segmentation on MS-COCO.
  arXiv  Detail & Related papers  (2022-09-26T23:27:51Z)
• Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective [68.37624784559728]
  In this paper, we tackle issues by learning SIRR models from a domain perspective. For each source set, a specific SIRR model is trained to serve as a domain expert of relevant reflection types. For images from one source set, we train RTAW to only predict expert-wise weights of other domain experts for improving generalization ability. Experiments show the appealing performance gain of our AdaNEC on different state-of-the-art SIRR networks.
  arXiv  Detail & Related papers  (2022-04-04T14:06:11Z)
• Learning to Generalize across Domains on Single Test Samples [126.9447368941314]
  We learn to generalize across domains on single test samples. We formulate the adaptation to the single test sample as a variational Bayesian inference problem. Our model achieves at least comparable -- and often better -- performance than state-of-the-art methods on multiple benchmarks for domain generalization.
  arXiv  Detail & Related papers  (2022-02-16T13:21:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.