Multi-weather Cross-view Geo-localization Using Denoising Diffusion Models

• URL: http://arxiv.org/abs/2408.02408v2
• Date: Wed, 28 Aug 2024 02:53:22 GMT
• Title: Multi-weather Cross-view Geo-localization Using Denoising Diffusion Models
• Abstract summary: Cross-view geo-localization aims to determine an unknown location by matching drone-view images with the correct geo-tagged satellite-view images from a large gallery. Recent research shows that learning discriminative image representations under specific weather conditions can significantly enhance performance. This paper introduces MCGF, a Multi-weather Cross-view Geo-localization Framework designed to dynamically adapt to unseen weather conditions.
• Score: 35.905368662233954
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cross-view geo-localization in GNSS-denied environments aims to determine an unknown location by matching drone-view images with the correct geo-tagged satellite-view images from a large gallery. Recent research shows that learning discriminative image representations under specific weather conditions can significantly enhance performance. However, the frequent occurrence of unseen extreme weather conditions hinders progress. This paper introduces MCGF, a Multi-weather Cross-view Geo-localization Framework designed to dynamically adapt to unseen weather conditions. MCGF establishes a joint optimization between image restoration and geo-localization using denoising diffusion models. For image restoration, MCGF incorporates a shared encoder and a lightweight restoration module to help the backbone eliminate weather-specific information. For geo-localization, MCGF uses EVA-02 as a backbone for feature extraction, with cross-entropy loss for training and cosine distance for testing. Extensive experiments on University160k-WX demonstrate that MCGF achieves competitive results for geo-localization in varying weather conditions.

Related papers

• GeoISF: Instance Semantic Forest Inspired Large-Scale Cross-View Geo-Localization via Ground LiDAR-to-Satellite Image [15.591523786591575]
  This paper introduces the large-scale LiDAR-to-image geo-localization pipeline called GeoISF.<n>By leveraging environmental semantic representation as a shared medium, GeoISF effectively bridges the modality gap and improves semantic matching accuracy.
  arXiv  Detail & Related papers  (2026-06-17T02:17:02Z)
• Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse [20.496826407313854]
  Drone-view geo-localization aims to match a query drone image, often captured under adverse weather conditions, against a gallery of geo-tagged satellite images.<n>Weather-induced degradations in the drone view severely exacerbate the intrinsic cross-view domain gap.<n>We introduce GeoFuse, a cross-modal fusion framework that integrates precisely aligned road map tiles with satellite imagery.
  arXiv  Detail & Related papers  (2026-05-14T15:01:22Z)
• BGG: Bridging the Geometric Gap between Cross-View images by Vision Foundation Model Adaptation for Geo-Localization [50.74663742490919]
  Cross-View Geo-Localization (CVGL) aims to acquire the geolocation of images by image retrieval.<n>This paper proposes a parameter-efficient framework for bridging the geometric gap across images based on the vision foundation model (VFM)<n>It mainly contains a Multi-granularity Feature Enhancement Adapter (MFEA) and a Frequency-Aware Structural Aggregation (FASA) module.
  arXiv  Detail & Related papers  (2026-05-11T10:46:33Z)
• GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalization [53.080882980294795]
  Current research on agentic visual reasoning enables deep multimodal understanding but primarily focuses on image manipulation tools.<n>In this work, we revisit the geolocalization task, which requires not only nuanced visual grounding but also web search to confirm or refine hypotheses.<n>Since existing geolocalization benchmarks fail to meet the need for high-resolution imagery and the localization challenge for deep agentic reasoning, we curate GeoBench.<n>We propose GeoVista, an agentic model that seamlessly integrates tool invocation within the reasoning loop, including an image-zoom-in tool to magnify regions of interest and a web-search tool to retrieve related
  arXiv  Detail & Related papers  (2025-11-19T18:59:22Z)
• GT-Loc: Unifying When and Where in Images Through a Joint Embedding Space [48.09196906704634]
  GT-Loc is a novel retrieval-based method that jointly predicts the capture time (hour and month) and geo-location (GPS coordinates) of an image.<n>Our approach employs separate encoders for images, time, and location, aligning their embeddings within a shared high-dimensional feature space.
  arXiv  Detail & Related papers  (2025-07-14T16:54:57Z)
• LocDiffusion: Identifying Locations on Earth by Diffusing in the Hilbert Space [10.342723428164412]
  We propose to leverage diffusion as a mechanism for image geolocalization. To avoid the problematic manifold reprojection step in diffusion, we developed a novel spherical positional encoding-decoding framework. We train a conditional latent diffusion model called LocDiffusion that generates geolocations under the guidance of images.
  arXiv  Detail & Related papers  (2025-03-23T17:15:26Z)
• GAIR: Improving Multimodal Geo-Foundation Model with Geo-Aligned Implicit Representations [5.439918212297177]
  Key challenge in multimodal GeoFM development is to explicitly model geospatial relationships across modalities. We propose GAIR, a novel multimodal GeoFM architecture integrating overhead RS data, street view imagery, and their geolocation metadata. We evaluate GAIR across 10 geospatial tasks spanning RS image-based, SV image-based, and location embedding-based benchmarks.
  arXiv  Detail & Related papers  (2025-03-20T19:59:39Z)
• Style Alignment based Dynamic Observation Method for UAV-View Geo-localization [7.185123213523453]
  We propose a style alignment based dynamic observation method for UAV-view geo-localization. Specifically, we introduce a style alignment strategy to transfrom the diverse visual style of drone-view images into a unified satellite images visual style. A dynamic observation module is designed to evaluate the spatial distribution of images by mimicking human observation habits.
  arXiv  Detail & Related papers  (2024-07-03T06:19:42Z)
• STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagery [14.651828898850892]
  We introduce a novel UAV thermal geo-localization approach that employs a coarse-to-fine deep homography estimation method. This method attains reliable thermal geo-localization within a 512-meter radius of the UAV's last known location.
  arXiv  Detail & Related papers  (2024-05-30T20:41:12Z)
• GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization [61.10806364001535]
  Worldwide Geo-localization aims to pinpoint the precise location of images taken anywhere on Earth. Existing approaches divide the globe into discrete geographic cells, transforming the problem into a classification task. We propose GeoCLIP, a novel CLIP-inspired Image-to-GPS retrieval approach that enforces alignment between the image and its corresponding GPS locations.
  arXiv  Detail & Related papers  (2023-09-27T20:54:56Z)
• Cross-View Visual Geo-Localization for Outdoor Augmented Reality [11.214903134756888]
  We address the problem of geo-pose estimation by cross-view matching of query ground images to a geo-referenced aerial satellite image database. We propose a new transformer neural network-based model and a modified triplet ranking loss for joint location and orientation estimation. Experiments on several benchmark cross-view geo-localization datasets show that our model achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-03-28T01:58:03Z)
• Cross-view Geo-localization via Learning Disentangled Geometric Layout Correspondence [11.823147814005411]
  Cross-view geo-localization aims to estimate the location of a query ground image by matching it to a reference geo-tagged aerial images database. Recent works achieve outstanding progress on cross-view geo-localization benchmarks. However, existing methods still suffer from poor performance on the cross-area benchmarks.
  arXiv  Detail & Related papers  (2022-12-08T04:54:01Z)
• Cross-View Image Sequence Geo-localization [6.555961698070275]
  Cross-view geo-localization aims to estimate the GPS location of a query ground-view image. Recent approaches use panoramic ground-view images to increase the range of visibility. We present the first cross-view geo-localization method that works on a sequence of limited Field-Of-View images.
  arXiv  Detail & Related papers  (2022-10-25T19:46:18Z)
• Multiple-environment Self-adaptive Network for Aerial-view Geo-localization [85.52750931345287]
  Aerial-view geo-localization tends to determine an unknown position through matching the drone-view image with the geo-tagged satellite-view image. We propose a Multiple-environment Self-adaptive Network (MuSe-Net) to adjust the domain shift caused by environmental changing. In particular, MuSe-Net employs a two-branch neural network containing one multiple-environment style extraction network and one self-adaptive feature extraction network.
  arXiv  Detail & Related papers  (2022-04-18T16:04:29Z)
• Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching [102.39635336450262]
  We address the problem of ground-to-satellite image geo-localization by matching a query image captured at the ground level against a large-scale database with geotagged satellite images. Our new method is able to achieve the fine-grained location of a query image, up to pixel size precision of the satellite image.
  arXiv  Detail & Related papers  (2022-03-26T20:10:38Z)
• Spatial-spectral Hyperspectral Image Classification via Multiple Random Anchor Graphs Ensemble Learning [88.60285937702304]
  This paper proposes a novel spatial-spectral HSI classification method via multiple random anchor graphs ensemble learning (RAGE) Firstly, the local binary pattern is adopted to extract the more descriptive features on each selected band, which preserves local structures and subtle changes of a region. Secondly, the adaptive neighbors assignment is introduced in the construction of anchor graph, to reduce the computational complexity.
  arXiv  Detail & Related papers  (2021-03-25T09:31:41Z)
• Image Fine-grained Inpainting [89.17316318927621]
  We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields. To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss. We also employ a discriminator with local and global branches to ensure local-global contents consistency.
  arXiv  Detail & Related papers  (2020-02-07T03:45:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.