Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery

• URL: http://arxiv.org/abs/2608.22300v1
• Date: Sun, 23 Aug 2026 08:50:59 GMT
• Title: Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery
• Abstract summary: Co-registration underlies nearly every multi-temporal and multi-sensor use of optical satellite imagery.<n>We present SCDF, a training-free, GPU-free estimator whose motion model is the dense per-pixel displacement field itself.<n>On 584 constructed-ground-truth pairs built from real Sentinel Landsat-8/9, and NAIP imagery, SCDF registers every pair with zero failures.
• Score: 4.730120849611304
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Co-registration underlies nearly every multi-temporal and multi-sensor use of optical satellite imagery, and operational products still carry documented offsets well above the fraction-of-a-pixel scale at which change detection, time series, and data fusion degrade. Real image pairs differ along several axes at once (sensor response, scene content, viewing geometry, resolution, mosaic seams), and the last of these is not a single global motion. Existing tools embed a motion model and constants tuned to their development data; a pair that fits is registered precisely, while one that does not either fails to match or returns a result wrong by tens of pixels with no failure reported. Learned matchers add a GPU requirement and carry no accuracy guarantee outside their training distribution. We present SCDF (self-calibrating displacement fields), a training-free, GPU-free estimator whose motion model is the dense per-pixel displacement field itself, so no scene motion falls outside the model. A single predict--measure--filter loop runs over a resolution pyramid: the accumulated field predicts where each patch of the moving image falls in the reference, RootSIFT matching and a correlation pass measure the displacement there to sub-pixel precision, and filters whose thresholds are all calibrated on the image pair itself decide what survives. One configuration, with no per-dataset tuning, processes full $8192^2$ scenes on a single CPU core. On 584 constructed-ground-truth pairs built from real Sentinel-2, Landsat-8/9, and NAIP imagery, against seven classical baselines and two zero-shot pretrained matchers, SCDF registers every pair with zero failures, reduces the best baseline's real-pair median end-point error from 6.83 to 4.17m, and cuts its 90th percentile from 17.8 to 7.77m.

Related papers

• LeVJEPA: Efficient & Scalable Video Pretraining without the Heuristics [50.45297537821907]
  We introduce LeVJEPA, the first video encoder trained under LeJEPA's collapse-free objective.<n>A single encoder is trained with an invariance loss over global and local views of a clip.<n>LeVJEPA matches or surpasses V-JEPA 2 across ViT-S/B/L at 5.6 to 20.8x less pretraining compute.
  arXiv  Detail & Related papers  (2026-08-27T17:26:24Z)
• Event-Based Motion Estimation via Oriented Distance Fields [55.23416502666468]
  Event-based motion estimation is central to tasks that demand high temporal resolution and robustness to fast motion.<n>We propose Oriented Distance Field Motion Estimation (ODF Motion Estimation), which replaces this optimization with a single averaging step over a precomputed field of event distance vectors.<n>On public and self-collected datasets, ODF motion estimation reaches sub-pixel accuracy at the lowest latency among compared methods.
  arXiv  Detail & Related papers  (2026-08-25T08:27:42Z)
• LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching [39.25581475845445]
  We present LoRetta, a foundation model coupling matchability-aware affine localization with guided dense registration.<n>We also introduce LEVIR-GM, a global-scale multi-temporal optical matching benchmark with dataset-native matchability labels.<n>On LEVIR-GM, LoRetta achieves an area under the curve (AUC) of 83.3%, outperforming the strongest baseline RoMa v2 by 1.6 points.
  arXiv  Detail & Related papers  (2026-08-04T18:02:19Z)
• Explaining AI-Image Detection: What the Heatmap Actually Shows [65.01025489527173]
  We build a detector and attach an attribution map as its evidence.<n>We measure what that pair delivers on 186,527 images under controls.<n>Whether an attribution ranking exists at all depends on whether the detector reacts to the image.
  arXiv  Detail & Related papers  (2026-07-31T16:07:05Z)
• Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware [1.932555230783329]
  Follow-me person tracking must run on the drone itself.<n>EMT-Det is a five-stage system that estimates ego-motion.<n>On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos.
  arXiv  Detail & Related papers  (2026-07-09T19:30:00Z)
• OctoSense: Self-Supervised Learning for Multimodal Robot Perception [50.20346079739425]
  We present OctoSense, an open-source sensor platform with stereo and event cameras, LiDAR, a thermal camera, an inertial measurement unit, and proprioception (CAN bus data from a car, and joint angles for a quadruped robot)<n>The eponymous OctoSense dataset contains 59 hours of time-synchronized driving data across different types of environments at different times of the day.<n>We demonstrate multi-modal self-supervised learning using such real-world data, where sensors have different representations, frequencies, latencies and noise.
  arXiv  Detail & Related papers  (2026-06-25T17:30:49Z)
• Diffusion Transformer World-Action Model for AV Scene Prediction [0.0]
  Action-conditioned world models let an autonomous vehicle predict future camera scenes from its own planned controls.<n>But at compact, trainable scale the futures are ambiguous and the field's standard distortion metrics actively mislead.<n>We confront this with a compact latent world model that predicts future scene latents a frozen decoder renders to $256 times 256$ frames up to 8 seconds ahead.
  arXiv  Detail & Related papers  (2026-06-11T07:24:12Z)
• iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision [0.1749935196721634]
  Existing human-in-the-loop frameworks expand sparse clicks into dense supervision via auxiliary machinery.<n>This paper hypothesizes that expert clicks targeting confident model errors, not arbitrary pixels, suffice to match dense supervision.<n>iSAGE is the only iterative human-in-the-loop framework operating without auxiliary machinery.
  arXiv  Detail & Related papers  (2026-06-08T20:09:35Z)
• Real-Time Oriented Object Detection Transformer in Remote Sensing Images [36.48263676876599]
  We propose a real-time oriented object detection transformer, the first real-time end-to-end oriented object detector.<n>Specifically, angle distribution refinement is proposed to reformulate angle regression.<n>We also propose oriented contrastive denoising to stabilize training and analyze four noise modes.
  arXiv  Detail & Related papers  (2026-03-16T16:28:31Z)
• SOTA: Spike-Navigated Optimal TrAnsport Saliency Region Detection in Composite-bias Videos [50.51658520045165]
  Spike-d Optimal TrAnsport Saliency Region Detection (SOTA) is a framework that leverages the strengths of spike cameras while mitigating biases in both spatial and temporal dimensions.<n>Our method introduces Spike-based Micro-debias (SM) to capture subtle frame-to-frame variations.<n>SOTA refines predictions by reducing inconsistencies across diverse conditions.
  arXiv  Detail & Related papers  (2025-05-01T08:30:40Z)
• Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurring [71.60457491155451]
  Eliminating image blur produced by various kinds of motion has been a challenging problem. We propose a novel real-world deblurring filtering model called the Motion-adaptive Separable Collaborative Filter. Our method provides an effective solution for real-world motion blur removal and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-04-19T19:44:24Z)
• Coordinate Transformer: Achieving Single-stage Multi-person Mesh Recovery from Videos [91.44553585470688]
  Multi-person 3D mesh recovery from videos is a critical first step towards automatic perception of group behavior in virtual reality, physical therapy and beyond. We propose the Coordinate transFormer (CoordFormer) that directly models multi-person spatial-temporal relations and simultaneously performs multi-mesh recovery in an end-to-end manner. Experiments on the 3DPW dataset demonstrate that CoordFormer significantly improves the state-of-the-art, outperforming the previously best results by 4.2%, 8.8% and 4.7% according to the MPJPE, PAMPJPE, and PVE metrics, respectively.
  arXiv  Detail & Related papers  (2023-08-20T18:23:07Z)
• Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image [91.29546868637911]
  This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization. Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
  arXiv  Detail & Related papers  (2022-04-10T19:16:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.