Deep Kernelized Dense Geometric Matching
- URL: http://arxiv.org/abs/2202.00667v1
- Date: Tue, 1 Feb 2022 18:58:46 GMT
- Title: Deep Kernelized Dense Geometric Matching
- Authors: Johan Edstedt, M{\aa}rten Wadenb\"ack, Michael Felsberg
- Abstract summary: We propose to formulate global correspondence estimation as a continuous probabilistic regression task using deep kernels.
Our approach achieves significant improvements compared to the state-of-the-art on the competitive HPatches and YFCC100m benchmarks.
- Score: 14.274582421372308
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Dense geometric matching is a challenging computer vision task, requiring
accurate correspondences under extreme variations in viewpoint and
illumination, even for low-texture regions. In this task, finding accurate
global correspondences is essential for later refinement stages. The current
learning based paradigm is to perform global fixed-size correlation, followed
by flattening and convolution to predict correspondences. In this work, we
consider the problem from a different perspective and propose to formulate
global correspondence estimation as a continuous probabilistic regression task
using deep kernels, yielding a novel approach to learning dense
correspondences. Our full approach, \textbf{D}eep \textbf{K}ernelized
\textbf{M}atching, achieves significant improvements compared to the
state-of-the-art on the competitive HPatches and YFCC100m benchmarks, and we
dissect the gains of our contributions in a thorough ablation study.
Related papers
- LGU-SLAM: Learnable Gaussian Uncertainty Matching with Deformable Correlation Sampling for Deep Visual SLAM [11.715999663401591]
Learnable 2D Gaussian uncertainty model is designed to associate matching-frame pairs.
A multi-scale deformable correlation strategy is devised to adaptively fine-tune the sampling of each direction.
Experiments on real-world and synthetic datasets are conducted to validate the effectiveness and superiority of our method.
arXiv Detail & Related papers (2024-10-30T17:20:08Z) - RGM: A Robust Generalizable Matching Model [49.60975442871967]
We propose a deep model for sparse and dense matching, termed RGM (Robust Generalist Matching)
To narrow the gap between synthetic training samples and real-world scenarios, we build a new, large-scale dataset with sparse correspondence ground truth.
We are able to mix up various dense and sparse matching datasets, significantly improving the training diversity.
arXiv Detail & Related papers (2023-10-18T07:30:08Z) - Q-REG: End-to-End Trainable Point Cloud Registration with Surface
Curvature [81.25511385257344]
We present a novel solution, Q-REG, which utilizes rich geometric information to estimate the rigid pose from a single correspondence.
Q-REG allows to formalize the robust estimation as an exhaustive search, hence enabling end-to-end training.
We demonstrate in the experiments that Q-REG is agnostic to the correspondence matching method and provides consistent improvement both when used only in inference and in end-to-end training.
arXiv Detail & Related papers (2023-09-27T20:58:53Z) - SIGMA: Scale-Invariant Global Sparse Shape Matching [50.385414715675076]
We propose a novel mixed-integer programming (MIP) formulation for generating precise sparse correspondences for non-rigid shapes.
We show state-of-the-art results for sparse non-rigid matching on several challenging 3D datasets.
arXiv Detail & Related papers (2023-08-16T14:25:30Z) - A2B: Anchor to Barycentric Coordinate for Robust Correspondence [25.719939636977934]
We show that geometric-invariant coordinate representations, such as barycentric coordinates, can significantly reduce mismatches between features.
We introduce DEGREE, a novel anchor-to-barycentric (A2B) coordinate encoding approach, which generates multiple affine-invariant correspondence coordinates from paired images.
arXiv Detail & Related papers (2023-06-05T10:28:53Z) - Federated Learning as Variational Inference: A Scalable Expectation
Propagation Approach [66.9033666087719]
This paper extends the inference view and describes a variational inference formulation of federated learning.
We apply FedEP on standard federated learning benchmarks and find that it outperforms strong baselines in terms of both convergence speed and accuracy.
arXiv Detail & Related papers (2023-02-08T17:58:11Z) - Neural Matching Fields: Implicit Representation of Matching Fields for
Visual Correspondence [41.39740414165091]
We present a novel method for semantic correspondence, called Neural Matching Field (NeMF)
We learn a high-dimensional matching field, since a naive exhaustive inference would require querying from all pixels in the 4D space to infer pixel-wise correspondences.
With these combined, competitive results are attained on several standard benchmarks for semantic correspondence.
arXiv Detail & Related papers (2022-10-06T05:38:27Z) - Contextual Model Aggregation for Fast and Robust Federated Learning in
Edge Computing [88.76112371510999]
Federated learning is a prime candidate for distributed machine learning at the network edge.
Existing algorithms face issues with slow convergence and/or robustness of performance.
We propose a contextual aggregation scheme that achieves the optimal context-dependent bound on loss reduction.
arXiv Detail & Related papers (2022-03-23T21:42:31Z) - Bending Graphs: Hierarchical Shape Matching using Gated Optimal
Transport [80.64516377977183]
Shape matching has been a long-studied problem for the computer graphics and vision community.
We investigate a hierarchical learning design, to which we incorporate local patch-level information and global shape-level structures.
We propose a novel optimal transport solver by recurrently updating features on non-confident nodes to learn globally consistent correspondences between the shapes.
arXiv Detail & Related papers (2022-02-03T11:41:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.