EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matching

• URL: http://arxiv.org/abs/2502.20685v1
• Date: Fri, 28 Feb 2025 03:37:01 GMT
• Title: EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matching
• Abstract summary: We introduce the first learning-based dense matching algorithm, termed Equirectangular Projection-Oriented Kernelized Feature Matching (EDM)<n>Our proposed method achieves notable performance enhancements, with improvements of +26.72 and +42.62 in AUC@5deg on the Matterport3D and Stanford2D3D datasets.
• Score: 49.15373858190824
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce the first learning-based dense matching algorithm, termed Equirectangular Projection-Oriented Dense Kernelized Feature Matching (EDM), specifically designed for omnidirectional images. Equirectangular projection (ERP) images, with their large fields of view, are particularly suited for dense matching techniques that aim to establish comprehensive correspondences across images. However, ERP images are subject to significant distortions, which we address by leveraging the spherical camera model and geodesic flow refinement in the dense matching method. To further mitigate these distortions, we propose spherical positional embeddings based on 3D Cartesian coordinates of the feature grid. Additionally, our method incorporates bidirectional transformations between spherical and Cartesian coordinate systems during refinement, utilizing a unit sphere to improve matching performance. We demonstrate that our proposed method achieves notable performance enhancements, with improvements of +26.72 and +42.62 in AUC@5{\deg} on the Matterport3D and Stanford2D3D datasets.

Related papers

• SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection [75.77856258186854]
  360 salient object detection aims to accurately segment salient regions across a full field of view.<n>Existing methods mainly focus on compensating projection distortion while overlooking the interaction between panoramic geometry and salient object structure.<n>We propose SphereSOD, an ERP-native framework that couples panoramic geometry with evolving salient structures.
  arXiv  Detail & Related papers  (2026-09-07T14:47:54Z)
• Robust structure from motion for aerial-ground images via detector-free feature matching and multi-view track refinement [15.28970239781579]
  Integrated 3D reconstruction from aerial-ground images is essential for generating high-precision urban 3D models.<n>This study introduces a rotation-robust detector-free matching network coupled with multi-view track refinement for incremental Structure from Motion (ISfM)<n>By using real aerial-ground datasets, experimental results demonstrate that the proposed method improves AUC at 5 pose error by 93.9% compared with LoFTR.
  arXiv  Detail & Related papers  (2026-08-15T14:16:02Z)
• EntON: Eigenentropy-Optimized Neighborhood Densification in 3D Gaussian Splatting [0.6364833131414095]
  We present a novel Eigenentropy-optimized neighboorhood densification strategy in 3D Gaussian Splatting (3DGS)<n>In contrast to the conventional densification strategy, which relies on the magnitude of the view-space position gradient, our approach introduces a geometry-aware strategy to guide adaptive splitting and pruning.<n> Experiments demonstrate that our Eigenentropy-aware alternating densification strategy improves geometric accuracy by up to 33% and rendering quality by up to 7%.
  arXiv  Detail & Related papers  (2026-03-06T12:32:24Z)
• JOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting [10.35563602148445]
  We propose a unified framework that jointly optimize 3D Gaussian points and camera poses without requiring pre-calibrated inputs.<n>Our approach iteratively refines 3D Gaussian parameters and updates camera poses through a novel co-optimization strategy.<n>Our approach significantly outperforms existing COLMAP-free techniques in reconstruction quality, and also surpasses the standard COLMAP-based baseline in general.
  arXiv  Detail & Related papers  (2025-10-30T04:00:07Z)
• HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation [37.50046993538762]
  In estimation for seen objects, a prevalent pipeline involves using neural networks to predict dense 3D coordinates of the object surface on 2D images.<n>This study predicts 3D coordinates both the object's front and back surfaces densely densely 3D coordinates between pose poses.<n>Results show that the proposed approach outperforms seven classic BOP core datasets.
  arXiv  Detail & Related papers  (2025-10-11T11:29:53Z)
• Attention on the Sphere [0.5431339024941462]
  We introduce a generalized attention mechanism for spherical domains, enabling Transformer architectures to process data defined on the two-dimensional sphere.<n>By integrating numerical quadrature weights into the attention mechanism, we obtain a geometrically faithful spherical attention that is approximately rotationally equivariant.<n>To further enhance both scalability and model performance, we propose simulating neighborhood attention on the sphere.
  arXiv  Detail & Related papers  (2025-05-16T11:59:30Z)
• Double-Shot 3D Shape Measurement with a Dual-Branch Network for Structured Light Projection Profilometry [14.749887303860717]
  We propose a dual-branch Convolutional Neural Network (CNN)-Transformer network (PDCNet) to process different structured light (SL) modalities.<n>Within PDCNet, a Transformer branch is used to capture global perception in the fringe images, while a CNN branch is designed to collect local details in the speckle images.<n>Our method can reduce fringe order ambiguity while producing high-accuracy results on self-made datasets.
  arXiv  Detail & Related papers  (2024-07-19T10:49:26Z)
• Multiway Point Cloud Mosaicking with Diffusion and Global Optimization [74.3802812773891]
  We introduce a novel framework for multiway point cloud mosaicking (named Wednesday) At the core of our approach is ODIN, a learned pairwise registration algorithm that identifies overlaps and refines attention scores. Tested on four diverse, large-scale datasets, our method state-of-the-art pairwise and rotation registration results by a large margin on all benchmarks.
  arXiv  Detail & Related papers  (2024-03-30T17:29:13Z)
• Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation [50.376243444909136]
  We present a unified framework to predict both point-wise correspondences and shape between 3D shapes. We combine the deep functional map framework with classical surface deformation models to map shapes in both spectral and spatial domains.
  arXiv  Detail & Related papers  (2024-02-29T07:26:23Z)
• Towards Scalable Multi-View Reconstruction of Geometry and Materials [27.660389147094715]
  We propose a novel method for joint recovery of camera pose, object geometry and spatially-varying Bidirectional Reflectance Distribution Function (svBRDF) of 3D scenes. The input are high-resolution RGBD images captured by a mobile, hand-held capture system with point lights for active illumination.
  arXiv  Detail & Related papers  (2023-06-06T15:07:39Z)
• TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimation [25.395619346823715]
  We propose a novel method for joint estimation of shape and pose of rigid objects from their sequentially observed RGB-D images. We introduce Deep Directional Distance Function (DeepDDF), a neural network that directly outputs the depth image of an object given the camera viewpoint and viewing direction. We formulate the joint estimation itself as a Transformer which we refer to as TransPoser.
  arXiv  Detail & Related papers  (2023-03-23T17:46:54Z)
• LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals [9.201550006194994]
  Learnable matchers often underperform when there exists only small regions of co-visibility between image pairs. We propose LFM-3D, a Learnable Feature Matching framework that uses models based on graph neural networks. We show that the resulting improved correspondences lead to much higher relative posing accuracy for in-the-wild image pairs.
  arXiv  Detail & Related papers  (2023-03-22T17:46:27Z)
• Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360{\deg} Omnidirectional Image [141.10227079090419]
  We propose a Multi-Projection Fusion and Refinement Network (MPFR-Net) to detect the salient objects in 360deg omnidirectional image. MPFR-Net uses the equirectangular projection image and four corresponding cube-unfolding images as inputs. Experimental results on two omnidirectional datasets demonstrate that the proposed approach outperforms the state-of-the-art methods both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2022-12-23T14:50:40Z)
• Joint stereo 3D object detection and implicit surface reconstruction [39.30458073540617]
  We present a new learning-based framework S-3D-RCNN that can recover accurate object orientation in SO(3) and simultaneously predict implicit rigid shapes from stereo RGB images. For orientation estimation, in contrast to previous studies that map local appearance to observation angles, we propose a progressive approach by extracting meaningful Intermediate Geometrical Representations (IGRs) This approach features a deep model that transforms perceived intensities from one or two views to object part coordinates to achieve direct egocentric object orientation estimation in the camera coordinate system. To further achieve finer description inside 3D bounding boxes, we investigate the implicit shape estimation problem from stereo images
  arXiv  Detail & Related papers  (2021-11-25T05:52:30Z)
• Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo [61.6260594326246]
  We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously. Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
  arXiv  Detail & Related papers  (2021-03-22T18:06:58Z)
• Self-supervised Geometric Perception [96.89966337518854]
  Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels. We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
  arXiv  Detail & Related papers  (2021-03-04T15:34:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.