Local Feature Extraction from Salient Regions by Feature Map Transformation

• URL: http://arxiv.org/abs/2301.10413v1
• Date: Wed, 25 Jan 2023 05:31:20 GMT
• Title: Local Feature Extraction from Salient Regions by Feature Map Transformation
• Authors: Yerim Jung, Nur Suriza Syazwany Binti Ahmad Nizam, Sang-Chul Lee
• Abstract summary: We propose a framework that robustly extracts and describes salient local features regardless of changing light and viewpoints. The framework suppresses illumination variations and encourages structural information to ignore the noise from light. Our model extracts feature points from salient regions leading to reduced incorrect matches.
• Score: 0.7734726150561086
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Local feature matching is essential for many applications, such as localization and 3D reconstruction. However, it is challenging to match feature points accurately in various camera viewpoints and illumination conditions. In this paper, we propose a framework that robustly extracts and describes salient local features regardless of changing light and viewpoints. The framework suppresses illumination variations and encourages structural information to ignore the noise from light and to focus on edges. We classify the elements in the feature covariance matrix, an implicit feature map information, into two components. Our model extracts feature points from salient regions leading to reduced incorrect matches. In our experiments, the proposed method achieved higher accuracy than the state-of-the-art methods in the public dataset, such as HPatches, Aachen Day-Night, and ETH, which especially show highly variant viewpoints and illumination.

Related papers

• SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality [50.179377002092416]
  We propose an efficient visual localization method capable of high-quality rendering with fewer parameters. Our method achieves superior or comparable rendering and localization performance to state-of-the-art implicit-based visual localization approaches.
  arXiv  Detail & Related papers  (2024-09-21T08:46:16Z)
• Gaussian Splatting with Localized Points Management [52.009874685460694]
  Localized Point Management (LPM) is capable of identifying those error-contributing zones in the highest demand for both point addition and geometry calibration. LPM applies point densification in the identified zone, whilst resetting the opacity of those points residing in front of these regions so that a new opportunity is created to correct ill-conditioned points. Notably, LPM improves both vanilla 3DGS and SpaceTimeGS to achieve state-of-the-art rendering quality while retaining real-time speeds.
  arXiv  Detail & Related papers  (2024-06-06T16:55:07Z)
• GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis [63.5925701087252]
  We propose a novel method for representing a scene illuminated by a point light using a set of relightable 3D Gaussian points. Inspired by the Blinn-Phong model, our approach decomposes the scene into ambient, diffuse, and specular components. To facilitate the decomposition of geometric information independent of lighting conditions, we introduce a novel bilevel optimization-based meta-learning framework.
  arXiv  Detail & Related papers  (2024-05-31T13:48:54Z)
• Real-Time Simultaneous Localization and Mapping with LiDAR intensity [9.374695605941627]
  We propose a novel real-time LiDAR intensity image-based simultaneous localization and mapping method. Our method can run in real time with high accuracy and works well with illumination changes, low-texture, and unstructured environments.
  arXiv  Detail & Related papers  (2023-01-23T03:59:48Z)
• MeshLoc: Mesh-Based Visual Localization [54.731309449883284]
  We explore a more flexible alternative based on dense 3D meshes that does not require features matching between database images to build the scene representation. Surprisingly competitive results can be obtained when extracting features on renderings of these meshes, without any neural rendering stage. Our results show that dense 3D model-based representations are a promising alternative to existing representations and point to interesting and challenging directions for future research.
  arXiv  Detail & Related papers  (2022-07-21T21:21:10Z)
• ImpDet: Exploring Implicit Fields for 3D Object Detection [74.63774221984725]
  We introduce a new perspective that views bounding box regression as an implicit function. This leads to our proposed framework, termed Implicit Detection or ImpDet. Our ImpDet assigns specific values to points in different local 3D spaces, thereby high-quality boundaries can be generated.
  arXiv  Detail & Related papers  (2022-03-31T17:52:12Z)
• Object-Guided Day-Night Visual Localization in Urban Scenes [2.4493299476776778]
  The proposed method first detects semantic objects and establishes correspondences of those objects between images. Experiments on standard urban localization datasets show that OGuL significantly improves localization results with as simple local features as SIFT.
  arXiv  Detail & Related papers  (2022-02-09T13:21:30Z)
• ASLFeat: Learning Local Features of Accurate Shape and Localization [42.70030492742363]
  We present ASLFeat, with three light-weight yet effective modifications to mitigate above issues. First, we resort to deformable convolutional networks to densely estimate and apply local transformation. Second, we take advantage of the inherent feature hierarchy to restore spatial resolution and low-level details for accurate keypoint localization.
  arXiv  Detail & Related papers  (2020-03-23T04:03:03Z)
• Multi-View Optimization of Local Feature Geometry [70.18863787469805]
  We address the problem of refining the geometry of local image features from multiple views without known scene or camera geometry. Our proposed method naturally complements the traditional feature extraction and matching paradigm. We show that our method consistently improves the triangulation and camera localization performance for both hand-crafted and learned local features.
  arXiv  Detail & Related papers  (2020-03-18T17:22:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.