SwitchHit: A Probabilistic, Complementarity-Based Switching System for Improved Visual Place Recognition in Changing Environments

• URL: http://arxiv.org/abs/2203.00591v1
• Date: Tue, 1 Mar 2022 16:23:22 GMT
• Title: SwitchHit: A Probabilistic, Complementarity-Based Switching System for Improved Visual Place Recognition in Changing Environments
• Authors: Maria Waheed, Michael Milford, Klaus McDonald-Maier and Shoaib Ehsan
• Abstract summary: There is no universal VPR technique that can work in all types of environments. Running multiple VPR techniques in parallel may be prohibitive for resource-constrained embedded platforms. This paper presents a probabilistic complementarity based switching VPR system, SwitchHit.
• Score: 20.917586014941033
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visual place recognition (VPR), a fundamental task in computer vision and robotics, is the problem of identifying a place mainly based on visual information. Viewpoint and appearance changes, such as due to weather and seasonal variations, make this task challenging. Currently, there is no universal VPR technique that can work in all types of environments, on a variety of robotic platforms, and under a wide range of viewpoint and appearance changes. Recent work has shown the potential of combining different VPR methods intelligently by evaluating complementarity for some specific VPR datasets to achieve better performance. This, however, requires ground truth information (correct matches) which is not available when a robot is deployed in a real-world scenario. Moreover, running multiple VPR techniques in parallel may be prohibitive for resource-constrained embedded platforms. To overcome these limitations, this paper presents a probabilistic complementarity based switching VPR system, SwitchHit. Our proposed system consists of multiple VPR techniques, however, it does not simply run all techniques at once, rather predicts the probability of correct match for an incoming query image and dynamically switches to another complementary technique if the probability of correctly matching the query is below a certain threshold. This innovative use of multiple VPR techniques allow our system to be more efficient and robust than other combined VPR approaches employing brute force and running multiple VPR techniques at once. Thus making it more suitable for resource constrained embedded systems and achieving an overall superior performance from what any individual VPR method in the system could have by achieved running independently.

Related papers

• CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition [73.51329037954866]
  We propose a robust global representation method with cross-image correlation awareness for visual place recognition. Our method uses the attention mechanism to correlate multiple images within a batch. Our method outperforms state-of-the-art methods by a large margin with significantly less training time.
  arXiv  Detail & Related papers  (2024-02-29T15:05:11Z)
• Deep Homography Estimation for Visual Place Recognition [49.235432979736395]
  We propose a transformer-based deep homography estimation (DHE) network. It takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification. Experiments on benchmark datasets show that our method can outperform several state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-25T13:22:17Z)
• Multi-Technique Sequential Information Consistency For Dynamic Visual Place Recognition In Changing Environments [23.33092172788319]
  Visual place recognition (VPR) is an essential component of robot navigation and localization systems. No single VPR technique excels in every environmental condition. We propose a VPR system dubbed Multi-Sequential Information Consistency (MuSIC)
  arXiv  Detail & Related papers  (2024-01-16T10:35:01Z)
• AANet: Aggregation and Alignment Network with Semi-hard Positive Sample Mining for Hierarchical Place Recognition [48.043749855085025]
  Visual place recognition (VPR) is one of the research hotspots in robotics, which uses visual information to locate robots. We present a unified network capable of extracting global features for retrieving candidates via an aggregation module. We also propose a Semi-hard Positive Sample Mining (ShPSM) strategy to select appropriate hard positive images for training more robust VPR networks.
  arXiv  Detail & Related papers  (2023-10-08T14:46:11Z)
• ComPtr: Towards Diverse Bi-source Dense Prediction Tasks via A Simple yet General Complementary Transformer [91.43066633305662]
  We propose a novel underlineComPlementary underlinetransformer, textbfComPtr, for diverse bi-source dense prediction tasks. ComPtr treats different inputs equally and builds an efficient dense interaction model in the form of sequence-to-sequence on top of the transformer.
  arXiv  Detail & Related papers  (2023-07-23T15:17:45Z)
• A-MuSIC: An Adaptive Ensemble System For Visual Place Recognition In Changing Environments [22.58641358408613]
  Visual place recognition (VPR) is an essential component of robot navigation and localization systems. No single VPR technique excels in every environmental condition. adaptive VPR system dubbed Adaptive Multi-Self Identification and Correction (A-MuSIC) A-MuSIC matches or beats state-of-the-art VPR performance across all tested benchmark datasets.
  arXiv  Detail & Related papers  (2023-03-24T19:25:22Z)
• A Complementarity-Based Switch-Fuse System for Improved Visual Place Recognition [19.14779092252812]
  Switch-Fuse is an interesting way to combine the robustness of switching VPR techniques based on complementarity and the force of fusing the carefully selected techniques to significantly improve performance. The system combines two significant processes, switching and fusing VPR techniques, which together as a hybrid model substantially improve performance on all major VPR data sets illustrated using PR curves.
  arXiv  Detail & Related papers  (2023-03-01T18:19:10Z)
• Diversity Through Exclusion (DTE): Niche Identification for Reinforcement Learning through Value-Decomposition [63.67574523750839]
  We propose a generic reinforcement learning (RL) algorithm that performs better than baseline deep Q-learning algorithms in environments with multiple variably-valued niches. We show that agents trained this way can escape poor-but-attractive local optima to instead converge to harder-to-discover higher value strategies.
  arXiv  Detail & Related papers  (2023-02-02T16:00:19Z)
• Merging Classification Predictions with Sequential Information for Lightweight Visual Place Recognition in Changing Environments [22.58641358408613]
  Low-overhead visual place recognition (VPR) is a highly active research topic. Mobile robotics applications often operate under low-end hardware, and even more hardware capable systems can still benefit from freeing up onboard system resources for other navigation tasks. This work addresses lightweight VPR by proposing a novel system based on the combination of binary-weighted classifier networks with a one-dimensional convolutional network, dubbed merger.
  arXiv  Detail & Related papers  (2022-10-03T11:42:08Z)
• Exploring the Diversity and Invariance in Yourself for Visual Pre-Training Task [192.74445148376037]
  Self-supervised learning methods have achieved remarkable success in visual pre-training task. These methods only focus on limited regions or the extracted features on totally different regions inside each image are nearly the same. This paper introduces Exploring the Diversity and Invariance in Yourself E-DIY.
  arXiv  Detail & Related papers  (2021-06-01T14:52:36Z)
• VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Change [25.853640977526705]
  VPR research has grown rapidly as a field over the past decade due to improving camera hardware and its potential for deep learning-based techniques. This growth has led to fragmentation and a lack of standardisation in the field, especially concerning performance evaluation. In this paper, we address these gaps through a new comprehensive open-source framework for assessing the performance of VPR techniques, dubbed "VPR-Bench"
  arXiv  Detail & Related papers  (2020-05-17T00:27:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.