A-MuSIC: An Adaptive Ensemble System For Visual Place Recognition In Changing Environments

• URL: http://arxiv.org/abs/2303.14247v1
• Date: Fri, 24 Mar 2023 19:25:22 GMT
• Title: A-MuSIC: An Adaptive Ensemble System For Visual Place Recognition In Changing Environments
• Authors: Bruno Arcanjo, Bruno Ferrarini, Michael Milford, Klaus D. McDonald-Maier and Shoaib Ehsan
• Abstract summary: Visual place recognition (VPR) is an essential component of robot navigation and localization systems. No single VPR technique excels in every environmental condition. adaptive VPR system dubbed Adaptive Multi-Self Identification and Correction (A-MuSIC) A-MuSIC matches or beats state-of-the-art VPR performance across all tested benchmark datasets.
• Score: 22.58641358408613
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visual place recognition (VPR) is an essential component of robot navigation and localization systems that allows them to identify a place using only image data. VPR is challenging due to the significant changes in a place's appearance under different illumination throughout the day, with seasonal weather and when observed from different viewpoints. Currently, no single VPR technique excels in every environmental condition, each exhibiting unique benefits and shortcomings. As a result, VPR systems combining multiple techniques achieve more reliable VPR performance in changing environments, at the cost of higher computational loads. Addressing this shortcoming, we propose an adaptive VPR system dubbed Adaptive Multi-Self Identification and Correction (A-MuSIC). We start by developing a method to collect information of the runtime performance of a VPR technique by analysing the frame-to-frame continuity of matched queries. We then demonstrate how to operate the method on a static ensemble of techniques, generating data on which techniques are contributing the most for the current environment. A-MuSIC uses the collected information to both select a minimal subset of techniques and to decide when a re-selection is required during navigation. A-MuSIC matches or beats state-of-the-art VPR performance across all tested benchmark datasets while maintaining its computational load on par with individual techniques.

Related papers

• CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition [73.51329037954866]
  We propose a robust global representation method with cross-image correlation awareness for visual place recognition. Our method uses the attention mechanism to correlate multiple images within a batch. Our method outperforms state-of-the-art methods by a large margin with significantly less training time.
  arXiv  Detail & Related papers  (2024-02-29T15:05:11Z)
• Deep Homography Estimation for Visual Place Recognition [49.235432979736395]
  We propose a transformer-based deep homography estimation (DHE) network. It takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification. Experiments on benchmark datasets show that our method can outperform several state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-25T13:22:17Z)
• Multi-Technique Sequential Information Consistency For Dynamic Visual Place Recognition In Changing Environments [23.33092172788319]
  Visual place recognition (VPR) is an essential component of robot navigation and localization systems. No single VPR technique excels in every environmental condition. We propose a VPR system dubbed Multi-Sequential Information Consistency (MuSIC)
  arXiv  Detail & Related papers  (2024-01-16T10:35:01Z)
• SwitchHit: A Probabilistic, Complementarity-Based Switching System for Improved Visual Place Recognition in Changing Environments [20.917586014941033]
  There is no universal VPR technique that can work in all types of environments. Running multiple VPR techniques in parallel may be prohibitive for resource-constrained embedded platforms. This paper presents a probabilistic complementarity based switching VPR system, SwitchHit.
  arXiv  Detail & Related papers  (2022-03-01T16:23:22Z)
• Robust Semi-supervised Federated Learning for Images Automatic Recognition in Internet of Drones [57.468730437381076]
  We present a Semi-supervised Federated Learning (SSFL) framework for privacy-preserving UAV image recognition. There are significant differences in the number, features, and distribution of local data collected by UAVs using different camera modules. We propose an aggregation rule based on the frequency of the client's participation in training, namely the FedFreq aggregation rule.
  arXiv  Detail & Related papers  (2022-01-03T16:49:33Z)
• Unsupervised Complementary-aware Multi-process Fusion for Visual Place Recognition [28.235055888073855]
  We propose an unsupervised algorithm that finds the most robust set of VPR techniques to use in the current deployment environment. The proposed dynamic multi-process fusion (Dyn-MPF) has superior VPR performance compared to a variety of challenging competitive methods.
  arXiv  Detail & Related papers  (2021-12-09T04:57:33Z)
• Seeking Similarities over Differences: Similarity-based Domain Alignment for Adaptive Object Detection [86.98573522894961]
  We propose a framework that generalizes the components commonly used by Unsupervised Domain Adaptation (UDA) algorithms for detection. Specifically, we propose a novel UDA algorithm, ViSGA, that leverages the best design choices and introduces a simple but effective method to aggregate features at instance-level. We show that both similarity-based grouping and adversarial training allows our model to focus on coarsely aligning feature groups, without being forced to match all instances across loosely aligned domains.
  arXiv  Detail & Related papers  (2021-10-04T13:09:56Z)
• Shared Space Transfer Learning for analyzing multi-site fMRI data [83.41324371491774]
  Multi-voxel pattern analysis (MVPA) learns predictive models from task-based functional magnetic resonance imaging (fMRI) data. MVPA works best with a well-designed feature set and an adequate sample size. Most fMRI datasets are noisy, high-dimensional, expensive to collect, and with small sample sizes. This paper proposes the Shared Space Transfer Learning (SSTL) as a novel transfer learning approach.
  arXiv  Detail & Related papers  (2020-10-24T08:50:26Z)
• ConvSequential-SLAM: A Sequence-based, Training-less Visual Place Recognition Technique for Changing Environments [19.437998213418446]
  Visual Place Recognition (VPR) is the ability to correctly recall a previously visited place under changing viewpoints and appearances. We present a new handcrafted VPR technique that achieves state-of-the-art place matching performance under challenging conditions.
  arXiv  Detail & Related papers  (2020-09-28T16:31:29Z)
• Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning [85.6386289476598]
  We develop a novel adversarial graph representation adaptation (AGRA) framework for cross-domain holistic-local feature co-adaptation. We conduct extensive and fair evaluations on several popular benchmarks and show that the proposed AGRA framework outperforms previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-08-03T15:00:31Z)
• VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Change [25.853640977526705]
  VPR research has grown rapidly as a field over the past decade due to improving camera hardware and its potential for deep learning-based techniques. This growth has led to fragmentation and a lack of standardisation in the field, especially concerning performance evaluation. In this paper, we address these gaps through a new comprehensive open-source framework for assessing the performance of VPR techniques, dubbed "VPR-Bench"
  arXiv  Detail & Related papers  (2020-05-17T00:27:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.