Multi-Technique Sequential Information Consistency For Dynamic Visual
Place Recognition In Changing Environments
- URL: http://arxiv.org/abs/2401.08263v1
- Date: Tue, 16 Jan 2024 10:35:01 GMT
- Title: Multi-Technique Sequential Information Consistency For Dynamic Visual
Place Recognition In Changing Environments
- Authors: Bruno Arcanjo, Bruno Ferrarini, Michael Milford, Klaus D.
McDonald-Maier and Shoaib Ehsan
- Abstract summary: Visual place recognition (VPR) is an essential component of robot navigation and localization systems.
No single VPR technique excels in every environmental condition.
We propose a VPR system dubbed Multi-Sequential Information Consistency (MuSIC)
- Score: 23.33092172788319
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Visual place recognition (VPR) is an essential component of robot navigation
and localization systems that allows them to identify a place using only image
data. VPR is challenging due to the significant changes in a place's appearance
driven by different daily illumination, seasonal weather variations and diverse
viewpoints. Currently, no single VPR technique excels in every environmental
condition, each exhibiting unique benefits and shortcomings, and therefore
combining multiple techniques can achieve more reliable VPR performance.
Present multi-method approaches either rely on online ground-truth information,
which is often not available, or on brute-force technique combination,
potentially lowering performance with high variance technique sets. Addressing
these shortcomings, we propose a VPR system dubbed Multi-Sequential Information
Consistency (MuSIC) which leverages sequential information to select the most
cohesive technique on an online per-frame basis. For each technique in a set,
MuSIC computes their respective sequential consistencies by analysing the
frame-to-frame continuity of their top match candidates, which are then
directly compared to select the optimal technique for the current query image.
The use of sequential information to select between VPR methods results in an
overall VPR performance increase across different benchmark datasets, while
avoiding the need for extra ground-truth of the runtime environment.
Related papers
- Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression [63.23578860867408]
We investigate how to integrate the evaluations of importance and sparsity scores into a single stage.
We present OFB, a cost-efficient approach that simultaneously evaluates both importance and sparsity scores.
Experiments demonstrate that OFB can achieve superior compression performance over state-of-the-art searching-based and pruning-based methods.
arXiv Detail & Related papers (2024-03-23T13:22:36Z) - CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition [73.51329037954866]
We propose a robust global representation method with cross-image correlation awareness for visual place recognition.
Our method uses the attention mechanism to correlate multiple images within a batch.
Our method outperforms state-of-the-art methods by a large margin with significantly less training time.
arXiv Detail & Related papers (2024-02-29T15:05:11Z) - A-MuSIC: An Adaptive Ensemble System For Visual Place Recognition In
Changing Environments [22.58641358408613]
Visual place recognition (VPR) is an essential component of robot navigation and localization systems.
No single VPR technique excels in every environmental condition.
adaptive VPR system dubbed Adaptive Multi-Self Identification and Correction (A-MuSIC)
A-MuSIC matches or beats state-of-the-art VPR performance across all tested benchmark datasets.
arXiv Detail & Related papers (2023-03-24T19:25:22Z) - Diversity-Aware Meta Visual Prompting [111.75306320834629]
We present Diversity-Aware Meta Visual Prompting(DAM-VP), an efficient prompting method for transferring pre-trained models to downstream tasks with frozen backbone.
We cluster the downstream dataset into small subsets in a diversity-strapped way, with each subset has its own prompt separately.
All the prompts are optimized with a meta-prompt, which is learned across several datasets.
arXiv Detail & Related papers (2023-03-14T17:59:59Z) - SwitchHit: A Probabilistic, Complementarity-Based Switching System for
Improved Visual Place Recognition in Changing Environments [20.917586014941033]
There is no universal VPR technique that can work in all types of environments.
Running multiple VPR techniques in parallel may be prohibitive for resource-constrained embedded platforms.
This paper presents a probabilistic complementarity based switching VPR system, SwitchHit.
arXiv Detail & Related papers (2022-03-01T16:23:22Z) - Robust Semi-supervised Federated Learning for Images Automatic
Recognition in Internet of Drones [57.468730437381076]
We present a Semi-supervised Federated Learning (SSFL) framework for privacy-preserving UAV image recognition.
There are significant differences in the number, features, and distribution of local data collected by UAVs using different camera modules.
We propose an aggregation rule based on the frequency of the client's participation in training, namely the FedFreq aggregation rule.
arXiv Detail & Related papers (2022-01-03T16:49:33Z) - Unsupervised Complementary-aware Multi-process Fusion for Visual Place
Recognition [28.235055888073855]
We propose an unsupervised algorithm that finds the most robust set of VPR techniques to use in the current deployment environment.
The proposed dynamic multi-process fusion (Dyn-MPF) has superior VPR performance compared to a variety of challenging competitive methods.
arXiv Detail & Related papers (2021-12-09T04:57:33Z) - Sequence-Based Filtering for Visual Route-Based Navigation: Analysing
the Benefits, Trade-offs and Design Choices [17.48671856442762]
An emerging trend in Visual Place Recognition (VPR) is the use of sequence-based filtering methods on top of single-frame-based place matching techniques.
This paper conducts an in-depth investigation of the relationship between the performance of single-frame-based place matching techniques and the use of sequence-based filtering on top of those methods.
arXiv Detail & Related papers (2021-03-02T19:24:58Z) - Shared Space Transfer Learning for analyzing multi-site fMRI data [83.41324371491774]
Multi-voxel pattern analysis (MVPA) learns predictive models from task-based functional magnetic resonance imaging (fMRI) data.
MVPA works best with a well-designed feature set and an adequate sample size.
Most fMRI datasets are noisy, high-dimensional, expensive to collect, and with small sample sizes.
This paper proposes the Shared Space Transfer Learning (SSTL) as a novel transfer learning approach.
arXiv Detail & Related papers (2020-10-24T08:50:26Z) - ConvSequential-SLAM: A Sequence-based, Training-less Visual Place
Recognition Technique for Changing Environments [19.437998213418446]
Visual Place Recognition (VPR) is the ability to correctly recall a previously visited place under changing viewpoints and appearances.
We present a new handcrafted VPR technique that achieves state-of-the-art place matching performance under challenging conditions.
arXiv Detail & Related papers (2020-09-28T16:31:29Z) - Cross-Domain Facial Expression Recognition: A Unified Evaluation
Benchmark and Adversarial Graph Learning [85.6386289476598]
We develop a novel adversarial graph representation adaptation (AGRA) framework for cross-domain holistic-local feature co-adaptation.
We conduct extensive and fair evaluations on several popular benchmarks and show that the proposed AGRA framework outperforms previous state-of-the-art methods.
arXiv Detail & Related papers (2020-08-03T15:00:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.