Hierarchical Relationship Alignment Metric Learning
- URL: http://arxiv.org/abs/2103.15107v1
- Date: Sun, 28 Mar 2021 11:10:24 GMT
- Title: Hierarchical Relationship Alignment Metric Learning
- Authors: Lifeng Gu
- Abstract summary: We propose a hierarchical relationship alignment metric leaning model HRAML, which uses the concept of relationship alignment to model metric learning problems.
We organize several experiment divided by learning tasks, and verified the better performance of HRAML against many popular methods and RAML framework.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Most existing metric learning methods focus on learning a similarity or
distance measure relying on similar and dissimilar relations between sample
pairs. However, pairs of samples cannot be simply identified as similar or
dissimilar in many real-world applications, e.g., multi-label learning, label
distribution learning. To this end, relation alignment metric learning (RAML)
framework is proposed to handle the metric learning problem in those scenarios.
But RAML learn a linear metric, which can't model complex datasets. Combining
with deep learning and RAML framework, we propose a hierarchical relationship
alignment metric leaning model HRAML, which uses the concept of relationship
alignment to model metric learning problems under multiple learning tasks, and
makes full use of the consistency between the sample pair relationship in the
feature space and the sample pair relationship in the label space. Further we
organize several experiment divided by learning tasks, and verified the better
performance of HRAML against many popular methods and RAML framework.
Related papers
- ConML: A Universal Meta-Learning Framework with Task-Level Contrastive Learning [49.447777286862994]
ConML is a universal meta-learning framework that can be applied to various meta-learning algorithms.
We demonstrate that ConML integrates seamlessly with optimization-based, metric-based, and amortization-based meta-learning algorithms.
arXiv Detail & Related papers (2024-10-08T12:22:10Z) - POGEMA: A Benchmark Platform for Cooperative Multi-Agent Navigation [76.67608003501479]
We introduce and specify an evaluation protocol defining a range of domain-related metrics computed on the basics of the primary evaluation indicators.
The results of such a comparison, which involves a variety of state-of-the-art MARL, search-based, and hybrid methods, are presented.
arXiv Detail & Related papers (2024-07-20T16:37:21Z) - DiffKendall: A Novel Approach for Few-Shot Learning with Differentiable
Kendall's Rank Correlation [16.038667928358763]
Few-shot learning aims to adapt models trained on the base dataset to novel tasks where the categories were not seen by the model before.
This often leads to a relatively uniform distribution of feature values across channels on novel classes.
We show that the importance ranking of feature channels is a more reliable indicator for few-shot learning than geometric similarity metrics.
arXiv Detail & Related papers (2023-07-28T05:32:56Z) - Metric Learning as a Service with Covariance Embedding [7.5989847759545155]
Metric learning aims to maximize and minimize inter- and intra-class similarities.
Existing models mainly rely on distance measures to obtain a separable embedding space.
We argue that to enable metric learning as a service for high-performance deep learning applications, we should also wisely deal with inter-class relationships.
arXiv Detail & Related papers (2022-11-28T10:10:59Z) - Deep Relational Metric Learning [84.95793654872399]
This paper presents a deep relational metric learning framework for image clustering and retrieval.
We learn an ensemble of features that characterizes an image from different aspects to model both interclass and intraclass distributions.
Experiments on the widely-used CUB-200-2011, Cars196, and Stanford Online Products datasets demonstrate that our framework improves existing deep metric learning methods and achieves very competitive results.
arXiv Detail & Related papers (2021-08-23T09:31:18Z) - ReSSL: Relational Self-Supervised Learning with Weak Augmentation [68.47096022526927]
Self-supervised learning has achieved great success in learning visual representations without data annotations.
We introduce a novel relational SSL paradigm that learns representations by modeling the relationship between different instances.
Our proposed ReSSL significantly outperforms the previous state-of-the-art algorithms in terms of both performance and training efficiency.
arXiv Detail & Related papers (2021-07-20T06:53:07Z) - Positive semidefinite support vector regression metric learning [0.0]
RAML framework is proposed to handle the metric learning problem in those scenarios.
It can't learn positive semidefinite distance metric which is necessary in metric learning.
We propose two methds to overcame the weakness.
arXiv Detail & Related papers (2020-08-18T04:45:59Z) - Memory-Augmented Relation Network for Few-Shot Learning [114.47866281436829]
In this work, we investigate a new metric-learning method, Memory-Augmented Relation Network (MRN)
In MRN, we choose the samples that are visually similar from the working context, and perform weighted information propagation to attentively aggregate helpful information from chosen ones to enhance its representation.
We empirically demonstrate that MRN yields significant improvement over its ancestor and achieves competitive or even better performance when compared with other few-shot learning approaches.
arXiv Detail & Related papers (2020-05-09T10:09:13Z) - A Multilayer Framework for Online Metric Learning [71.31889711244739]
This paper proposes a multilayer framework for online metric learning to capture the nonlinear similarities among instances.
A new Mahalanobis-based Online Metric Learning (MOML) algorithm is presented based on the passive-aggressive strategy and one-pass triplet construction strategy.
The proposed MLOML enjoys several nice properties, indeed learns a metric progressively, and performs better on the benchmark datasets.
arXiv Detail & Related papers (2018-05-15T01:10:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.