Joint Learning of Hyperbolic Label Embeddings for Hierarchical
Multi-label Classification
- URL: http://arxiv.org/abs/2101.04997v1
- Date: Wed, 13 Jan 2021 10:58:54 GMT
- Title: Joint Learning of Hyperbolic Label Embeddings for Hierarchical
Multi-label Classification
- Authors: Soumya Chatterjee, Ayush Maheshwari, Ganesh Ramakrishnan, Saketha Nath
Jagaralpudi
- Abstract summary: We consider the problem of multi-label classification where the labels lie in a hierarchy.
We propose a novel formulation for the joint learning and empirically evaluate its efficacy.
- Score: 9.996804039553858
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: We consider the problem of multi-label classification where the labels lie in
a hierarchy. However, unlike most existing works in hierarchical multi-label
classification, we do not assume that the label-hierarchy is known. Encouraged
by the recent success of hyperbolic embeddings in capturing hierarchical
relations, we propose to jointly learn the classifier parameters as well as the
label embeddings. Such a joint learning is expected to provide a twofold
advantage: i) the classifier generalizes better as it leverages the prior
knowledge of existence of a hierarchy over the labels, and ii) in addition to
the label co-occurrence information, the label-embedding may benefit from the
manifold structure of the input datapoints, leading to embeddings that are more
faithful to the label hierarchy. We propose a novel formulation for the joint
learning and empirically evaluate its efficacy. The results show that the joint
learning improves over the baseline that employs label co-occurrence based
pre-trained hyperbolic embeddings. Moreover, the proposed classifiers achieve
state-of-the-art generalization on standard benchmarks. We also present
evaluation of the hyperbolic embeddings obtained by joint learning and show
that they represent the hierarchy more accurately than the other alternatives.
Related papers
- SEAL: Simultaneous Label Hierarchy Exploration And Learning [9.701914280306118]
We propose a new framework that explores the label hierarchy by augmenting the observed labels with latent labels that follow a prior hierarchical structure.
Our approach uses a 1-Wasserstein metric over the tree metric space as an objective function, which enables us to simultaneously learn a data-driven label hierarchy and perform (semi-supervised) learning.
arXiv Detail & Related papers (2023-04-26T08:31:59Z) - TagRec++: Hierarchical Label Aware Attention Network for Question
Categorization [0.3683202928838613]
Online learning systems organize the content according to a well defined taxonomy of hierarchical nature.
The task of categorizing inputs to the hierarchical labels is usually cast as a flat multi-class classification problem.
We formulate the task as a dense retrieval problem to retrieve the appropriate hierarchical labels for each content.
arXiv Detail & Related papers (2022-08-10T05:08:37Z) - Multi-label Classification with High-rank and High-order Label
Correlations [62.39748565407201]
Previous methods capture the high-order label correlations mainly by transforming the label matrix to a latent label space with low-rank matrix factorization.
We propose a simple yet effective method to depict the high-order label correlations explicitly, and at the same time maintain the high-rank of the label matrix.
Comparative studies over twelve benchmark data sets validate the effectiveness of the proposed algorithm in multi-label classification.
arXiv Detail & Related papers (2022-07-09T05:15:31Z) - Use All The Labels: A Hierarchical Multi-Label Contrastive Learning
Framework [75.79736930414715]
We present a hierarchical multi-label representation learning framework that can leverage all available labels and preserve the hierarchical relationship between classes.
We introduce novel hierarchy preserving losses, which jointly apply a hierarchical penalty to the contrastive loss, and enforce the hierarchy constraint.
arXiv Detail & Related papers (2022-04-27T21:41:44Z) - Label Hierarchy Transition: Delving into Class Hierarchies to Enhance
Deep Classifiers [40.993137740456014]
We propose a unified probabilistic framework based on deep learning to address the challenges of hierarchical classification.
The proposed framework can be readily adapted to any existing deep network with only minor modifications.
We extend our proposed LHT framework to the skin lesion diagnosis task and validate its great potential in computer-aided diagnosis.
arXiv Detail & Related papers (2021-12-04T14:58:36Z) - Expert Knowledge-Guided Length-Variant Hierarchical Label Generation for
Proposal Classification [21.190465278587045]
Proposal classification aims to classify a proposal into a length-variant sequence of labels.
We develop a new deep proposal classification framework to jointly model the three features.
Our model can automatically identify the best length of label sequence to stop next label prediction.
arXiv Detail & Related papers (2021-09-14T13:09:28Z) - Open-Set Representation Learning through Combinatorial Embedding [62.05670732352456]
We are interested in identifying novel concepts in a dataset through representation learning based on the examples in both labeled and unlabeled classes.
We propose a learning approach, which naturally clusters examples in unseen classes using the compositional knowledge given by multiple supervised meta-classifiers on heterogeneous label spaces.
The proposed algorithm discovers novel concepts via a joint optimization of enhancing the discrimitiveness of unseen classes as well as learning the representations of known classes generalizable to novel ones.
arXiv Detail & Related papers (2021-06-29T11:51:57Z) - Exploring the Hierarchy in Relation Labels for Scene Graph Generation [75.88758055269948]
The proposed method can improve several state-of-the-art baselines by a large margin (up to $33%$ relative gain) in terms of Recall@50.
Experiments show that the proposed simple yet effective method can improve several state-of-the-art baselines by a large margin.
arXiv Detail & Related papers (2020-09-12T17:36:53Z) - Interaction Matching for Long-Tail Multi-Label Classification [57.262792333593644]
We present an elegant and effective approach for addressing limitations in existing multi-label classification models.
By performing soft n-gram interaction matching, we match labels with natural language descriptions.
arXiv Detail & Related papers (2020-05-18T15:27:55Z) - Hierarchical Image Classification using Entailment Cone Embeddings [68.82490011036263]
We first inject label-hierarchy knowledge into an arbitrary CNN-based classifier.
We empirically show that availability of such external semantic information in conjunction with the visual semantics from images boosts overall performance.
arXiv Detail & Related papers (2020-04-02T10:22:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.