A Supervised Learning Approach to Rankability
- URL: http://arxiv.org/abs/2203.07364v1
- Date: Mon, 14 Mar 2022 17:55:43 GMT
- Title: A Supervised Learning Approach to Rankability
- Authors: Nathan McJames, David Malone, Oliver Mason
- Abstract summary: rankability of data is a problem that considers the ability of a dataset, represented as a graph, to produce a meaningful ranking of the items it contains.
We propose new methods to assess rankability, which are amenable to efficient estimation.
- Score: 0.6015898117103067
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The rankability of data is a recently proposed problem that considers the
ability of a dataset, represented as a graph, to produce a meaningful ranking
of the items it contains. To study this concept, a number of rankability
measures have recently been proposed, based on comparisons to a complete
dominance graph via combinatorial and linear algebraic methods. In this paper,
we review these measures and highlight some questions to which they give rise
before going on to propose new methods to assess rankability, which are
amenable to efficient estimation. Finally, we compare these measures by
applying them to both synthetic and real-life sports data.
Related papers
- Baseline Results for Selected Nonlinear System Identification Benchmarks [2.144088660722956]
This paper presents a set of ten baseline techniques and their relative performances on five popular benchmarks.
The aim of this contribution is to stimulate thought and discussion regarding objective comparison of identification methodologies.
arXiv Detail & Related papers (2024-05-17T13:40:59Z) - End-to-End Graph-Sequential Representation Learning for Accurate Recommendations [0.7673339435080445]
This paper presents a novel multi-representational learning framework exploiting these two paradigms' synergies.
Our empirical evaluation on several datasets demonstrates that mutual training of sequential and graph components with the proposed framework significantly improves recommendations performance.
arXiv Detail & Related papers (2024-03-01T15:32:44Z) - Few-Shot Learning on Graphs: from Meta-learning to Pre-training and
Prompting [56.25730255038747]
This survey endeavors to synthesize recent developments, provide comparative insights, and identify future directions.
We systematically categorize existing studies into three major families: meta-learning approaches, pre-training approaches, and hybrid approaches.
We analyze the relationships among these methods and compare their strengths and limitations.
arXiv Detail & Related papers (2024-02-02T14:32:42Z) - Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls
and New Benchmarking [66.83273589348758]
Link prediction attempts to predict whether an unseen edge exists based on only a portion of edges of a graph.
A flurry of methods have been introduced in recent years that attempt to make use of graph neural networks (GNNs) for this task.
New and diverse datasets have also been created to better evaluate the effectiveness of these new models.
arXiv Detail & Related papers (2023-06-18T01:58:59Z) - Exogenous Data in Forecasting: FARM -- A New Measure for Relevance
Evaluation [62.997667081978825]
We introduce a new approach named FARM - Forward Relevance Aligned Metric.
Our forward method relies on an angular measure that compares changes in subsequent data points to align time-warped series.
As a first validation step, we present the application of our FARM approach to synthetic but representative signals.
arXiv Detail & Related papers (2023-04-21T15:22:33Z) - Recent Few-Shot Object Detection Algorithms: A Survey with Performance
Comparison [54.357707168883024]
Few-Shot Object Detection (FSOD) mimics the humans' ability of learning to learn.
FSOD intelligently transfers the learned generic object knowledge from the common heavy-tailed, to the novel long-tailed object classes.
We give an overview of FSOD, including the problem definition, common datasets, and evaluation protocols.
arXiv Detail & Related papers (2022-03-27T04:11:28Z) - A Unified Framework for Rank-based Evaluation Metrics for Link
Prediction in Knowledge Graphs [19.822126244784133]
Link prediction task on knowledge graphs without explicit negative triples motivates the usage of rank-based metrics.
We introduce a simple theoretical framework for rank-based metrics upon which we investigate two avenues for improvements to existing metrics via alternative aggregation functions and concepts from probability theory.
We propose several new rank-based metrics that are more easily interpreted and compared accompanied by a demonstration of their usage in a benchmarking of knowledge graph embedding models.
arXiv Detail & Related papers (2022-03-14T23:09:46Z) - On Modality Bias Recognition and Reduction [70.69194431713825]
We study the modality bias problem in the context of multi-modal classification.
We propose a plug-and-play loss function method, whereby the feature space for each label is adaptively learned.
Our method yields remarkable performance improvements compared with the baselines.
arXiv Detail & Related papers (2022-02-25T13:47:09Z) - Methods of ranking for aggregated fuzzy numbers from interval-valued
data [0.0]
This paper primarily presents two methods of ranking aggregated fuzzy numbers from intervals using the Interval Agreement Approach (IAA)
The shortcomings of previous measures, along with the improvements of the proposed methods, are illustrated using both a synthetic and real-world application.
arXiv Detail & Related papers (2020-12-03T02:56:15Z) - Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking
Fairness and Algorithm Utility [54.179859639868646]
Bipartite ranking aims to learn a scoring function that ranks positive individuals higher than negative ones from labeled data.
There have been rising concerns on whether the learned scoring function can cause systematic disparity across different protected groups.
We propose a model post-processing framework for balancing them in the bipartite ranking scenario.
arXiv Detail & Related papers (2020-06-15T10:08:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.