Deep Reinforcement Learning of Graph Matching
- URL: http://arxiv.org/abs/2012.08950v2
- Date: Thu, 18 Mar 2021 07:26:13 GMT
- Title: Deep Reinforcement Learning of Graph Matching
- Authors: Chang Liu, Runzhong Wang, Zetian Jiang, Junchi Yan
- Abstract summary: Graph matching (GM) under node and pairwise constraints has been a building block in areas from optimization to computer vision.
We present a reinforcement learning solver for GM i.e. RGM that seeks the node correspondence between pairwise graphs.
Our method differs from the previous deep graph matching model in the sense that they are focused on the front-end feature extraction and affinity function learning.
- Score: 63.469961545293756
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Graph matching (GM) under node and pairwise constraints has been a building
block in areas from combinatorial optimization, data mining to computer vision,
for effective structural representation and association. We present a
reinforcement learning solver for GM i.e. RGM that seeks the node
correspondence between pairwise graphs, whereby the node embedding model on the
association graph is learned to sequentially find the node-to-node matching.
Our method differs from the previous deep graph matching model in the sense
that they are focused on the front-end feature extraction and affinity function
learning, while our method aims to learn the back-end decision making given the
affinity objective function whether obtained by learning or not. Such an
objective function maximization setting naturally fits with the reinforcement
learning mechanism, of which the learning procedure is label-free. These
features make it more suitable for practical usage. Extensive experimental
results on both synthetic datasets, Willow Object dataset, Pascal VOC dataset,
and QAPLIB showcase superior performance regarding both matching accuracy and
efficiency. To our best knowledge, this is the first deep reinforcement
learning solver for graph matching.
Related papers
- Combining Optimal Transport and Embedding-Based Approaches for More Expressiveness in Unsupervised Graph Alignment [19.145556156889064]
Unsupervised graph alignment finds the one-to-one node correspondence between a pair of attributed graphs by only exploiting graph structure and node features.
We propose a principled approach to combine their advantages motivated by theoretical analysis of model expressiveness.
We are the first to guarantee the one-to-one matching constraint by reducing the problem to maximum weight matching.
arXiv Detail & Related papers (2024-06-19T04:57:35Z) - Co-attention Graph Pooling for Efficient Pairwise Graph Interaction
Learning [19.58671020943416]
Graph Neural Networks (GNNs) have proven to be effective in processing and learning from graph-structured data.
We propose a novel and efficient graph-level approach for extracting interaction representations using co-attention in graph pooling.
Our method, Co-Attention Graph Pooling (CAGPool), exhibits competitive performance relative to existing methods in both classification and regression tasks.
arXiv Detail & Related papers (2023-07-28T07:53:34Z) - Learnable Graph Matching: A Practical Paradigm for Data Association [74.28753343714858]
We propose a general learnable graph matching method to address these issues.
Our method achieves state-of-the-art performance on several MOT datasets.
For image matching, our method outperforms state-of-the-art methods on a popular indoor dataset, ScanNet.
arXiv Detail & Related papers (2023-03-27T17:39:00Z) - Localized Contrastive Learning on Graphs [110.54606263711385]
We introduce a simple yet effective contrastive model named Localized Graph Contrastive Learning (Local-GCL)
In spite of its simplicity, Local-GCL achieves quite competitive performance in self-supervised node representation learning tasks on graphs with various scales and properties.
arXiv Detail & Related papers (2022-12-08T23:36:00Z) - GraphCoCo: Graph Complementary Contrastive Learning [65.89743197355722]
Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations.
This paper proposes an effective graph complementary contrastive learning approach named GraphCoCo to tackle the above issue.
arXiv Detail & Related papers (2022-03-24T02:58:36Z) - Joint Graph Learning and Matching for Semantic Feature Correspondence [69.71998282148762]
We propose a joint emphgraph learning and matching network, named GLAM, to explore reliable graph structures for boosting graph matching.
The proposed method is evaluated on three popular visual matching benchmarks (Pascal VOC, Willow Object and SPair-71k)
It outperforms previous state-of-the-art graph matching methods by significant margins on all benchmarks.
arXiv Detail & Related papers (2021-09-01T08:24:02Z) - Learnable Graph Matching: Incorporating Graph Partitioning with Deep
Feature Learning for Multiple Object Tracking [58.30147362745852]
Data association across frames is at the core of Multiple Object Tracking (MOT) task.
Existing methods mostly ignore the context information among tracklets and intra-frame detections.
We propose a novel learnable graph matching method to address these issues.
arXiv Detail & Related papers (2021-03-30T08:58:45Z) - A Light Heterogeneous Graph Collaborative Filtering Model using Textual
Information [16.73333758538986]
We exploit the relevant and easily accessible textual information by advanced natural language processing (NLP) models.
We propose a light RGCN-based (RGCN, relational graph convolutional network) collaborative filtering method on heterogeneous graphs.
arXiv Detail & Related papers (2020-10-04T11:10:37Z) - Neural Stochastic Block Model & Scalable Community-Based Graph Learning [8.00785050036369]
This paper proposes a scalable community-based neural framework for graph learning.
The framework learns the graph topology through the task of community detection and link prediction.
We look into two particular applications, the graph alignment and the anomalous correlation detection.
arXiv Detail & Related papers (2020-05-16T03:28:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.