Attribute2vec: Deep Network Embedding Through Multi-Filtering GCN
- URL: http://arxiv.org/abs/2004.01375v1
- Date: Fri, 3 Apr 2020 05:06:16 GMT
- Title: Attribute2vec: Deep Network Embedding Through Multi-Filtering GCN
- Authors: Tingyi Wanyan, Chenwei Zhang, Ariful Azad, Xiaomin Liang, Daifeng Li,
Ying Ding
- Abstract summary: We present a multi-filtering Graph Convolution Neural Network (GCN) framework for network embedding task.
It uses multiple local GCN filters to do feature extraction in every propagation layer.
- Score: 10.860740815185489
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a multi-filtering Graph Convolution Neural Network (GCN) framework
for network embedding task. It uses multiple local GCN filters to do feature
extraction in every propagation layer. We show this approach could capture
different important aspects of node features against the existing attribute
embedding based method. We also show that with multi-filtering GCN approach, we
can achieve significant improvement against baseline methods when training data
is limited. We also perform many empirical experiments and demonstrate the
benefit of using multiple filters against single filter as well as most current
existing network embedding methods for both the link prediction and node
classification tasks.
Related papers
- Graph Neural Networks with Diverse Spectral Filtering [32.69196871253339]
Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph machine learning.
We propose a novel diverse spectral filtering (DSF) framework, which automatically learns node-specific filter weights.
Our framework can consistently boost model performance by up to 4.92% in node classification tasks.
arXiv Detail & Related papers (2023-12-14T15:38:12Z) - Complete the Missing Half: Augmenting Aggregation Filtering with
Diversification for Graph Convolutional Neural Networks [46.14626839260314]
We show that current Graph Neural Networks (GNNs) are potentially a problematic factor underlying all GNN models for learning on certain datasets.
We augment the aggregation operations with their dual, i.e. diversification operators that make the node more distinct and preserve the identity.
Such augmentation replaces the aggregation with a two-channel filtering process that, in theory, is beneficial for enriching the node representations.
In the experiments, we observe desired characteristics of the models and significant performance boost upon the baselines on 9 node classification tasks.
arXiv Detail & Related papers (2022-12-21T07:24:03Z) - MFNet: Multi-filter Directive Network for Weakly Supervised Salient
Object Detection [104.0177412274975]
Weakly supervised salient object detection (WSOD) targets to train a CNNs-based saliency network using only low-cost annotations.
Existing WSOD methods take various techniques to pursue single "high-quality" pseudo label from low-cost annotations and then develop their saliency networks.
We introduce a new multiple-pseudo-label framework to integrate more comprehensive and accurate saliency cues from multiple labels.
arXiv Detail & Related papers (2021-12-03T06:12:42Z) - Learning Versatile Convolution Filters for Efficient Visual Recognition [125.34595948003745]
This paper introduces versatile filters to construct efficient convolutional neural networks.
We conduct theoretical analysis on network complexity and an efficient convolution scheme is introduced.
Experimental results on benchmark datasets and neural networks demonstrate that our versatile filters are able to achieve comparable accuracy as that of original filters.
arXiv Detail & Related papers (2021-09-20T06:07:14Z) - Unsharp Mask Guided Filtering [53.14430987860308]
The goal of this paper is guided image filtering, which emphasizes the importance of structure transfer during filtering.
We propose a new and simplified formulation of the guided filter inspired by unsharp masking.
Our formulation enjoys a filtering prior to a low-pass filter and enables explicit structure transfer by estimating a single coefficient.
arXiv Detail & Related papers (2021-06-02T19:15:34Z) - Graph Neural Networks with Adaptive Frequency Response Filter [55.626174910206046]
We develop a graph neural network framework AdaGNN with a well-smooth adaptive frequency response filter.
We empirically validate the effectiveness of the proposed framework on various benchmark datasets.
arXiv Detail & Related papers (2021-04-26T19:31:21Z) - Complete the Missing Half: Augmenting Aggregation Filtering with
Diversification for Graph Convolutional Networks [46.14626839260314]
We show that current Graph Neural Networks (GNNs) are potentially a problematic factor underlying all GNN methods for learning on certain datasets.
We augment the aggregation operations with their dual, i.e. diversification operators that make the node more distinct and preserve the identity.
Such augmentation replaces the aggregation with a two-channel filtering process that, in theory, is beneficial for enriching the node representations.
In the experiments, we observe desired characteristics of the models and significant performance boost upon the baselines on 9 node classification tasks.
arXiv Detail & Related papers (2020-08-20T08:45:16Z) - MTP: Multi-Task Pruning for Efficient Semantic Segmentation Networks [32.84644563020912]
We present a multi-task channel pruning approach for semantic segmentation networks.
The importance of each convolution filter wrt the channel of an arbitrary layer will be simultaneously determined by the classification and segmentation tasks.
Experimental results on several benchmarks illustrate the superiority of the proposed algorithm over the state-of-the-art pruning methods.
arXiv Detail & Related papers (2020-07-16T15:03:01Z) - A "Network Pruning Network" Approach to Deep Model Compression [62.68120664998911]
We present a filter pruning approach for deep model compression using a multitask network.
Our approach is based on learning a a pruner network to prune a pre-trained target network.
The compressed model produced by our approach is generic and does not need any special hardware/software support.
arXiv Detail & Related papers (2020-01-15T20:38:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.