Associative Learning for Network Embedding

• URL: http://arxiv.org/abs/2208.14376v1
• Date: Tue, 30 Aug 2022 16:35:45 GMT
• Title: Associative Learning for Network Embedding
• Authors: Yuchen Liang, Dmitry Krotov, Mohammed J. Zaki
• Abstract summary: We introduce a network embedding method from a new perspective. Our network learns associations between the content of each node and that node's neighbors. Our proposed method is evaluated on different downstream tasks such as node classification and linkage prediction.
• Score: 20.873120242498292
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The network embedding task is to represent the node in the network as a low-dimensional vector while incorporating the topological and structural information. Most existing approaches solve this problem by factorizing a proximity matrix, either directly or implicitly. In this work, we introduce a network embedding method from a new perspective, which leverages Modern Hopfield Networks (MHN) for associative learning. Our network learns associations between the content of each node and that node's neighbors. These associations serve as memories in the MHN. The recurrent dynamics of the network make it possible to recover the masked node, given that node's neighbors. Our proposed method is evaluated on different downstream tasks such as node classification and linkage prediction. The results show competitive performance compared to the common matrix factorization techniques and deep learning based methods.

Related papers

• Degree-based stratification of nodes in Graph Neural Networks [66.17149106033126]
  We modify the Graph Neural Network (GNN) architecture so that the weight matrices are learned, separately, for the nodes in each group. This simple-to-implement modification seems to improve performance across datasets and GNN methods.
  arXiv  Detail & Related papers  (2023-12-16T14:09:23Z)
• Collaborative Graph Neural Networks for Attributed Network Embedding [63.39495932900291]
  Graph neural networks (GNNs) have shown prominent performance on attributed network embedding. We propose COllaborative graph Neural Networks--CONN, a tailored GNN architecture for network embedding.
  arXiv  Detail & Related papers  (2023-07-22T04:52:27Z)
• Topic-aware latent models for representation learning on networks [5.304857921982132]
  We introduce TNE, a generic framework to enhance the embeddings of nodes acquired by means of random walk-based approaches with topic-based information. We evaluate our methodology in two downstream tasks: node classification and link prediction.
  arXiv  Detail & Related papers  (2021-11-10T08:52:52Z)
• Network Representation Learning: From Preprocessing, Feature Extraction to Node Embedding [9.844802841686105]
  Network representation learning (NRL) advances the conventional graph mining of social networks, knowledge graphs, and complex biomedical and physics information networks. This survey paper reviews the design principles and the different node embedding techniques for network representation learning over homogeneous networks.
  arXiv  Detail & Related papers  (2021-10-14T17:46:37Z)
• Node2Seq: Towards Trainable Convolutions in Graph Neural Networks [59.378148590027735]
  We propose a graph network layer, known as Node2Seq, to learn node embeddings with explicitly trainable weights for different neighboring nodes. For a target node, our method sorts its neighboring nodes via attention mechanism and then employs 1D convolutional neural networks (CNNs) to enable explicit weights for information aggregation. In addition, we propose to incorporate non-local information for feature learning in an adaptive manner based on the attention scores.
  arXiv  Detail & Related papers  (2021-01-06T03:05:37Z)
• Dynamic Graph: Learning Instance-aware Connectivity for Neural Networks [78.65792427542672]
  Dynamic Graph Network (DG-Net) is a complete directed acyclic graph, where the nodes represent convolutional blocks and the edges represent connection paths. Instead of using the same path of the network, DG-Net aggregates features dynamically in each node, which allows the network to have more representation ability.
  arXiv  Detail & Related papers  (2020-10-02T16:50:26Z)
• Learning Connectivity of Neural Networks from a Topological Perspective [80.35103711638548]
  We propose a topological perspective to represent a network into a complete graph for analysis. By assigning learnable parameters to the edges which reflect the magnitude of connections, the learning process can be performed in a differentiable manner. This learning process is compatible with existing networks and owns adaptability to larger search spaces and different tasks.
  arXiv  Detail & Related papers  (2020-08-19T04:53:31Z)
• DINE: A Framework for Deep Incomplete Network Embedding [33.97952453310253]
  We propose a Deep Incomplete Network Embedding method, namely DINE. We first complete the missing part including both nodes and edges in a partially observable network by using the expectation-maximization framework. We evaluate DINE over three networks on multi-label classification and link prediction tasks.
  arXiv  Detail & Related papers  (2020-08-09T04:59:35Z)
• Graph Prototypical Networks for Few-shot Learning on Attributed Networks [72.31180045017835]
  We propose a graph meta-learning framework -- Graph Prototypical Networks (GPN) GPN is able to perform textitmeta-learning on an attributed network and derive a highly generalizable model for handling the target classification task.
  arXiv  Detail & Related papers  (2020-06-23T04:13:23Z)
• Adversarial Deep Network Embedding for Cross-network Node Classification [27.777464531860325]
  Cross-network node classification leverages the abundant labeled nodes from a source network to help classify unlabeled nodes in a target network. In this paper, we propose an adversarial cross-network deep network embedding model to integrate adversarial domain adaptation with deep network embedding. The proposed ACDNE model achieves the state-of-the-art performance in cross-network node classification.
  arXiv  Detail & Related papers  (2020-02-18T04:30:43Z)
• A Block-based Generative Model for Attributed Networks Embedding [42.00826538556588]
  We propose a block-based generative model for attributed network embedding from a probability perspective. We use a neural network to characterize the nonlinearity between node embeddings and node attributes. The results show that our proposed method consistently outperforms state-of-the-art embedding methods for both clustering and classification tasks.
  arXiv  Detail & Related papers  (2020-01-06T03:44:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.