Knowledge-Enhanced Hierarchical Graph Transformer Network for
Multi-Behavior Recommendation
- URL: http://arxiv.org/abs/2110.04000v1
- Date: Fri, 8 Oct 2021 09:44:00 GMT
- Title: Knowledge-Enhanced Hierarchical Graph Transformer Network for
Multi-Behavior Recommendation
- Authors: Lianghao Xia, Chao Huang, Yong Xu, Peng Dai, Xiyue Zhang, Hongsheng
Yang, Jian Pei, Liefeng Bo
- Abstract summary: This work proposes a Knowledge-Enhanced Hierarchical Graph Transformer Network (KHGT) to investigate multi-typed interactive patterns between users and items in recommender systems.
KHGT is built upon a graph-structured neural architecture to capture type-specific behavior characteristics.
We show that KHGT consistently outperforms many state-of-the-art recommendation methods across various evaluation settings.
- Score: 56.12499090935242
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate user and item embedding learning is crucial for modern recommender
systems. However, most existing recommendation techniques have thus far focused
on modeling users' preferences over singular type of user-item interactions.
Many practical recommendation scenarios involve multi-typed user interactive
behaviors (e.g., page view, add-to-favorite and purchase), which presents
unique challenges that cannot be handled by current recommendation solutions.
In particular: i) complex inter-dependencies across different types of user
behaviors; ii) the incorporation of knowledge-aware item relations into the
multi-behavior recommendation framework; iii) dynamic characteristics of
multi-typed user-item interactions. To tackle these challenges, this work
proposes a Knowledge-Enhanced Hierarchical Graph Transformer Network (KHGT), to
investigate multi-typed interactive patterns between users and items in
recommender systems. Specifically, KHGT is built upon a graph-structured neural
architecture to i) capture type-specific behavior characteristics; ii)
explicitly discriminate which types of user-item interactions are more
important in assisting the forecasting task on the target behavior.
Additionally, we further integrate the graph attention layer with the temporal
encoding strategy, to empower the learned embeddings be reflective of both
dedicated multiplex user-item and item-item relations, as well as the
underlying interaction dynamics. Extensive experiments conducted on three
real-world datasets show that KHGT consistently outperforms many
state-of-the-art recommendation methods across various evaluation settings. Our
implementation code is available at https://github.com/akaxlh/KHGT.
Related papers
- Knowledge Enhancement for Multi-Behavior Contrastive Recommendation [39.50243004656453]
We propose a Knowledge Enhancement Multi-Behavior Contrastive Learning Recommendation (KMCLR) framework.
In this work, we design the multi-behavior learning module to extract users' personalized behavior information for user-embedding enhancement.
In the optimization stage, we model the coarse-grained commonalities and the fine-grained differences between multi-behavior of users to further improve the recommendation effect.
arXiv Detail & Related papers (2023-01-13T06:24:33Z) - Coarse-to-Fine Knowledge-Enhanced Multi-Interest Learning Framework for
Multi-Behavior Recommendation [52.89816309759537]
Multi-types of behaviors (e.g., clicking, adding to cart, purchasing, etc.) widely exist in most real-world recommendation scenarios.
The state-of-the-art multi-behavior models learn behavior dependencies indistinguishably with all historical interactions as input.
We propose a novel Coarse-to-fine Knowledge-enhanced Multi-interest Learning framework to learn shared and behavior-specific interests for different behaviors.
arXiv Detail & Related papers (2022-08-03T05:28:14Z) - Multi-Behavior Sequential Recommendation with Temporal Graph Transformer [66.10169268762014]
We tackle the dynamic user-item relation learning with the awareness of multi-behavior interactive patterns.
We propose a new Temporal Graph Transformer (TGT) recommendation framework to jointly capture dynamic short-term and long-range user-item interactive patterns.
arXiv Detail & Related papers (2022-06-06T15:42:54Z) - Multiplex Behavioral Relation Learning for Recommendation via Memory
Augmented Transformer Network [25.563806871858073]
This work proposes a Memory-Augmented Transformer Networks (MATN) to enable the recommendation with multiplex behavioral relational information.
In our MATN framework, we first develop a transformer-based multi-behavior relation encoder, to make the learned interaction representations be reflective of the cross-type behavior relations.
A memory attention network is proposed to supercharge MATN capturing the contextual signals of different types of behavior into the category-specific latent embedding space.
arXiv Detail & Related papers (2021-10-08T09:54:43Z) - Graph Meta Network for Multi-Behavior Recommendation [24.251784947151755]
We propose a Multi-Behavior recommendation framework with Graph Meta Network to incorporate the multi-behavior pattern modeling into a meta-learning paradigm.
Our developed MB-GMN empowers the user-item interaction learning with the capability of uncovering type-dependent behavior representations.
arXiv Detail & Related papers (2021-10-08T08:38:27Z) - Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation [61.114580368455236]
User purchasing prediction with multi-behavior information remains a challenging problem for current recommendation systems.
We propose the concept of hyper meta-path to construct hyper meta-paths or hyper meta-graphs to explicitly illustrate the dependencies among different behaviors of a user.
Thanks to the recent success of graph contrastive learning, we leverage it to learn embeddings of user behavior patterns adaptively instead of assigning a fixed scheme to understand the dependencies among different behaviors.
arXiv Detail & Related papers (2021-09-07T04:28:09Z) - Dynamic Graph Collaborative Filtering [64.87765663208927]
Dynamic recommendation is essential for recommender systems to provide real-time predictions based on sequential data.
Here we propose Dynamic Graph Collaborative Filtering (DGCF), a novel framework leveraging dynamic graphs to capture collaborative and sequential relations.
Our approach achieves higher performance when the dataset contains less action repetition, indicating the effectiveness of integrating dynamic collaborative information.
arXiv Detail & Related papers (2021-01-08T04:16:24Z) - Multi-Interactive Attention Network for Fine-grained Feature Learning in
CTR Prediction [48.267995749975476]
In the Click-Through Rate (CTR) prediction scenario, user's sequential behaviors are well utilized to capture the user interest.
Existing methods mostly utilize attention on the behavior of users, which is not always suitable for CTR prediction.
We propose a Multi-Interactive Attention Network (MIAN) to comprehensively extract the latent relationship among all kinds of fine-grained features.
arXiv Detail & Related papers (2020-12-13T05:46:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.