How Does Message Passing Improve Collaborative Filtering?

• URL: http://arxiv.org/abs/2404.08660v2
• Date: Mon, 28 Oct 2024 22:29:03 GMT
• Title: How Does Message Passing Improve Collaborative Filtering?
• Authors: Mingxuan Ju, William Shiao, Zhichun Guo, Yanfang Ye, Yozen Liu, Neil Shah, Tong Zhao,
• Abstract summary: Collaborative filtering (CF) has exhibited prominent results for recommender systems and been broadly utilized for real-world applications. Message passing helps CF methods in a manner akin to its benefits for graph-based learning tasks in general. We present Test-time Aggregation for CF, a test-time augmentation framework that only conducts message passing once at inference time.
• Score: 49.019075781827034
• License:
• Abstract: Collaborative filtering (CF) has exhibited prominent results for recommender systems and been broadly utilized for real-world applications. A branch of research enhances CF methods by message passing used in graph neural networks, due to its strong capabilities of extracting knowledge from graph-structured data, like user-item bipartite graphs that naturally exist in CF. They assume that message passing helps CF methods in a manner akin to its benefits for graph-based learning tasks in general. However, even though message passing empirically improves CF, whether or not this assumption is correct still needs verification. To address this gap, we formally investigate why message passing helps CF from multiple perspectives and show that many assumptions made by previous works are not entirely accurate. With our curated ablation studies and theoretical analyses, we discover that (1) message passing improves the CF performance primarily by additional representations passed from neighbors during the forward pass instead of additional gradient updates to neighbor representations during the model back-propagation and (ii) message passing usually helps low-degree nodes more than high-degree nodes. Utilizing these novel findings, we present Test-time Aggregation for CF, namely TAG-CF, a test-time augmentation framework that only conducts message passing once at inference time. The key novelty of TAG-CF is that it effectively utilizes graph knowledge while circumventing most of notorious computational overheads of message passing. Besides, TAG-CF is extremely versatile can be used as a plug-and-play module to enhance representations trained by different CF supervision signals. Evaluated on six datasets, TAG-CF consistently improves the recommendation performance of CF methods without graph by up to 39.2% on cold users and 31.7% on all users, with little to no extra computational overheads.

Related papers

• Amplify Graph Learning for Recommendation via Sparsity Completion [16.32861024767423]
  Graph learning models have been widely deployed in collaborative filtering (CF) based recommendation systems. Due to the issue of data sparsity, the graph structure of the original input lacks potential positive preference edges. We propose an Amplify Graph Learning framework based on Sparsity Completion (called AGL-SC)
  arXiv  Detail & Related papers  (2024-06-27T08:26:20Z)
• FourierKAN-GCF: Fourier Kolmogorov-Arnold Network -- An Effective and Efficient Feature Transformation for Graph Collaborative Filtering [16.894095429454598]
  We propose a simple and effective graph-based recommendation model called FourierKAN-GCF. We employ message dropout and node dropout strategies to improve the representation power and robustness of the model.
  arXiv  Detail & Related papers  (2024-06-03T06:36:04Z)
• Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals [67.64770842323966]
  Causal explanations of predictions of NLP systems are essential to ensure safety and establish trust. Existing methods often fall short of explaining model predictions effectively or efficiently. We propose two approaches for counterfactual (CF) approximation.
  arXiv  Detail & Related papers  (2023-10-01T07:31:04Z)
• Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven Analysis [50.972595036856035]
  We present a code that successfully replicates results from six popular and recent graph recommendation models. We compare these graph models with traditional collaborative filtering models that historically performed well in offline evaluations. By investigating the information flow from users' neighborhoods, we aim to identify which models are influenced by intrinsic features in the dataset structure.
  arXiv  Detail & Related papers  (2023-08-01T09:31:44Z)
• On Manipulating Signals of User-Item Graph: A Jacobi Polynomial-based Graph Collaborative Filtering [45.75671148689973]
  Graph Collaborative (CF) is an important research direction in recommender systems. In this paper, we analyze the important factors that a graph filter should consider to achieve better performance. Based on Jacobi bases and filtering frequency decomposition strategies, we design JGCF, which brings at most 27.06% performance gain on Alibaba-iFashion.
  arXiv  Detail & Related papers  (2023-06-06T12:22:09Z)
• How Powerful is Graph Convolution for Recommendation? [21.850817998277158]
  Graph convolutional networks (GCNs) have recently enabled a popular class of algorithms for collaborative filtering (CF) In this paper, we endeavor to obtain a better understanding of GCN-based CF methods via the lens of graph signal processing.
  arXiv  Detail & Related papers  (2021-08-17T11:38:18Z)
• SelfCF: A Simple Framework for Self-supervised Collaborative Filtering [72.68215241599509]
  Collaborative filtering (CF) is widely used to learn informative latent representations of users and items from observed interactions. We propose a self-supervised collaborative filtering framework (SelfCF) that is specially designed for recommender scenario with implicit feedback. We show that SelfCF can boost up the accuracy by up to 17.79% on average, compared with a self-supervised framework BUIR.
  arXiv  Detail & Related papers  (2021-07-07T05:21:12Z)
• Efficient Data-specific Model Search for Collaborative Filtering [56.60519991956558]
  Collaborative filtering (CF) is a fundamental approach for recommender systems. In this paper, motivated by the recent advances in automated machine learning (AutoML), we propose to design a data-specific CF model. Key here is a new framework that unifies state-of-the-art (SOTA) CF methods and splits them into disjoint stages of input encoding, embedding function, interaction and prediction function.
  arXiv  Detail & Related papers  (2021-06-14T14:30:32Z)
• A Survey on Concept Factorization: From Shallow to Deep Representation Learning [104.78577405792592]
  Concept Factorization (CF) has attracted a great deal of interests in the areas of machine learning and data mining. We first re-view the root CF method, and then explore the advancement of CF-based representation learning. We also introduce the potential application areas of CF-based methods.
  arXiv  Detail & Related papers  (2020-07-31T04:19:14Z)
• Constructing Complexity-efficient Features in XCS with Tree-based Rule Conditions [3.0538120180981294]
  A major goal of machine learning is to create techniques that abstract away irrelevant information. This paper aims to optimise the structural efficiency of Code Fragments (CFs) in XOF.
  arXiv  Detail & Related papers  (2020-04-23T05:41:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.