Efficient and Scalable Recommendation via Item-Item Graph Partitioning
- URL: http://arxiv.org/abs/2207.05959v1
- Date: Wed, 13 Jul 2022 04:37:48 GMT
- Title: Efficient and Scalable Recommendation via Item-Item Graph Partitioning
- Authors: Tianjun Wei, Jianghong Ma, Tommy W. S. Chow
- Abstract summary: Collaborative filtering (CF) is a widely searched problem in recommender systems.
We propose an efficient and scalable recommendation via item-item graph partitioning (ERGP)
- Score: 10.390315462253726
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Collaborative filtering (CF) is a widely searched problem in recommender
systems. Linear autoencoder is a kind of well-established method for CF, which
estimates item-item relations through encoding user-item interactions. Despite
the excellent performance of linear autoencoders, the rapidly increasing
computational and storage costs caused by the growing number of items limit
their scalabilities in large-scale real-world scenarios. Recently, graph-based
approaches have achieved success on CF with high scalability, and have been
shown to have commonalities with linear autoencoders in user-item interaction
modeling. Motivated by this, we propose an efficient and scalable
recommendation via item-item graph partitioning (ERGP), aiming to address the
limitations of linear autoencoders. In particular, a recursive graph
partitioning strategy is proposed to ensure that the item set is divided into
several partitions of finite size. Linear autoencoders encode user-item
interactions within partitions while preserving global information across the
entire item set. This allows ERGP to have guaranteed efficiency and high
scalability when the number of items increases. Experiments conducted on 3
public datasets and 3 open benchmarking datasets demonstrate the effectiveness
of ERGP, which outperforms state-of-the-art models with lower training time and
storage costs.
Related papers
- Core-based Hierarchies for Efficient GraphRAG [0.0]
GraphRAG organizes documents into a knowledge graph with hierarchical communities that can be summarized.<n>Current GraphRAG approaches rely on Leiden clustering for community detection, but we prove that on sparse knowledge graphs, where average degree is constant and most nodes have low degree, modularity optimization admits exponentially many near-optimal partitions.<n>To address this, we propose replacing Leiden with k-core decomposition, which yields a deterministic, density-aware hierarchy in linear time.
arXiv Detail & Related papers (2026-03-05T14:17:30Z) - Aegis: A Correlation-Based Data Masking Advisor for Data Sharing Ecosystems [4.614078797875801]
This paper presents a framework that selects optimal masking configurations for machine learning datasets with features and class labels.<n>Aegis incorporates a utility that minimizes predictive utility deviation, quantifying shifts in feature label correlations due to masking.<n>Our experimental evaluation of real world datasets shows that Aegis identifies optimal masking configurations over an order of magnitude faster.
arXiv Detail & Related papers (2025-10-12T21:16:43Z) - Lighter-X: An Efficient and Plug-and-play Strategy for Graph-based Recommendation through Decoupled Propagation [49.865020394064096]
We propose textbfLighter-X, an efficient and modular framework that can be seamlessly integrated with existing GNN-based recommender architectures.<n>Our approach substantially reduces both parameter size and computational complexity while preserving the theoretical guarantees and empirical performance of the base models.<n>Experiments demonstrate that Lighter-X achieves comparable performance to baseline models with significantly fewer parameters.
arXiv Detail & Related papers (2025-10-11T08:33:08Z) - GLiClass: Generalist Lightweight Model for Sequence Classification Tasks [49.2639069781367]
We propose GLiClass, a novel method that adapts the GLiNER architecture for sequence classification tasks.<n>Our approach achieves strong accuracy and efficiency comparable to embedding-based methods, while maintaining the flexibility needed for zero-shot and few-shot learning scenarios.
arXiv Detail & Related papers (2025-08-11T06:22:25Z) - Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning [62.640169289390535]
SPLIT-RAG is a multi-agent RAG framework that addresses the limitations with question-driven semantic graph partitioning and collaborative subgraph retrieval.<n>The innovative framework first create Semantic Partitioning of Linked Information, then use the Type-Specialized knowledge base to achieve Multi-Agent RAG.<n>The attribute-aware graph segmentation manages to divide knowledge graphs into semantically coherent subgraphs, ensuring subgraphs align with different query types.<n>A hierarchical merging module resolves inconsistencies across subgraph-derived answers through logical verifications.
arXiv Detail & Related papers (2025-05-20T06:44:34Z) - ScaleGNN: Towards Scalable Graph Neural Networks via Adaptive High-order Neighboring Feature Fusion [73.85920403511706]
We propose ScaleGNN, a novel framework that adaptively fuses multi-hop node features for scalable and effective graph learning.<n>We show that ScaleGNN consistently outperforms state-of-the-art GNNs in both predictive accuracy and computational efficiency.
arXiv Detail & Related papers (2025-04-22T14:05:11Z) - RGL: A Graph-Centric, Modular Framework for Efficient Retrieval-Augmented Generation on Graphs [58.10503898336799]
We introduce the RAG-on-Graphs Library (RGL), a modular framework that seamlessly integrates the complete RAG pipeline.
RGL addresses key challenges by supporting a variety of graph formats and integrating optimized implementations for essential components.
Our evaluations demonstrate that RGL not only accelerates the prototyping process but also enhances the performance and applicability of graph-based RAG systems.
arXiv Detail & Related papers (2025-03-25T03:21:48Z) - Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogs [4.165917157093442]
This paper introduces a novel Scalable Cross-Entropy (SCE) loss function in the sequential learning setup.
It approximates the CE loss for datasets with large-size catalogs, enhancing both time efficiency and memory usage without compromising recommendations quality.
Experimental results on multiple datasets demonstrate the effectiveness of SCE in reducing peak memory usage by a factor of up to 100 compared to the alternatives.
arXiv Detail & Related papers (2024-09-27T13:17:59Z) - EDGE-Rec: Efficient and Data-Guided Edge Diffusion For Recommender Systems Graphs [0.0]
We propose a new attention mechanism to take advantage of real-valued interaction weights as well as user and item features directly.
We train a novel Graph Diffusion Transformer GDiT architecture to iteratively denoise the weighted interaction matrix of the user-item interaction graph directly.
Inspired by the recent progress in text-conditioned image generation, our method directly produces user-item rating predictions on the same scale as the original ratings.
arXiv Detail & Related papers (2024-09-23T03:23:20Z) - Fine-grainedly Synthesize Streaming Data Based On Large Language Models
With Graph Structure Understanding For Data Sparsity [24.995442293434643]
Due to the sparsity of user data, sentiment analysis on user reviews in e-commerce platforms often suffers from poor performance.
We propose a fine-grained streaming data synthesis framework that categorizes sparse users into three categories: Mid-tail, Long-tail, and Extreme.
arXiv Detail & Related papers (2024-03-10T08:59:04Z) - APGL4SR: A Generic Framework with Adaptive and Personalized Global
Collaborative Information in Sequential Recommendation [86.29366168836141]
We propose a graph-driven framework, named Adaptive and Personalized Graph Learning for Sequential Recommendation (APGL4SR)
APGL4SR incorporates adaptive and personalized global collaborative information into sequential recommendation systems.
As a generic framework, APGL4SR can outperform other baselines with significant margins.
arXiv Detail & Related papers (2023-11-06T01:33:24Z) - Efficient Multi-View Graph Clustering with Local and Global Structure
Preservation [59.49018175496533]
We propose a novel anchor-based multi-view graph clustering framework termed Efficient Multi-View Graph Clustering with Local and Global Structure Preservation (EMVGC-LG)
Specifically, EMVGC-LG jointly optimize anchor construction and graph learning to enhance the clustering quality.
In addition, EMVGC-LG inherits the linear complexity of existing AMVGC methods respecting the sample number.
arXiv Detail & Related papers (2023-08-31T12:12:30Z) - Broad Recommender System: An Efficient Nonlinear Collaborative Filtering
Approach [56.12815715932561]
We propose a new broad recommender system called Broad Collaborative Filtering (BroadCF)
Instead of Deep Neural Networks (DNNs), Broad Learning System (BLS) is used as a mapping function to learn the complex nonlinear relationships between users and items.
Extensive experiments conducted on seven benchmark datasets have confirmed the effectiveness of the proposed BroadCF algorithm.
arXiv Detail & Related papers (2022-04-20T01:25:08Z) - IA-GCN: Interactive Graph Convolutional Network for Recommendation [13.207235494649343]
Graph Convolutional Network (GCN) has become a novel state-of-the-art for Collaborative Filtering (CF) based Recommender Systems (RS)
We build bilateral interactive guidance between each user-item pair and propose a new model named IA-GCN (short for InterActive GCN)
Our model is built on top of LightGCN, a state-of-the-art GCN model for CF, and can be combined with various GCN-based CF architectures in an end-to-end fashion.
arXiv Detail & Related papers (2022-04-08T03:38:09Z) - Highly Parallel Autoregressive Entity Linking with Discriminative
Correction [51.947280241185]
We propose a very efficient approach that parallelizes autoregressive linking across all potential mentions.
Our model is >70 times faster and more accurate than the previous generative method.
arXiv Detail & Related papers (2021-09-08T17:28:26Z) - Adversarial Feature Augmentation and Normalization for Visual
Recognition [109.6834687220478]
Recent advances in computer vision take advantage of adversarial data augmentation to ameliorate the generalization ability of classification models.
Here, we present an effective and efficient alternative that advocates adversarial augmentation on intermediate feature embeddings.
We validate the proposed approach across diverse visual recognition tasks with representative backbone networks.
arXiv Detail & Related papers (2021-03-22T20:36:34Z) - Graph Convolution Machine for Context-aware Recommender System [59.50474932860843]
We extend the advantages of graph convolutions to context-aware recommender system (CARS)
We propose textitGraph Convolution Machine (GCM), an end-to-end framework that consists of three components: an encoder, graph convolution layers, and a decoder.
We conduct experiments on three real-world datasets from Yelp and Amazon, validating the effectiveness of GCM and the benefits of performing graph convolutions for CARS.
arXiv Detail & Related papers (2020-01-30T15:32:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.