Time-aware Self-Attention Meets Logic Reasoning in Recommender Systems
- URL: http://arxiv.org/abs/2208.13330v1
- Date: Mon, 29 Aug 2022 01:46:42 GMT
- Title: Time-aware Self-Attention Meets Logic Reasoning in Recommender Systems
- Abstract summary: We propose a Time-aware Self-Attention with Neural Collaborative Reasoning (TiSANCR) based recommendation model.
TiSANCR integrates temporal patterns and self-attention mechanism into reasoning-based recommendation.
Experiments on benchmark datasets demonstrate that the proposed TiSANCR achieves significant improvement and consistently outperforms state-of-the-art recommendation methods.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: At the age of big data, recommender systems have shown remarkable success as
a key means of information filtering in our daily life. Recent years have
witnessed the technical development of recommender systems, from perception
learning to cognition reasoning which intuitively build the task of
recommendation as the procedure of logical reasoning and have achieve
significant improvement. However, the logical statement in reasoning implicitly
admits irrelevance of ordering, even does not consider time information which
plays an important role in many recommendation tasks. Furthermore,
recommendation model incorporated with temporal context would tend to be
self-attentive, i.e., automatically focus more (less) on the relevance
(irrelevance), respectively.
To address these issues, in this paper, we propose a Time-aware
Self-Attention with Neural Collaborative Reasoning (TiSANCR) based
recommendation model, which integrates temporal patterns and self-attention
mechanism into reasoning-based recommendation. Specially, temporal patterns
represented by relative time, provide context and auxiliary information to
characterize the user's preference in recommendation, while self-attention is
leveraged to distill informative patterns and suppress irrelevances. Therefore,
the fusion of self-attentive temporal information provides deeper
representation of user's preference. Extensive experiments on benchmark
datasets demonstrate that the proposed TiSANCR achieves significant improvement
and consistently outperforms the state-of-the-art recommendation methods.
Related papers
- Reinforced Preference Optimization for Reasoning-Augmented Recommendations [34.99578717556569]
We introduce RPORec, a reinforced preference optimization framework for Recommender systems.<n>RPORec unifies an LLM backbone's reasoning ability with a dedicated recommendation head (Rechead) for precise item retrieval.<n>Extensive experiments on public benchmarks and large-scale online deployments show that RPORec consistently outperforms state-of-the-art LLM-based recommendation methods.
arXiv Detail & Related papers (2026-05-21T03:56:42Z) - RecThinker: An Agentic Framework for Tool-Augmented Reasoning in Recommendation [63.74915464611075]
RecThinker is an agentic framework for tool-augmented reasoning in recommendation.<n>We develop a suite of specialized tools for RecThinker, enabling the model to acquire user item-side and collaborative information.
arXiv Detail & Related papers (2026-03-10T16:07:17Z) - Towards Long-Term User Welfare in Recommender Systems via Creator-Oriented Information Revelation [16.39197122169092]
We propose an information-revealing framework, named Long-term Welfare Optimization via Information Revelation (LoRe)<n>In this framework, we utilize a classical information revelation method to map the stakeholders in recommender systems (RS)<n>Our method can effectively outperform existing fair re-ranking methods and information revealing strategies in improving long-term user welfare.
arXiv Detail & Related papers (2025-10-12T09:18:15Z) - Reinforcement Learning for Durable Algorithmic Recourse [49.54997446851335]
We present a time-aware framework for algorithmic recourse, explicitly modeling how candidate populations adapt in response to recommendations.<n>We also introduce a novel reinforcement learning (RL)-based recourse algorithm that captures the evolving dynamics of the environment.
arXiv Detail & Related papers (2025-09-26T09:24:12Z) - STARec: An Efficient Agent Framework for Recommender Systems via Autonomous Deliberate Reasoning [54.28691219536054]
We introduce STARec, a slow-thinking augmented agent framework that endows recommender systems with autonomous deliberative reasoning capabilities.<n>We develop anchored reinforcement training - a two-stage paradigm combining structured knowledge distillation from advanced reasoning models with preference-aligned reward shaping.<n>Experiments on MovieLens 1M and Amazon CDs benchmarks demonstrate that STARec achieves substantial performance gains compared with state-of-the-art baselines.
arXiv Detail & Related papers (2025-08-26T08:47:58Z) - Counterfactual Tuning for Temporal Sensitivity Enhancement in Large Language Model-based Recommendation [8.798364656768657]
Existing large language models (LLMs) fail to leverage the rich temporal information inherent in users' historical interaction sequences.<n>We propose Counterfactual Enhanced Temporal Framework for LLM-Based Recommendation (CETRec)<n> CETRec is grounded in causal inference principles, which allow it to isolate and measure the specific impact of temporal information on recommendation outcomes.
arXiv Detail & Related papers (2025-07-03T10:11:35Z) - Towards Human-like Preference Profiling in Sequential Recommendation [42.100841285901474]
RecPO is a preference optimization framework for sequential recommendation.<n>It exploits adaptive reward margins based on inferred preference hierarchies and temporal signals.<n>It mirrors key characteristics of human decision-making: favoring timely satisfaction, maintaining coherent preferences, and exercising discernment under shifting contexts.
arXiv Detail & Related papers (2025-06-02T21:09:29Z) - Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation [51.06031200728449]
We propose a novel framework called mccHRL to provide different levels of temporal abstraction on listwise recommendation.
Within the hierarchical framework, the high-level agent studies the evolution of user perception, while the low-level agent produces the item selection policy.
Results observe significant performance improvement by our method, compared with several well-known baselines.
arXiv Detail & Related papers (2024-09-11T17:01:06Z) - EASRec: Elastic Architecture Search for Efficient Long-term Sequential
Recommender Systems [82.76483989905961]
Current Sequential Recommender Systems (SRSs) suffer from computational and resource inefficiencies.
We develop the Elastic Architecture Search for Efficient Long-term Sequential Recommender Systems (EASRec)
EASRec introduces data-aware gates that leverage historical information from input data batch to improve the performance of the recommendation network.
arXiv Detail & Related papers (2024-02-01T07:22:52Z) - Robust Recommender System: A Survey and Future Directions [58.87305602959857]
We first present a taxonomy to organize current techniques for withstanding malicious attacks and natural noise.
We then explore state-of-the-art methods in each category, including fraudster detection, adversarial training, certifiable robust training for defending against malicious attacks.
We discuss robustness across varying recommendation scenarios and its interplay with other properties like accuracy, interpretability, privacy, and fairness.
arXiv Detail & Related papers (2023-09-05T08:58:46Z) - Impression-Aware Recommender Systems [53.48892326556546]
We present a systematic literature review on recommender systems using impressions.
We define a theoretical framework to delimit recommender systems using impressions and a novel paradigm for personalized recommendations, called impression-aware recommender systems.
arXiv Detail & Related papers (2023-08-15T16:16:02Z) - Fisher-Weighted Merge of Contrastive Learning Models in Sequential
Recommendation [0.0]
We are the first to apply the Fisher-Merging method to Sequential Recommendation, addressing and resolving practical challenges associated with it.
We demonstrate the effectiveness of our proposed methods, highlighting their potential to advance the state-of-the-art in sequential learning and recommendation systems.
arXiv Detail & Related papers (2023-07-05T05:58:56Z) - Generic Temporal Reasoning with Differential Analysis and Explanation [61.96034987217583]
We introduce a novel task named TODAY that bridges the gap with temporal differential analysis.
TODAY evaluates whether systems can correctly understand the effect of incremental changes.
We show that TODAY's supervision style and explanation annotations can be used in joint learning.
arXiv Detail & Related papers (2022-12-20T17:40:03Z) - CausPref: Causal Preference Learning for Out-of-Distribution
Recommendation [36.22965012642248]
The current recommender system is still vulnerable to the distribution shift of users and items in realistic scenarios.
We propose to incorporate the recommendation-specific DAG learner into a novel causal preference-based recommendation framework named CausPref.
Our approach surpasses the benchmark models significantly under types of out-of-distribution settings.
arXiv Detail & Related papers (2022-02-08T16:42:03Z) - Reinforcement Learning based Path Exploration for Sequential Explainable
Recommendation [57.67616822888859]
We propose a novel Temporal Meta-path Guided Explainable Recommendation leveraging Reinforcement Learning (TMER-RL)
TMER-RL utilizes reinforcement item-item path modelling between consecutive items with attention mechanisms to sequentially model dynamic user-item evolutions on dynamic knowledge graph for explainable recommendation.
Extensive evaluations of TMER on two real-world datasets show state-of-the-art performance compared against recent strong baselines.
arXiv Detail & Related papers (2021-11-24T04:34:26Z) - Recommendation Fairness: From Static to Dynamic [12.080824433982993]
We discuss how fairness could be baked into reinforcement learning techniques for recommendation.
We argue that in order to make further progress in recommendation fairness, we may want to consider multi-agent (game-theoretic) optimization, multi-objective (Pareto) optimization.
arXiv Detail & Related papers (2021-09-05T21:38:05Z) - Dynamic Modeling of User Preferences for Stable Recommendations [0.0]
In domains where users tend to develop long-term preferences that do not change too frequently, the stability of recommendations is an important factor of the perceived quality of a recommender system.
We propose an incremental learning scheme that mitigates such problems through the dynamic modeling approach.
arXiv Detail & Related papers (2021-04-11T16:32:11Z) - S^3-Rec: Self-Supervised Learning for Sequential Recommendation with
Mutual Information Maximization [104.87483578308526]
We propose the model S3-Rec, which stands for Self-Supervised learning for Sequential Recommendation.
For our task, we devise four auxiliary self-supervised objectives to learn the correlations among attribute, item, subsequence, and sequence.
Extensive experiments conducted on six real-world datasets demonstrate the superiority of our proposed method over existing state-of-the-art methods.
arXiv Detail & Related papers (2020-08-18T11:44:10Z) - Sequential Recommender via Time-aware Attentive Memory Network [67.26862011527986]
We propose a temporal gating methodology to improve attention mechanism and recurrent units.
We also propose a Multi-hop Time-aware Attentive Memory network to integrate long-term and short-term preferences.
Our approach is scalable for candidate retrieval tasks and can be viewed as a non-linear generalization of latent factorization for dot-product based Top-K recommendation.
arXiv Detail & Related papers (2020-05-18T11:29:38Z) - D\'ej\`a vu: A Contextualized Temporal Attention Mechanism for
Sequential Recommendation [34.505472771669744]
We argue that the influence from the past events on a user's current action should vary over the course of time and under different context.
We propose a Contextualized Temporal Attention Mechanism that learns to weigh historical actions' influence on not only what action it is, but also when and how the action took place.
arXiv Detail & Related papers (2020-01-29T20:27:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.