Trustworthy Recommendation in the Era of Large Language Models: Opportunities and Challenges
- URL: http://arxiv.org/abs/2606.00540v1
- Date: Sat, 30 May 2026 05:14:53 GMT
- Title: Trustworthy Recommendation in the Era of Large Language Models: Opportunities and Challenges
- Abstract summary: Large Language Models (LLMs) have been extensively integrated into recommender systems.<n>LLMs offer unprecedented opportunities to enhance trustworthiness.<n>But they simultaneously introduce new risks, such as novel forms of bias and hallucination-induced issues.
- Score: 60.18620798072947
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The field of recommender systems (RS) is currently undergoing two profound paradigm shifts. From the perspective of objectives, the goal has shifted beyond mere recommendation accuracy to comprehensive trustworthiness, encompassing multiple dimensions such as robustness, fairness, and privacy preservation. From a technical perspective, Large Language Models (LLMs) have been extensively integrated into RS, reshaping the foundations of recommendation through richer semantic understanding, stronger intent reasoning, and more flexible user interactions. The convergence of these two shifts prompts a timely and pivotal question: how does the integration of LLMs reshape the landscape of trustworthy recommendation? In this work, we present a systematic review of trustworthy LLM-empowered recommendation. By comprehensively analyzing over 200 recent studies, we reveal that the introduction of LLMs acts as a double-edged sword. While their advanced mechanisms and user-friendly interfaces offer unprecedented opportunities to enhance trustworthiness, they simultaneously introduce new risks, such as novel forms of bias and hallucination-induced issues. To characterize this dual impact, we systematically identify 13 opportunities and 18 challenges across six fundamental dimensions of trustworthiness, and accordingly organize the existing literature into a novel taxonomy. We also provide a comprehensive review of commonly used datasets and evaluation metrics to facilitate empirical validation. Finally, we identify critical open challenges and outline future directions, hoping to inspire future research on this emerging topic.
Related papers
- Rethinking Fairness in LLM-Based Recommender Systems: A Survey [53.806131724790525]
Large Language Models (LLMs) are reshaping recommender systems by enabling more semantic, generative, and interactive recommendation pipelines.<n>This survey provides a systematic review of fairness in LLM-based recommender systems (LLM4Rec)
arXiv Detail & Related papers (2026-05-31T16:20:31Z) - Verifiable Reasoning for LLM-based Generative Recommendation [106.7765000777685]
Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation.<n>We propose a novel textbftextitreason-verify-recommend paradigm, which interleaves reasoning with verification to provide reliable feedback.<n>Experiments on four real-world datasets demonstrate that VRec substantially enhances recommendation effectiveness and scalability without compromising efficiency.
arXiv Detail & Related papers (2026-03-08T16:55:45Z) - Uncertainty and Fairness Awareness in LLM-Based Recommendation Systems [3.937681476010311]
This paper studies how uncertainty and fairness evaluations affect the accuracy, consistency, and trustworthiness of large language models (LLMs)<n>We quantify predictive uncertainty (via entropy) and demonstrate that Google DeepMind's Gemini 1.5 Flash exhibits systematic unfairness for certain sensitive attributes.<n>We propose a novel uncertainty-aware evaluation methodology for RecLLMs, present empirical insights from deep uncertainty case studies, and introduce a personality profile-informed fairness benchmark.
arXiv Detail & Related papers (2026-01-31T17:18:13Z) - Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigation [51.19622266249408]
MultiTrust-X is a benchmark for evaluating, analyzing, and mitigating the trustworthiness issues of MLLMs.<n>Based on the taxonomy, MultiTrust-X includes 32 tasks and 28 curated datasets.<n>Our experiments reveal significant vulnerabilities in current models.
arXiv Detail & Related papers (2025-08-21T09:00:01Z) - Toward Holistic Evaluation of Recommender Systems Powered by Generative Models [29.797042093096277]
generative models (Gen-RecSys) produce open-ended content, which simultaneously unlocks richer user experiences and introduces new risks.<n>Traditional accuracy metrics fail to measure factual correctness, content safety, or alignment with user intent.<n>We propose a holistic evaluation approach that includes scenario-based assessments and multi-metric checks-incorporating relevance.
arXiv Detail & Related papers (2025-04-09T08:08:16Z) - A Survey on Federated Fine-tuning of Large Language Models [21.559090305077273]
FedLLM offers a promising avenue for collaborative model adaptation while preserving data privacy.<n>To rigorously evaluate FedLLM, we undertake a thorough review of existing fine-tuning datasets and evaluation benchmarks.<n>We identify critical open challenges and outline promising research directions to foster future advancements in FedLLM.
arXiv Detail & Related papers (2025-03-15T06:52:10Z) - Trustworthiness in Retrieval-Augmented Generation Systems: A Survey [59.26328612791924]
Retrieval-Augmented Generation (RAG) has quickly grown into a pivotal paradigm in the development of Large Language Models (LLMs)
We propose a unified framework that assesses the trustworthiness of RAG systems across six key dimensions: factuality, robustness, fairness, transparency, accountability, and privacy.
arXiv Detail & Related papers (2024-09-16T09:06:44Z) - MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models [51.19622266249408]
MultiTrust is the first comprehensive and unified benchmark on the trustworthiness of MLLMs.<n>Our benchmark employs a rigorous evaluation strategy that addresses both multimodal risks and cross-modal impacts.<n>Extensive experiments with 21 modern MLLMs reveal some previously unexplored trustworthiness issues and risks.
arXiv Detail & Related papers (2024-06-11T08:38:13Z) - Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Review [2.780460221321639]
The paper underscores the significance of Large Language Models in reshaping recommender systems.
LLMs exhibit exceptional proficiency in recommending items, showcasing their adeptness in comprehending intricacies of language.
Despite their transformative potential, challenges persist, including sensitivity to input prompts, occasional misinterpretations, and unforeseen recommendations.
arXiv Detail & Related papers (2024-02-11T00:24:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.