Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System

• URL: http://arxiv.org/abs/2605.01400v1
• Date: Sat, 02 May 2026 11:43:47 GMT
• Title: Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System
• Abstract summary: This study examines how varying levels of user control in an ERS influenced users' perceptions of the recommendation goals of perceived control, transparency, trust, satisfaction, and perceived quality.<n>Our results show that enabling users to build and refine their profile is sufficient to promote positive perceptions of the ERS.<n>The findings provide empirical evidence that user control positively shapes transparency, trust, satisfaction, and perceived quality, though to varying extents.
• Score: 1.3125039212103755
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Educational recommender systems (ERSs) are becoming increasingly important in enhancing educational outcomes and personalizing learning experiences by providing recommendations of personalized resources and activities to learners, tailored to their individual learning needs. While user control is widely assumed to improve user experience, the effects of different levels of control in ERSs remain underexplored. To address this gap, we designed and evaluated an interactive ERS within the MOOC platform CourseMapper, where learners could interact with the input (i.e., user profile), process (i.e., recommendation algorithm), and output (i.e., recommendations) of the system. We conducted a between-subjects user study (N=184) to examine how varying levels of user control in an ERS influenced users' perceptions of the recommendation goals of perceived control, transparency, trust, satisfaction, and perceived quality. Our results show that enabling users to build and refine their profile is sufficient to promote positive perceptions of the ERS, while additional control options mainly reinforce these impressions. Moreover, perceived control is the only goal significantly affected by providing different levels of user control in the ERS, with input control exerting the strongest influence. Furthermore, different levels of control affect transparency, trust, satisfaction, and perceived quality in distinct yet interconnected ways. Overall, the findings provide empirical evidence that user control positively shapes transparency, trust, satisfaction, and perceived quality, though to varying extents.

Related papers

• Preference-Aware Rubric Learning for Personalized Evaluation [59.539429430690156]
  Existing evaluation methods fail to capture user-specific preferences embedded in long-term interaction histories.<n>We propose Personalized Evaluation as Learning, a paradigm that formulates personalized evaluation as a learning problem rather than a static judgment.<n>Experiments show that PARL consistently induces high-fidelity rubrics that reliably identify user-aligned responses and generalize across users.
  arXiv  Detail & Related papers  (2026-05-29T17:00:55Z)
• Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender System [1.3125039212103755]
  We examine how explanation format and PCs jointly influence perceived control, transparency, trust, and satisfaction in an educational recommender system (ERS)<n>Our results show that a well-designed visual, simple, interactive, selective, easy to understand visualization that clearly and intuitively communicates how user preferences are linked to recommendations fosters perceived control, transparency, appropriate trust, and satisfaction in the ERS for most users, independent of their PCs.
  arXiv  Detail & Related papers  (2026-03-26T16:37:13Z)
• Human-Centered Development of Indicators for Self-Service Learning Analytics: A Transparency through Exploration Approach [0.0]
  The aim of learning analytics is to turn educational data into insights, decisions, and actions to improve learning and teaching.<n>The reasoning of the provided insights, decisions, and actions is often not transparent to the end-user.<n>In this paper, we shed light on achieving transparent learning analytics by following a transparency through exploration approach.
  arXiv  Detail & Related papers  (2025-10-09T16:15:54Z)
• Exploring the Impact of Personality Traits on Conversational Recommender Systems: A Simulation with Large Language Models [70.180385882195]
  This paper introduces a personality-aware user simulation for Conversational Recommender Systems (CRSs)<n>The user agent induces customizable personality traits and preferences, while the system agent possesses the persuasion capability to simulate realistic interaction in CRSs.<n> Experimental results demonstrate that state-of-the-art LLMs can effectively generate diverse user responses aligned with specified personality traits.
  arXiv  Detail & Related papers  (2025-04-09T13:21:17Z)
• Designing and Evaluating an Educational Recommender System with Different Levels of User Control [0.6291443816903801]
  We present the systematic design and evaluation of an interactive educational recommender system (ERS)<n>We introduce user control around the input (i.e., user profile), process (i.e., recommendation algorithm), and output (i.e., recommendations) of the ERS.<n>Our results demonstrate the positive impact of user control on user perceived benefits of the ERS.
  arXiv  Detail & Related papers  (2025-01-22T14:14:49Z)
• Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
  In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied. We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
  arXiv  Detail & Related papers  (2024-04-19T16:45:50Z)
• Negotiating the Shared Agency between Humans & AI in the Recommender System [1.4249472316161877]
  This study introduces a dual-control mechanism aimed at enhancing user agency.<n>We evaluated the impact of varying levels of transparency and control on user experience.
  arXiv  Detail & Related papers  (2024-03-23T19:23:08Z)
• User-Controllable Recommendation via Counterfactual Retrospective and Prospective Explanations [96.45414741693119]
  We present a user-controllable recommender system that seamlessly integrates explainability and controllability. By providing both retrospective and prospective explanations through counterfactual reasoning, users can customize their control over the system.
  arXiv  Detail & Related papers  (2023-08-02T01:13:36Z)
• Editable User Profiles for Controllable Text Recommendation [66.00743968792275]
  We propose LACE, a novel concept value bottleneck model for controllable text recommendations. LACE represents each user with a succinct set of human-readable concepts. It learns personalized representations of the concepts based on user documents.
  arXiv  Detail & Related papers  (2023-04-09T14:52:18Z)
• Explainable Predictive Process Monitoring: A User Evaluation [62.41400549499849]
  Explainability is motivated by the lack of transparency of black-box Machine Learning approaches. We carry on a user evaluation on explanation approaches for Predictive Process Monitoring.
  arXiv  Detail & Related papers  (2022-02-15T22:24:21Z)
• Soliciting Human-in-the-Loop User Feedback for Interactive Machine Learning Reduces User Trust and Impressions of Model Accuracy [8.11839312231511]
  Mixed-initiative systems allow users to interactively provide feedback to improve system performance. Our research investigates how the act of providing feedback can affect user understanding of an intelligent system and its accuracy.
  arXiv  Detail & Related papers  (2020-08-28T16:46:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.