AdvisingWise: Supporting Academic Advising in Higher Educations Through a Human-in-the-Loop Multi-Agent Framework

• URL: http://arxiv.org/abs/2511.05706v1
• Date: Fri, 07 Nov 2025 20:55:24 GMT
• Title: AdvisingWise: Supporting Academic Advising in Higher Educations Through a Human-in-the-Loop Multi-Agent Framework
• Authors: Wendan Jiang, Shiyuan Wang, Hiba Eltigani, Rukhshan Haroon, Abdullah Bin Faisal, Fahad Dogar,
• Abstract summary: High student-to-advisor ratios limit advisors' capacity to provide timely support.<n>Recent advances in Large Language Models (LLMs) present opportunities to enhance the advising process.<n>We present AdvisingWise, a multi-agent system that automates time-consuming tasks, such as information retrieval and response drafting.
• Score: 8.037437041741901
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Academic advising is critical to student success in higher education, yet high student-to-advisor ratios limit advisors' capacity to provide timely support, particularly during peak periods. Recent advances in Large Language Models (LLMs) present opportunities to enhance the advising process. We present AdvisingWise, a multi-agent system that automates time-consuming tasks, such as information retrieval and response drafting, while preserving human oversight. AdvisingWise leverages authoritative institutional resources and adaptively prompts students about their academic backgrounds to generate reliable, personalized responses. All system responses undergo human advisor validation before delivery to students. We evaluate AdvisingWise through a mixed-methods approach: (1) expert evaluation on responses of 20 sample queries, (2) LLM-as-a-judge evaluation of the information retrieval strategy, and (3) a user study with 8 academic advisors to assess the system's practical utility. Our evaluation shows that AdvisingWise produces accurate, personalized responses. Advisors reported increasingly positive perceptions after using AdvisingWise, as their initial concerns about reliability and personalization diminished. We conclude by discussing the implications of human-AI synergy on the practice of academic advising.

Related papers

• Ψ-Arena: Interactive Assessment and Optimization of LLM-based Psychological Counselors with Tripartite Feedback [51.26493826461026]
  We propose Psi-Arena, an interactive framework for comprehensive assessment and optimization of large language models (LLMs)<n>Arena features realistic arena interactions that simulate real-world counseling through multi-stage dialogues with psychologically profiled NPC clients.<n>Experiments across eight state-of-the-art LLMs show significant performance variations in different real-world scenarios and evaluation perspectives.
  arXiv  Detail & Related papers  (2025-05-06T08:22:51Z)
• AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligence [28.732847229006264]
  We introduce AdvisorQA, the first benchmark developed to assess LLMs' capability in offering advice for deeply personalized concerns.<n>We've completed a benchmark encompassing daily life questions, diverse corresponding responses, and majority vote ranking to train our helpfulness metric.<n> Baseline experiments validate the efficacy of AdvisorQA through our helpfulness metric, GPT-4, and human evaluation.
  arXiv  Detail & Related papers  (2024-04-18T01:15:41Z)
• Learning Analytics Dashboards for Advisors -- A Systematic Literature Review [0.0]
  Learning Analytics Dashboard for Advisors is designed to provide data-driven insights and visualizations to support advisors in their decision-making. This study explores the current state of the art in learning analytics dashboards, focusing on specific requirements for advisors.
  arXiv  Detail & Related papers  (2024-01-17T19:34:55Z)
• Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback [46.70617195649979]
  CARE is an AI-based tool to empower and train peer counselors through practice and feedback.<n> CARE helps diagnose which counseling strategies are needed in a given situation and suggests example responses to counselors during their practice sessions.
  arXiv  Detail & Related papers  (2023-05-15T19:48:59Z)
• MADDM: Multi-Advisor Dynamic Binary Decision-Making by Maximizing the Utility [8.212621730577897]
  We propose a novel strategy for optimally selecting a set of advisers in a sequential binary decision-making setting. We assume no access to ground truth and no prior knowledge about the reliability of advisers.
  arXiv  Detail & Related papers  (2023-05-15T14:13:47Z)
• Ask-AC: An Initiative Advisor-in-the-Loop Actor-Critic Framework [41.04606578479283]
  We introduce a novel initiative advisor-in-the-loop actor-critic framework, termed as Ask-AC. At the heart of Ask-AC are two complementary components, namely action requester and adaptive state selector. Experimental results on both stationary and non-stationary environments demonstrate that the proposed framework significantly improves the learning efficiency of the agent.
  arXiv  Detail & Related papers  (2022-07-05T10:58:11Z)
• Are Akpans Trick or Treat: Unveiling Helpful Biases in Assistant Systems [55.09907990139756]
  Information-seeking AI assistant systems aim to answer users' queries about knowledge in a timely manner.<n>In this paper, we study computational measurements of helpfulness.<n> Experiments with state-of-the-art dialogue systems reveal that existing systems tend to be more helpful for questions regarding concepts from highly-developed countries.
  arXiv  Detail & Related papers  (2022-05-25T07:58:38Z)
• Doubting AI Predictions: Influence-Driven Second Opinion Recommendation [92.30805227803688]
  We propose a way to augment human-AI collaboration by building on a common organizational practice: identifying experts who are likely to provide complementary opinions. The proposed approach aims to leverage productive disagreement by identifying whether some experts are likely to disagree with an algorithmic assessment.
  arXiv  Detail & Related papers  (2022-04-29T20:35:07Z)
• FEBR: Expert-Based Recommendation Framework for beneficial and personalized content [77.86290991564829]
  We propose FEBR (Expert-Based Recommendation Framework), an apprenticeship learning framework to assess the quality of the recommended content. The framework exploits the demonstrated trajectories of an expert (assumed to be reliable) in a recommendation evaluation environment, to recover an unknown utility function. We evaluate the performance of our solution through a user interest simulation environment (using RecSim)
  arXiv  Detail & Related papers  (2021-07-17T18:21:31Z)
• KnowledgeCheckR: Intelligent Techniques for Counteracting Forgetting [52.623349754076024]
  We provide an overview of the recommendation approaches integrated in KnowledgeCheckR. Examples thereof are utility-based recommendation that helps to identify learning contents to be repeated in the future, collaborative filtering approaches that help to implement session-based recommendation, and content-based recommendation that supports intelligent question answering.
  arXiv  Detail & Related papers  (2021-02-15T20:06:28Z)
• Human Engagement Providing Evaluative and Informative Advice for Interactive Reinforcement Learning [2.5799044614524664]
  This work focuses on answering which of two approaches, evaluative or informative, is the preferred instructional approach for humans. Results show users giving informative advice provide more accurate advice, are willing to assist the learner agent for a longer time, and provide more advice per episode.
  arXiv  Detail & Related papers  (2020-09-21T02:14:02Z)
• Understanding the Advisor-advisee Relationship via Scholarly Data Analysis [32.63446608170046]
  Advisees mentored by advisors with high academic level have better academic performance than the rest. Advisees mentored by advisors with high academic level can raise their advisees' h-index ranking. This work provides new insights on promoting our understanding of the relationship between advisors' academic characteristics and advisees' performance.
  arXiv  Detail & Related papers  (2020-08-20T02:57:25Z)
• Opportunities of a Machine Learning-based Decision Support System for Stroke Rehabilitation Assessment [64.52563354823711]
  Rehabilitation assessment is critical to determine an adequate intervention for a patient. Current practices of assessment mainly rely on therapist's experience, and assessment is infrequently executed due to the limited availability of a therapist. We developed an intelligent decision support system that can identify salient features of assessment using reinforcement learning.
  arXiv  Detail & Related papers  (2020-02-27T17:04:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.