Enhancing a Student Productivity Model for Adaptive Problem-Solving
Assistance
- URL: http://arxiv.org/abs/2207.03025v1
- Date: Thu, 7 Jul 2022 00:41:00 GMT
- Title: Enhancing a Student Productivity Model for Adaptive Problem-Solving
Assistance
- Authors: Mehak Maniktala, Min Chi, and Tiffany Barnes
- Abstract summary: We present a novel data-driven approach to incorporate students' hint usage in predicting their need for help.
We show empirical evidence to support that such a policy can save students a significant amount of time in training.
We conclude with suggestions on the domains that can benefit from this approach as well as the requirements for adoption.
- Score: 7.253181280137071
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Research on intelligent tutoring systems has been exploring data-driven
methods to deliver effective adaptive assistance. While much work has been done
to provide adaptive assistance when students seek help, they may not seek help
optimally. This had led to the growing interest in proactive adaptive
assistance, where the tutor provides unsolicited assistance upon predictions of
struggle or unproductivity. Determining when and whether to provide
personalized support is a well-known challenge called the assistance dilemma.
Addressing this dilemma is particularly challenging in open-ended domains,
where there can be several ways to solve problems. Researchers have explored
methods to determine when to proactively help students, but few of these
methods have taken prior hint usage into account. In this paper, we present a
novel data-driven approach to incorporate students' hint usage in predicting
their need for help. We explore its impact in an intelligent tutor that deals
with the open-ended and well-structured domain of logic proofs. We present a
controlled study to investigate the impact of an adaptive hint policy based on
predictions of HelpNeed that incorporate students' hint usage. We show
empirical evidence to support that such a policy can save students a
significant amount of time in training, and lead to improved posttest results,
when compared to a control without proactive interventions. We also show that
incorporating students' hint usage significantly improves the adaptive hint
policy's efficacy in predicting students' HelpNeed, thereby reducing training
unproductivity, reducing possible help avoidance, and increasing possible help
appropriateness (a higher chance of receiving help when it was likely to be
needed). We conclude with suggestions on the domains that can benefit from this
approach as well as the requirements for adoption.
Related papers
- Learning to Assist Humans without Inferring Rewards [65.28156318196397]
We build upon prior work that studies assistance through the lens of empowerment.
An assistive agent aims to maximize the influence of the human's actions.
We prove that these representations estimate a similar notion of empowerment to that studied by prior work.
arXiv Detail & Related papers (2024-11-04T21:31:04Z) - Learning Task Decomposition to Assist Humans in Competitive Programming [90.4846613669734]
We introduce a novel objective for learning task decomposition, termed value (AssistV)
We collect a dataset of human repair experiences on different decomposed solutions.
Under 177 hours of human study, our method enables non-experts to solve 33.3% more problems, speeds them up by 3.3x, and empowers them to match unassisted experts.
arXiv Detail & Related papers (2024-06-07T03:27:51Z) - Improving Point-based Crowd Counting and Localization Based on Auxiliary Point Guidance [59.71186244597394]
We introduce an effective approach to stabilize the proposal-target matching in point-based methods.
We propose Auxiliary Point Guidance (APG) to provide clear and effective guidance for proposal selection and optimization.
We also develop Implicit Feature Interpolation (IFI) to enable adaptive feature extraction in diverse crowd scenarios.
arXiv Detail & Related papers (2024-05-17T07:23:27Z) - Use of recommendation models to provide support to dyslexic students [0.0]
This study investigates the possibility of using AI to suggest the most suitable supporting tools for dyslexic students.
We trained three collaborative-filtering recommendation models and studied their performance on a large database of 1237 students.
The obtained results showed that a recommendation system is highly effective in suggesting the optimal help tools/strategies for everyone.
arXiv Detail & Related papers (2024-03-18T12:12:38Z) - Optimising Human-AI Collaboration by Learning Convincing Explanations [62.81395661556852]
We propose a method for a collaborative system that remains safe by having a human making decisions.
Ardent enables efficient and effective decision-making by adapting to individual preferences for explanations.
arXiv Detail & Related papers (2023-11-13T16:00:16Z) - Reinforcement Learning Tutor Better Supported Lower Performers in a Math
Task [32.6507926764587]
Reinforcement learning could be a key tool to reduce the development cost and improve the effectiveness of intelligent tutoring software.
We show that deep reinforcement learning can be used to provide adaptive pedagogical support to students learning about the concept of volume.
arXiv Detail & Related papers (2023-04-11T02:11:24Z) - Discovering an Aid Policy to Minimize Student Evasion Using Offline
Reinforcement Learning [2.2344764434954256]
We propose a decision support method to the selection of aid actions for students using offline reinforcement learning.
Our experiments using logged data of real students shows, through off-policy evaluation, that the method should achieve roughly 1.0 to 1.5 times as much cumulative reward as the logged policy.
arXiv Detail & Related papers (2021-04-20T21:45:19Z) - Generative Inverse Deep Reinforcement Learning for Online Recommendation [62.09946317831129]
We propose a novel inverse reinforcement learning approach, namely InvRec, for online recommendation.
InvRec extracts the reward function from user's behaviors automatically, for online recommendation.
arXiv Detail & Related papers (2020-11-04T12:12:25Z) - Extending the Hint Factory for the assistance dilemma: A novel,
data-driven HelpNeed Predictor for proactive problem-solving help [6.188683567894372]
We present a set of data-driven methods to classify, predict, and prevent unproductive problem-solving steps.
We present a HelpNeed classification, that uses prior student data to determine when students are likely to be unproductive.
We conclude with suggestions on how these HelpNeed methods could be applied in other well-structured open-ended domains.
arXiv Detail & Related papers (2020-10-08T17:04:03Z) - Avoiding Help Avoidance: Using Interface Design Changes to Promote
Unsolicited Hint Usage in an Intelligent Tutor [6.639504127104268]
We propose a new hint delivery mechanism called "Assertions" for providing unsolicited hints in a data-driven intelligent tutor.
In systems that only provide hints upon request, hint avoidance results in students not receiving hints when they are needed.
Our results show that Assertions significantly increase unsolicited hint usage compared to Messages.
arXiv Detail & Related papers (2020-09-28T14:39:11Z) - AvE: Assistance via Empowerment [77.08882807208461]
We propose a new paradigm for assistance by instead increasing the human's ability to control their environment.
This task-agnostic objective preserves the person's autonomy and ability to achieve any eventual state.
arXiv Detail & Related papers (2020-06-26T04:40:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.