Does Difficulty even Matter? Investigating Difficulty Adjustment and Practice Behavior in an Open-Ended Learning Task

• URL: http://arxiv.org/abs/2311.01934v1
• Date: Fri, 3 Nov 2023 14:18:52 GMT
• Title: Does Difficulty even Matter? Investigating Difficulty Adjustment and Practice Behavior in an Open-Ended Learning Task
• Authors: Anan Sch\"utt, Tobias Huber, Jauwairia Nasir, Cristina Conati, Elisabeth Andr\'e
• Abstract summary: The effects of difficulty adjustment could be different for open-ended tasks. As the practice behavior of the students is expected to influence how well the students learn, we additionally look at their practice behavior as a post-hoc analysis.
• Score: 4.953983211671484
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Difficulty adjustment in practice exercises has been shown to be beneficial for learning. However, previous research has mostly investigated close-ended tasks, which do not offer the students multiple ways to reach a valid solution. Contrary to this, in order to learn in an open-ended learning task, students need to effectively explore the solution space as there are multiple ways to reach a solution. For this reason, the effects of difficulty adjustment could be different for open-ended tasks. To investigate this, as our first contribution, we compare different methods of difficulty adjustment in a user study conducted with 86 participants. Furthermore, as the practice behavior of the students is expected to influence how well the students learn, we additionally look at their practice behavior as a post-hoc analysis. Therefore, as a second contribution, we identify different types of practice behavior and how they link to students' learning outcomes and subjective evaluation measures as well as explore the influence the difficulty adjustment methods have on the practice behaviors. Our results suggest the usefulness of taking into account the practice behavior in addition to only using the practice performance to inform adaptive intervention and difficulty adjustment methods.

Related papers

• Beyond right or wrong : towards redefining adaptive learning indicators in virtual learning environments [0.5437050212139087]
  The objective of this work is to elucidate which learning indicators influence student learning and which can be implemented in a VLE to assist in adaptive learning.<n>The works selected and filtered by qualitative assessment reveal a comprehensive approach to assessing different aspects of the learning in virtual environments.
  arXiv  Detail & Related papers  (2025-12-13T00:36:45Z)
• The Right Kind of Help: Evaluating the Effectiveness of Intervention Methods in Elementary-Level Visual Programming [19.887538703101168]
  We present a large-scale study comparing the effectiveness of various intervention methods in elementary programming.<n>Specifically, we compare three intervention methods: code-edit recommendations (Code-Rec), quizzes based on code edits (Code-Quiz), and quizzes based on metacognitive strategies (Plan-Quiz)<n>All intervention methods significantly improved learning performance over the control group while preserving students' problem-solving skills in the post-learning phase.
  arXiv  Detail & Related papers  (2025-12-12T17:22:06Z)
• RLIF: Interactive Imitation Learning as Reinforcement Learning [56.997263135104504]
  We show how off-policy reinforcement learning can enable improved performance under assumptions that are similar but potentially even more practical than those of interactive imitation learning. Our proposed method uses reinforcement learning with user intervention signals themselves as rewards. This relaxes the assumption that intervening experts in interactive imitation learning should be near-optimal and enables the algorithm to learn behaviors that improve over the potential suboptimal human expert.
  arXiv  Detail & Related papers  (2023-11-21T21:05:21Z)
• Optimising Human-AI Collaboration by Learning Convincing Explanations [62.81395661556852]
  We propose a method for a collaborative system that remains safe by having a human making decisions. Ardent enables efficient and effective decision-making by adapting to individual preferences for explanations.
  arXiv  Detail & Related papers  (2023-11-13T16:00:16Z)
• Opportunities for Adaptive Experiments to Enable Continuous Improvement in Computer Science Education [7.50867730317249]
  In adaptive experiments, data is analyzed and utilized as different conditions are deployed to students. These algorithms can then dynamically deploy the most effective conditions in subsequent interactions with students. This work paves the way for exploring the importance of adaptive experiments in bridging research and practice to achieve continuous improvement.
  arXiv  Detail & Related papers  (2023-10-18T20:54:59Z)
• Resilient Constrained Learning [94.27081585149836]
  This paper presents a constrained learning approach that adapts the requirements while simultaneously solving the learning task. We call this approach resilient constrained learning after the term used to describe ecological systems that adapt to disruptions by modifying their operation.
  arXiv  Detail & Related papers  (2023-06-04T18:14:18Z)
• Reinforcing Cybersecurity Hands-on Training With Adaptive Learning [0.5735035463793008]
  This paper is one of the first works investigating adaptive learning in security training. We analyze the performance of 95 students in 12 training sessions to understand the limitations of the current training practice. We propose a novel tutor model for adaptive training, which considers students' proficiency before and during an ongoing training session.
  arXiv  Detail & Related papers  (2022-01-05T12:35:40Z)
• Imitation Learning by Reinforcement Learning [16.62889844853729]
  We show that for deterministic experts, imitation learning can be done by reduction to reinforcement learning. We conduct experiments which confirm that our reduction works well in practice for a continuous control task.
  arXiv  Detail & Related papers  (2021-08-10T16:14:41Z)
• Seeing Differently, Acting Similarly: Imitation Learning with Heterogeneous Observations [126.78199124026398]
  In many real-world imitation learning tasks, the demonstrator and the learner have to act in different but full observation spaces. In this work, we model the above learning problem as Heterogeneous Observations Learning (HOIL) We propose the Importance Weighting with REjection (IWRE) algorithm based on the techniques of importance-weighting, learning with rejection, and active querying to solve the key challenge of occupancy measure matching.
  arXiv  Detail & Related papers  (2021-06-17T05:44:04Z)
• Learning on a Budget via Teacher Imitation [0.5185131234265025]
  Action advising is a framework that provides a flexible way to transfer such knowledge in the form of actions between teacher-student peers. We extend the idea of advice reusing via teacher imitation to construct a unified approach that addresses both advice collection and advice utilisation problems.
  arXiv  Detail & Related papers  (2021-04-17T04:15:00Z)
• One Solution is Not All You Need: Few-Shot Extrapolation via Structured MaxEnt RL [142.36621929739707]
  We show that learning diverse behaviors for accomplishing a task can lead to behavior that generalizes to varying environments. By identifying multiple solutions for the task in a single environment during training, our approach can generalize to new situations.
  arXiv  Detail & Related papers  (2020-10-27T17:41:57Z)
• Importance Weighted Policy Learning and Adaptation [89.46467771037054]
  We study a complementary approach which is conceptually simple, general, modular and built on top of recent improvements in off-policy learning. The framework is inspired by ideas from the probabilistic inference literature and combines robust off-policy learning with a behavior prior. Our approach achieves competitive adaptation performance on hold-out tasks compared to meta reinforcement learning baselines and can scale to complex sparse-reward scenarios.
  arXiv  Detail & Related papers  (2020-09-10T14:16:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.