Building an Effective Automated Assessment System for C/C++ Introductory
Programming Courses in ODL Environment
- URL: http://arxiv.org/abs/2205.11915v1
- Date: Tue, 24 May 2022 09:20:43 GMT
- Title: Building an Effective Automated Assessment System for C/C++ Introductory
Programming Courses in ODL Environment
- Authors: Muhammad Salman Khan and Adnan Ahmad and Muhammad Humayoun
- Abstract summary: Traditional ways of assessing students' work are becoming insufficient in terms of both time and effort.
In distance education environment, such assessments become additionally more challenging in terms of hefty remuneration for hiring large number of tutors.
We identify different components that we believe are necessary in building an effective automated assessment system.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Assessments help in evaluating the knowledge gained by a learner at any
specific point as well as in continuous improvement of the curriculum design
and the whole learning process. However, with the increase in students'
enrollment at University level in either conventional or distance education
environment, traditional ways of assessing students' work are becoming
insufficient in terms of both time and effort. In distance education
environment, such assessments become additionally more challenging in terms of
hefty remuneration for hiring large number of tutors. The availability of
automated tools to assist the evaluation of students' work and providing
students with appropriate and timely feedback can really help in overcoming
these problems. We believe that building such tools for assessing students'
work for all kinds of courses in not yet possible. However, courses that
involve some formal language of expression can be automated, such as,
programming courses in Computer Science (CS) discipline. Instructors provide
various practical exercises to students as assignments to build these skills.
Usually, instructors manually grade and provide feedbacks on these assignments.
Although in literature, various tools have been reported to automate this
process, but most of these tools have been developed by the host institutions
themselves for their own use. We at COMSATS Institute of Information
Technology, Lahore are conducting a pioneer effort in Pakistan to automate the
marking of assignments of introductory programming courses that involve C or
C++ languages with the capability of associating appropriate feedbacks for
students. In this paper, we basically identify different components that we
believe are necessary in building an effective automated assessment system in
the context of introductory programming courses that involve C/C++ programming.
Related papers
- Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants [175.9723801486487]
We evaluate whether two AI assistants, GPT-3.5 and GPT-4, can adequately answer assessment questions.
GPT-4 answers an average of 65.8% of questions correctly, and can even produce the correct answer across at least one prompting strategy for 85.1% of questions.
Our results call for revising program-level assessment design in higher education in light of advances in generative AI.
arXiv Detail & Related papers (2024-08-07T12:11:49Z) - WIP: A Unit Testing Framework for Self-Guided Personalized Online Robotics Learning [3.613641107321095]
This paper focuses on creating a system for unit testing while integrating it into the course workflow.
In line with the framework's personalized student-centered approach, this method makes it easier for students to revise, and debug their programming work.
The course workflow updated to include unit tests will strengthen the learning environment and make it more interactive so that students can learn how to program robots in a self-guided fashion.
arXiv Detail & Related papers (2024-05-18T00:56:46Z) - Intelligent Tutoring System: Experience of Linking Software Engineering
and Programming Teaching [11.732008724228798]
Existing systems that handle automated grading primarily focus on the automation of test case executions.
We have built an intelligent tutoring system that has the capability of providing automated feedback and grading.
arXiv Detail & Related papers (2023-10-09T07:28:41Z) - Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs)
The system is into three inter-connected core processes-interaction, reflection, and reaction.
Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
arXiv Detail & Related papers (2023-09-15T02:42:03Z) - UKP-SQuARE: An Interactive Tool for Teaching Question Answering [61.93372227117229]
The exponential growth of question answering (QA) has made it an indispensable topic in any Natural Language Processing (NLP) course.
We introduce UKP-SQuARE as a platform for QA education.
Students can run, compare, and analyze various QA models from different perspectives.
arXiv Detail & Related papers (2023-05-31T11:29:04Z) - Smart tutor to provide feedback in programming courses [0.0]
We present an AI based intelligent tutor that answers students programming questions.
The tool has been tested by university students at the URJC along a whole course.
arXiv Detail & Related papers (2023-01-24T11:00:06Z) - Giving Feedback on Interactive Student Programs with Meta-Exploration [74.5597783609281]
Developing interactive software, such as websites or games, is a particularly engaging way to learn computer science.
Standard approaches require instructors to manually grade student-implemented interactive programs.
Online platforms that serve millions, like Code.org, are unable to provide any feedback on assignments for implementing interactive programs.
arXiv Detail & Related papers (2022-11-16T10:00:23Z) - Lifelong Learning Metrics [63.8376359764052]
The DARPA Lifelong Learning Machines (L2M) program seeks to yield advances in artificial intelligence (AI) systems.
This document outlines a formalism for constructing and characterizing the performance of agents performing lifelong learning scenarios.
arXiv Detail & Related papers (2022-01-20T16:29:14Z) - PyBryt: auto-assessment and auto-grading for computational thinking [6.1345408064202696]
We present a novel approach to providing formative feedback to students on programming assignments.
Our approach uses dynamic evaluation to trace intermediate results generated by student's code and compares them to the reference implementation provided by their teachers.
arXiv Detail & Related papers (2021-12-03T20:01:06Z) - An Analysis of Programming Course Evaluations Before and After the
Introduction of an Autograder [1.329950749508442]
This paper studies the answers to the standardized university evaluation questionnaires of foundational computer science courses which recently introduced autograding.
We hypothesize how the autograder might have contributed to the significant changes in the data, such as, improved interactions between tutors and students, improved overall course quality, improved learning success, increased time spent, and reduced difficulty.
The autograder technology can be validated as a teaching method to improve student satisfaction with programming courses.
arXiv Detail & Related papers (2021-10-28T14:09:44Z) - ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback [54.142719510638614]
In this paper, we frame the problem of providing feedback as few-shot classification.
A meta-learner adapts to give feedback to student code on a new programming question from just a few examples by instructors.
Our approach was successfully deployed to deliver feedback to 16,000 student exam-solutions in a programming course offered by a tier 1 university.
arXiv Detail & Related papers (2021-07-23T22:41:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.