An Online Integrated Development Environment for Automated Programming Assessment Systems

• URL: http://arxiv.org/abs/2503.13127v1
• Date: Mon, 17 Mar 2025 12:50:51 GMT
• Title: An Online Integrated Development Environment for Automated Programming Assessment Systems
• Abstract summary: This research contributes to the field of programming education by extracting and defining requirements for an online IDE.<n>The usability of the new online IDE was assessed using the Technology Acceptance Model (TAM), gathering feedback from 27 first-year students.
• Score: 4.618037115403291
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The increasing demand for programmers has led to a surge in participants in programming courses, making it increasingly challenging for instructors to assess student code manually. As a result, automated programming assessment systems (APASs) have been developed to streamline this process. These APASs support lecturers by managing and evaluating student programming exercises at scale. However, these tools often do not provide feature-rich online editors compared to their traditional integrated development environments (IDEs) counterparts. This absence of key features, such as syntax highlighting and autocompletion, can negatively impact the learning experience, as these tools are crucial for effective coding practice. To address this gap, this research contributes to the field of programming education by extracting and defining requirements for an online IDE in an educational context and presenting a prototypical implementation of an open-source solution for a scalable and secure online IDE. The usability of the new online IDE was assessed using the Technology Acceptance Model (TAM), gathering feedback from 27 first-year students through a structured survey. In addition to these qualitative insights, quantitative measures such as memory (RAM) usage were evaluated to determine the efficiency and scalability of the tool under varying usage conditions.

Related papers

• AI-Driven Research for Databases [46.766852032419116]
  A new class of techniques, termed AI-Driven Research for Systems, uses large language models to automate solution discovery.<n>This approach shifts optimization from manual system design to automated code generation.<n>We propose automating the design of evaluators by co-evolving them with the solutions.
  arXiv  Detail & Related papers  (2026-04-08T01:34:11Z)
• Learning to Code with Context: A Study-Based Approach [0.28675177318965045]
  The rapid emergence of generative AI tools is transforming the way software is developed.<n>Project-based courses offer an effective environment to explore and evaluate the integration of AI assistance into real-world development practices.<n>This paper presents our approach and a user study conducted within a university programming project in which students collaboratively developed computer games.
  arXiv  Detail & Related papers  (2025-12-04T20:40:36Z)
• Using LLMs and Essence to Support Software Practice Adoption [0.3609538870261841]
  This study explores the integration of Essence, a standard and thinking framework for managing software engineering practices, with large language models (LLMs)<n>The proposed system consistently outperforms its baseline counterpart in domain-specific tasks.
  arXiv  Detail & Related papers  (2025-08-22T14:59:35Z)
• AITEE -- Agentic Tutor for Electrical Engineering [44.99833362998488]
  AITEE is an agent-based tutoring system for electrical engineering.<n>It supports both hand-drawn and digital circuits through an adapted circuit reconstruction process.<n>It implements a Socratic dialogue to foster learner autonomy through guided questioning.
  arXiv  Detail & Related papers  (2025-05-27T10:07:05Z)
• Design of AI-Powered Tool for Self-Regulation Support in Programming Education [4.171227316909729]
  Large Language Model (LLM) tools have demonstrated their potential to deliver high-quality assistance. However, many of these tools operate independently from institutional Learning Management Systems. This isolation limits the ability to leverage learning materials and exercise context for generating tailored, context-aware feedback.
  arXiv  Detail & Related papers  (2025-04-03T22:47:33Z)
• PyEvalAI: AI-assisted evaluation of Jupyter Notebooks for immediate personalized feedback [43.56788158589046]
  PyEvalAI scores Jupyter notebooks using a combination of unit tests and a locally hosted language model to preserve privacy.<n>A case study demonstrates its effectiveness in improving feedback speed and grading efficiency for exercises in a university-level course on numerics.
  arXiv  Detail & Related papers  (2025-02-25T18:20:20Z)
• ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models [49.04652315815501]
  Tool learning has emerged as a crucial capability for large language models (LLMs) to solve complex real-world tasks through interaction with external tools. We propose ToolCoder, a novel framework that reformulates tool learning as a code generation task.
  arXiv  Detail & Related papers  (2025-02-17T03:42:28Z)
• Agent-Driven Automatic Software Improvement [55.2480439325792]
  This research proposal aims to explore innovative solutions by focusing on the deployment of agents powered by Large Language Models (LLMs) The iterative nature of agents, which allows for continuous learning and adaptation, can help surpass common challenges in code generation. We aim to use the iterative feedback in these systems to further fine-tune the LLMs underlying the agents, becoming better aligned to the task of automated software improvement.
  arXiv  Detail & Related papers  (2024-06-24T15:45:22Z)
• WIP: A Unit Testing Framework for Self-Guided Personalized Online Robotics Learning [3.613641107321095]
  This paper focuses on creating a system for unit testing while integrating it into the course workflow. In line with the framework's personalized student-centered approach, this method makes it easier for students to revise, and debug their programming work. The course workflow updated to include unit tests will strengthen the learning environment and make it more interactive so that students can learn how to program robots in a self-guided fashion.
  arXiv  Detail & Related papers  (2024-05-18T00:56:46Z)
• Code Compass: A Study on the Challenges of Navigating Unfamiliar Codebases [2.808331566391181]
  We propose a novel tool, Code, to address these issues. Our study highlights a significant gap in current tools and methodologies. Our formative study demonstrates how effectively the tool reduces the time developers spend navigating documentation.
  arXiv  Detail & Related papers  (2024-05-10T06:58:31Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• Combatting Human Trafficking in the Cyberspace: A Natural Language Processing-Based Methodology to Analyze the Language in Online Advertisements [55.2480439325792]
  This project tackles the pressing issue of human trafficking in online C2C marketplaces through advanced Natural Language Processing (NLP) techniques. We introduce a novel methodology for generating pseudo-labeled datasets with minimal supervision, serving as a rich resource for training state-of-the-art NLP models. A key contribution is the implementation of an interpretability framework using Integrated Gradients, providing explainable insights crucial for law enforcement.
  arXiv  Detail & Related papers  (2023-11-22T02:45:01Z)
• Software Engineering Educational Experience in Building an Intelligent Tutoring System [10.935408461248173]
  This paper discusses the Intelligent Tutoring System architecture, our teaching concept in the SE course, and our experience with the built ITS.<n>This SE course envisions building a full-fledged Intelligent Tutoring System to provide automated, real-time feedback for novice students in programming courses over multiple years.
  arXiv  Detail & Related papers  (2023-10-09T07:28:41Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Towards a Success Model for Automated Programming Assessment Systems Used as a Formative Assessment Tool [42.03652286907358]
  The assessment of source code in university education is a central and important task for lecturers of programming courses. The use of automated programming assessment systems (APASs) is a promising solution. Measuring the effectiveness and success of APASs is crucial to understanding how such platforms should be designed, implemented, and used.
  arXiv  Detail & Related papers  (2023-06-08T06:19:15Z)
• Building an Effective Automated Assessment System for C/C++ Introductory Programming Courses in ODL Environment [0.0]
  Traditional ways of assessing students' work are becoming insufficient in terms of both time and effort. In distance education environment, such assessments become additionally more challenging in terms of hefty remuneration for hiring large number of tutors. We identify different components that we believe are necessary in building an effective automated assessment system.
  arXiv  Detail & Related papers  (2022-05-24T09:20:43Z)
• Lifelong Learning Metrics [63.8376359764052]
  The DARPA Lifelong Learning Machines (L2M) program seeks to yield advances in artificial intelligence (AI) systems. This document outlines a formalism for constructing and characterizing the performance of agents performing lifelong learning scenarios.
  arXiv  Detail & Related papers  (2022-01-20T16:29:14Z)
• Securing Bring-Your-Own-Device (BYOD) Programming Exams [1.9164932573056916]
  Traditional pen and paper exams are inadequate for modern university programming courses. Many institutions lack the resources or space to be able to run assessments in dedicated computer labs. This has motivated the development of bring-your-own-device (BYOD) exam formats.
  arXiv  Detail & Related papers  (2020-01-12T15:01:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.