Analyzing-Evaluating-Creating: Assessing Computational Thinking and Problem Solving in Visual Programming Domains
- URL: http://arxiv.org/abs/2403.12227v1
- Date: Mon, 18 Mar 2024 20:18:34 GMT
- Title: Analyzing-Evaluating-Creating: Assessing Computational Thinking and Problem Solving in Visual Programming Domains
- Authors: Ahana Ghosh, Liina Malva, Adish Singla,
- Abstract summary: Computational thinking (CT) and problem-solving skills are increasingly integrated into K-8 school curricula worldwide.
We have developed ACE, a novel test focusing on the three higher cognitive levels in Bloom's taxonomy.
We evaluate the psychometric properties of ACE through a study conducted with 371 students in grades 3-7 from 10 schools.
- Score: 21.14335914575035
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Computational thinking (CT) and problem-solving skills are increasingly integrated into K-8 school curricula worldwide. Consequently, there is a growing need to develop reliable assessments for measuring students' proficiency in these skills. Recent works have proposed tests for assessing these skills across various CT concepts and practices, in particular, based on multi-choice items enabling psychometric validation and usage in large-scale studies. Despite their practical relevance, these tests are limited in how they measure students' computational creativity, a crucial ability when applying CT and problem solving in real-world settings. In our work, we have developed ACE, a novel test focusing on the three higher cognitive levels in Bloom's Taxonomy, i.e., Analyze, Evaluate, and Create. ACE comprises a diverse set of 7x3 multi-choice items spanning these three levels, grounded in elementary block-based visual programming. We evaluate the psychometric properties of ACE through a study conducted with 371 students in grades 3-7 from 10 schools. Based on several psychometric analysis frameworks, our results confirm the reliability and validity of ACE. Our study also shows a positive correlation between students' performance on ACE and performance on Hour of Code: Maze Challenge by Code.org.
Related papers
- Disentangling Heterogeneous Knowledge Concept Embedding for Cognitive Diagnosis on Untested Knowledge [16.126762028648436]
Current works assume each knowledge concept will be tested and covered by multiple exercises.
It's hardly feasible to completely cover all knowledge concepts in several exercises.
We propose a novel underlineDisentangling Heterogeneous underlineKnowledge underlineCognitive underlineDiagnosis framework on untested knowledge(DisKCD)
arXiv Detail & Related papers (2024-05-25T01:49:54Z) - Deep Learning-Based Object Pose Estimation: A Comprehensive Survey [73.74933379151419]
We discuss the recent advances in deep learning-based object pose estimation.
Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks.
arXiv Detail & Related papers (2024-05-13T14:44:22Z) - Survey of Computerized Adaptive Testing: A Machine Learning Perspective [66.26687542572974]
Computerized Adaptive Testing (CAT) provides an efficient and tailored method for assessing the proficiency of examinees.
This paper aims to provide a machine learning-focused survey on CAT, presenting a fresh perspective on this adaptive testing method.
arXiv Detail & Related papers (2024-03-31T15:09:47Z) - Connecting Beliefs, Mindsets, Anxiety, and Self-Efficacy in Computer
Science Learning: An Instrument for Capturing Secondary School Students'
Self-Beliefs [0.0]
We introduce the CS Interests and Beliefs Inventory (CSIBI), an instrument designed for novice secondary students learning by designing projects.
The inventory contains subscales on beliefs on problem solving competency, fascination in design, value of CS, creative expression, and beliefs about context-specific CS abilities.
We explain the creation of the instrument and attend to the role of mindsets as mediators of self-beliefs and how CSIBI may be adapted to other K-12 project-based learning settings.
arXiv Detail & Related papers (2023-07-19T14:47:08Z) - A Systematic Survey in Geometric Deep Learning for Structure-based Drug
Design [63.30166298698985]
Structure-based drug design (SBDD) utilizes the three-dimensional geometry of proteins to identify potential drug candidates.
Recent developments in geometric deep learning, focusing on the integration and processing of 3D geometric data, have greatly advanced the field of structure-based drug design.
arXiv Detail & Related papers (2023-06-20T14:21:58Z) - Multi-Dimensional Evaluation of Text Summarization with In-Context
Learning [79.02280189976562]
In this paper, we study the efficacy of large language models as multi-dimensional evaluators using in-context learning.
Our experiments show that in-context learning-based evaluators are competitive with learned evaluation frameworks for the task of text summarization.
We then analyze the effects of factors such as the selection and number of in-context examples on performance.
arXiv Detail & Related papers (2023-06-01T23:27:49Z) - UKP-SQuARE: An Interactive Tool for Teaching Question Answering [61.93372227117229]
The exponential growth of question answering (QA) has made it an indispensable topic in any Natural Language Processing (NLP) course.
We introduce UKP-SQuARE as a platform for QA education.
Students can run, compare, and analyze various QA models from different perspectives.
arXiv Detail & Related papers (2023-05-31T11:29:04Z) - The competent Computational Thinking test (cCTt): a valid, reliable and
gender-fair test for longitudinal CT studies in grades 3-6 [0.7896843467339624]
This study investigated whether the competent Computational Thinking test (cCTt) could evaluate learning reliably from grades 3 to 6 (ages 7-11)
The findings indicate that the cCTt is valid, reliable and gender-fair for grades 3-6, although more complex items would be beneficial for grades 5-6.
arXiv Detail & Related papers (2023-05-31T03:29:04Z) - Quiz-based Knowledge Tracing [61.9152637457605]
Knowledge tracing aims to assess individuals' evolving knowledge states according to their learning interactions.
QKT achieves state-of-the-art performance compared to existing methods.
arXiv Detail & Related papers (2023-04-05T12:48:42Z) - The competent Computational Thinking test (cCTt): Development and
validation of an unplugged Computational Thinking test for upper primary
school [0.8367620276482053]
The competent CT test (cCTt) is an unplugged CT test targeting 7-9 year-old students.
The expert evaluation indicates that the cCTt shows good face, construct, and content validity.
The psychometric analysis of the student data demonstrates adequate reliability, difficulty, and discriminability.
arXiv Detail & Related papers (2022-03-11T15:05:35Z) - Transfer Learning in Electronic Health Records through Clinical Concept
Embedding [0.0]
We aim to train some of the most prominent disease embedding techniques on a comprehensive EHR data from 3.1 million patients.
This study can be the first comprehensive approach for clinical concept embedding evaluation.
arXiv Detail & Related papers (2021-07-27T16:22:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.