Measuring Computational Thinking Self-Efficacy (CT-SEI): Instrument development and preliminary evaluation
- URL: http://arxiv.org/abs/2607.17704v1
- Date: Mon, 20 Jul 2026 08:50:51 GMT
- Title: Measuring Computational Thinking Self-Efficacy (CT-SEI): Instrument development and preliminary evaluation
- Abstract summary: We created an instrument to measure self-efficacy of students in higher education for Computational Thinking skills.<n>Data was collected from 270 students in higher education recruited both through Prolific and a university setting in Costa Rica.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Much effort is put into helping students at different educational levels develop Computational Thinking (CT) skills. Self-efficacy is important for skill development. It can predict perseverance, engagement and success on educational tasks. We created an instrument to measure self-efficacy of students in higher education for the CT skills abstraction, algorithmic thinking, decomposition, evaluation and generalization. First, 91 candidate items were created by including, adapting and extending items found in the literature. These items were evaluated by experts in the field of CT and education. 54 items remained and to reduce the number of items further, data was collected from 270 students in higher education recruited both through Prolific and a university setting in Costa Rica. Through principle component analysis (PCA) using a subset of 200 responses, the number of items was reduced to 27. Confirmatory factor analysis (CFA) using the remaining responses in the dataset showed the items can be divided into two categories: (1) creating the solution and (2) evaluating the solution. The created instrument can be valuable when assessing CT self-efficacy of students in higher education. With additional validation (e.g. examination of test-retest validity), we believe the scale could be used to evaluate the effectiveness of interventions, or decide what interventions should be provided to foster CT skill development.
Related papers
- Computational Thinking Development in AI Agent Creation_A Mixed-Methods Study [7.73047406525975]
This study examined computational thinking development among 93 pre-high school students in a five-day AI agent creation workshop using CocoFlow.<n>Results revealed significant improvements in abstract thinking and algorithmic thinking.<n>Students with moderate initial CT levels demonstrated substantially greater gains than both high-CT and low-CT peers.
arXiv Detail & Related papers (2026-05-14T03:48:08Z) - TRACE: Trajectory-Aware Comprehensive Evaluation for Deep Research Agents [51.30998248590416]
Trajectory-Aware Comprehensive Evaluation (TRACE) is a framework that holistically assesses the entire problem-solving trajectory.<n>Our contributions include the TRACE framework, its novel metrics, and the accompanying DeepResearch-Bench with controllable complexity.
arXiv Detail & Related papers (2026-02-05T13:28:57Z) - Pilot Study on Generative AI and Critical Thinking in Higher Education Classrooms [0.0]
Generative AI (GAI) tools have seen rapid adoption in educational settings, yet their role in fostering critical thinking remains underexplored.<n>This pilot study investigates students' ability to apply structured critical thinking when assessing Generative AI outputs in introductory Computational and Data Science courses.
arXiv Detail & Related papers (2025-08-29T18:07:11Z) - Development of the Measure of Assessment Self-Efficacy (MASE) for Quizzes and Exams [0.0]
Measures of assessment-related self-efficacy concentrate on students' beliefs about content-specific tasks but omit beliefs around assessment-taking.<n>This research aimed to develop and test the Measure of Assessment Self-Efficacy (MASE), designed to assess two types of efficacy beliefs related to assessment.
arXiv Detail & Related papers (2025-08-26T03:17:08Z) - Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications [59.721265428780946]
Large Language Models (LLMs) in medicine have enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning.<n>This paper provides the first systematic review of this emerging field.<n>We propose a taxonomy of reasoning enhancement techniques, categorized into training-time strategies and test-time mechanisms.
arXiv Detail & Related papers (2025-08-01T14:41:31Z) - STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond [68.47402386668846]
We introduce Structured Reasoning In Critical Text Assessment (STRICTA) to model text assessment as an explicit, step-wise reasoning process.<n>STRICTA breaks down the assessment into a graph of interconnected reasoning steps drawing on causality theory.<n>We apply STRICTA to a dataset of over 4000 reasoning steps from roughly 40 biomedical experts on more than 20 papers.
arXiv Detail & Related papers (2024-09-09T06:55:37Z) - Evaluating and Optimizing Educational Content with Large Language Model Judgments [52.33701672559594]
We use Language Models (LMs) as educational experts to assess the impact of various instructions on learning outcomes.
We introduce an instruction optimization approach in which one LM generates instructional materials using the judgments of another LM as a reward function.
Human teachers' evaluations of these LM-generated worksheets show a significant alignment between the LM judgments and human teacher preferences.
arXiv Detail & Related papers (2024-03-05T09:09:15Z) - Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline
Algorithm: Application to the ICU Length of Stay Prediction [65.268245109828]
This paper uses the MIMIC-IV dataset to examine the fairness and bias in an XGBoost binary classification model predicting the ICU length of stay.
The research reveals class imbalances in the dataset across demographic attributes and employs data preprocessing and feature extraction.
The paper concludes with recommendations for fairness-aware machine learning techniques for mitigating biases and the need for collaborative efforts among healthcare professionals and data scientists.
arXiv Detail & Related papers (2023-12-31T16:01:48Z) - The competent Computational Thinking test (cCTt): a valid, reliable and gender-fair test for longitudinal CT studies in grades 3-6 [0.06282171844772422]
This study investigated whether the competent Computational Thinking test (cCTt) could evaluate learning reliably from grades 3 to 6 (ages 7-11) using data from 2709 students.
The findings indicate that the cCTt is valid, reliable and gender-fair for grades 3-6, although more complex items would be beneficial for grades 5-6.
arXiv Detail & Related papers (2023-05-31T03:29:04Z) - The competent Computational Thinking test (cCTt): Development and
validation of an unplugged Computational Thinking test for upper primary
school [0.8367620276482053]
The competent CT test (cCTt) is an unplugged CT test targeting 7-9 year-old students.
The expert evaluation indicates that the cCTt shows good face, construct, and content validity.
The psychometric analysis of the student data demonstrates adequate reliability, difficulty, and discriminability.
arXiv Detail & Related papers (2022-03-11T15:05:35Z) - Interpretable Off-Policy Evaluation in Reinforcement Learning by
Highlighting Influential Transitions [48.91284724066349]
Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education.
Traditional measures such as confidence intervals may be insufficient due to noise, limited data and confounding.
We develop a method that could serve as a hybrid human-AI system, to enable human experts to analyze the validity of policy evaluation estimates.
arXiv Detail & Related papers (2020-02-10T00:26:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.