ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming
Learning for Children Aged 6-12
- URL: http://arxiv.org/abs/2402.04975v1
- Date: Wed, 7 Feb 2024 15:55:51 GMT
- Title: ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming
Learning for Children Aged 6-12
- Authors: Liuqing Chen, Shuhong Xiao, Yunnong Chen, Ruoyu Wu, Yaxuan Song,
Lingyun Sun
- Abstract summary: ChatScratch is an AI-augmented system to facilitate autonomous programming learning for young children.
ChatScratch employs structured interactive storyboards and visual cues to overcome artist's block.
- Score: 13.943361631775113
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: As Computational Thinking (CT) continues to permeate younger age groups in
K-12 education, established CT platforms such as Scratch face challenges in
catering to these younger learners, particularly those in the elementary school
(ages 6-12). Through formative investigation with Scratch experts, we uncover
three key obstacles to children's autonomous Scratch learning: artist's block
in project planning, bounded creativity in asset creation, and inadequate
coding guidance during implementation. To address these barriers, we introduce
ChatScratch, an AI-augmented system to facilitate autonomous programming
learning for young children. ChatScratch employs structured interactive
storyboards and visual cues to overcome artist's block, integrates digital
drawing and advanced image generation technologies to elevate creativity, and
leverages Scratch-specialized Large Language Models (LLMs) for professional
coding guidance. Our study shows that, compared to Scratch, ChatScratch
efficiently fosters autonomous programming learning, and contributes to the
creation of high-quality, personally meaningful Scratch projects for children.
Related papers
- Scratch Copilot: Supporting Youth Creative Coding with AI [7.494510764739512]
We present Cognimates Scratch Copilot: an AI-powered assistant integrated into a Scratch-like environment.<n>This paper details the system architecture and findings from an exploratory qualitative evaluation with 18 international children.
arXiv Detail & Related papers (2025-05-06T17:13:29Z) - Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration [64.6107798750142]
Vocal Sandbox is a framework for enabling seamless human-robot collaboration in situated environments.
We design lightweight and interpretable learning algorithms that allow users to build an understanding and co-adapt to a robot's capabilities in real-time.
We evaluate Vocal Sandbox in two settings: collaborative gift bag assembly and LEGO stop-motion animation.
arXiv Detail & Related papers (2024-11-04T20:44:40Z) - A Problem-Based Learning Approach to Teaching Design in CS1 [0.9786690381850356]
Design skills are increasingly recognized as a core competency for software professionals.
New designers require a structured process to keep them from being overwhelmed by possibilities.
We present our experience teaching a team design project course to 200 first-year-university students.
arXiv Detail & Related papers (2024-10-15T23:36:08Z) - Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads [74.54183505245553]
A systematic analysis of AI capabilities for joint vision and text reasoning is missing in the current scientific literature.
We evaluate state-of-the-art LVLMs on their mathematical and algorithmic reasoning abilities using visuo-linguistic problems from children's Olympiads.
Our results show that modern LVLMs do demonstrate increasingly powerful reasoning skills in solving problems for higher grades, but lack the foundations to correctly answer problems designed for younger children.
arXiv Detail & Related papers (2024-06-22T05:04:39Z) - From Keyboard to Chatbot: An AI-powered Integration Platform with Large-Language Models for Teaching Computational Thinking for Young Children [22.933382649048113]
We present a novel methodology with an AI-powered integration platform to effectively teach computational thinking for young children.
Young children can describe their desired task in natural language, while the system can respond with an easy-to-understand program.
A tangible robot can immediately execute the decomposed program and demonstrate the program's outcomes to young children.
arXiv Detail & Related papers (2024-05-01T04:29:21Z) - Examining the Values Reflected by Children during AI Problem Formulation [9.516294164912072]
We find that children's proposed ideas require advanced system intelligence and understanding the social relationships of a user.
Children's ideas showed they cared about family and expected machines to understand their social context before making decisions.
arXiv Detail & Related papers (2023-09-27T17:58:30Z) - AI Friends: A Design Framework for AI-Powered Creative Programming for
Youth [7.699345459748752]
We designed a 3 week series of programming activities with ten children, 7 to 12 years old, and nine parents.
Using a creative self efficacy lens, we observe that families found it easier to generate game ideas when prompted with questions by AI Friend.
Parents played a unique role in guiding children in more complex programming tasks when the AI Friend failed to help.
arXiv Detail & Related papers (2023-05-17T17:48:32Z) - Self-Supervised 3D Action Representation Learning with Skeleton Cloud
Colorization [75.0912240667375]
3D Skeleton-based human action recognition has attracted increasing attention in recent years.
Most of the existing work focuses on supervised learning which requires a large number of labeled action sequences.
In this paper, we address self-supervised 3D action representation learning for skeleton-based action recognition.
arXiv Detail & Related papers (2023-04-18T08:03:26Z) - StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child
Interactive Storytelling with Flexible Parental Involvement [61.47157418485633]
We developed StoryBuddy, an AI-enabled system for parents to create interactive storytelling experiences.
A user study validated StoryBuddy's usability and suggested design insights for future parent-AI collaboration systems.
arXiv Detail & Related papers (2022-02-13T04:53:28Z) - Introducing Variational Autoencoders to High School Students [12.341543369402217]
This paper describes the lesson design and shares insights from the pilot studies with 22 students.
We developed a web-based game and used Plato's cave, a philosophical metaphor, to introduce how VAEs work.
We found that our approach was effective in teaching students about a novel AI concept.
arXiv Detail & Related papers (2021-11-13T04:34:15Z) - The MineRL BASALT Competition on Learning from Human Feedback [58.17897225617566]
The MineRL BASALT competition aims to spur forward research on this important class of techniques.
We design a suite of four tasks in Minecraft for which we expect it will be hard to write down hardcoded reward functions.
We provide a dataset of human demonstrations on each of the four tasks, as well as an imitation learning baseline.
arXiv Detail & Related papers (2021-07-05T12:18:17Z) - Learning-based pose edition for efficient and interactive design [55.41644538483948]
In computer-aided animation artists define the key poses of a character by manipulating its skeletons.
Character pose must respect many ill-defined constraints, and so the resulting realism greatly depends on the animator's skill and knowledge.
We describe an efficient tool for pose design, allowing users to intuitively manipulate a pose to create character animations.
arXiv Detail & Related papers (2021-07-01T12:15:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.