Automatic Creativity Measurement in Scratch Programs Across Modalities

• URL: http://arxiv.org/abs/2211.05227v1
• Date: Mon, 7 Nov 2022 10:43:36 GMT
• Title: Automatic Creativity Measurement in Scratch Programs Across Modalities
• Authors: Anastasia Kovalkov and Benjamin Paa{\ss}en and Avi Segal and Niels Pinkwart and Kobi Gal
• Abstract summary: We make the journey fromdefining a formal measure of creativity that is efficientlycomputable to applying the measure in a practical domain. We adapted the general measure for projects in the popular visual programming language Scratch. We designed a machine learning model for predicting the creativity of Scratch projects, trained and evaluated on human expert creativity assessments.
• Score: 6.242018846706069
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Promoting creativity is considered an important goal of education, but creativity is notoriously hard to measure.In this paper, we make the journey fromdefining a formal measure of creativity that is efficientlycomputable to applying the measure in a practical domain. The measure is general and relies on coretheoretical concepts in creativity theory, namely fluency, flexibility, and originality, integratingwith prior cognitive science literature. We adapted the general measure for projects in the popular visual programming language Scratch.We designed a machine learning model for predicting the creativity of Scratch projects, trained and evaluated on human expert creativity assessments in an extensive user study. Our results show that opinions about creativity in Scratch varied widely across experts. The automatic creativity assessment aligned with the assessment of the human experts more than the experts agreed with each other. This is a first step in providing computational models for measuring creativity that can be applied to educational technologies, and to scale up the benefit of creativity education in schools.

Related papers

• A Framework for Collaborating a Large Language Model Tool in Brainstorming for Triggering Creative Thoughts [2.709166684084394]
  This study proposes a framework called GPS, which employs goals, prompts, and strategies to guide designers to systematically work with an LLM tool for improving the creativity of ideas generated during brainstorming. Our framework, tested through a design example and a case study, demonstrates its effectiveness in stimulating creativity and its seamless LLM tool integration into design practices.
  arXiv  Detail & Related papers  (2024-10-10T13:39:27Z)
• Good Idea or Not, Representation of LLM Could Tell [86.36317971482755]
  We focus on idea assessment, which aims to leverage the knowledge of large language models to assess the merit of scientific ideas. We release a benchmark dataset from nearly four thousand manuscript papers with full texts, meticulously designed to train and evaluate the performance of different approaches to this task. Our findings suggest that the representations of large language models hold more potential in quantifying the value of ideas than their generative outputs.
  arXiv  Detail & Related papers  (2024-09-07T02:07:22Z)
• Using a CNN Model to Assess Visual Artwork's Creativity [0.5926480964767554]
  We develop a CNN model to automatically assess the creativity of human paintings. Using a dataset of six hundred paintings by professionals and children, our model achieved 90% accuracy and faster evaluation times than human raters.
  arXiv  Detail & Related papers  (2024-08-02T17:57:32Z)
• An Artificial Intelligence Approach for Interpreting Creative Combinational Designs [1.3948357001626264]
  Combinational creativity is a form of creativity involving the blending of familiar ideas. This study focuses on the computational interpretation, specifically identifying the 'base' and 'additive' components that constitute a creative design.
  arXiv  Detail & Related papers  (2024-05-08T11:47:32Z)
• Can AI Be as Creative as Humans? [84.43873277557852]
  We prove in theory that AI can be as creative as humans under the condition that it can properly fit the data generated by human creators. The debate on AI's creativity is reduced into the question of its ability to fit a sufficient amount of data.
  arXiv  Detail & Related papers  (2024-01-03T08:49:12Z)
• Art or Artifice? Large Language Models and the False Promise of Creativity [53.04834589006685]
  We propose the Torrance Test of Creative Writing (TTCW) to evaluate creativity as a product. TTCW consists of 14 binary tests organized into the original dimensions of Fluency, Flexibility, Originality, and Elaboration. Our analysis shows that LLM-generated stories pass 3-10X less TTCW tests than stories written by professionals.
  arXiv  Detail & Related papers  (2023-09-25T22:02:46Z)
• Towards Creativity Characterization of Generative Models via Group-based Subset Scanning [64.6217849133164]
  We propose group-based subset scanning to identify, quantify, and characterize creative processes. We find that creative samples generate larger subsets of anomalies than normal or non-creative samples across datasets.
  arXiv  Detail & Related papers  (2022-03-01T15:07:14Z)
• DeepCreativity: Measuring Creativity with Deep Learning Techniques [2.5426469613007012]
  This paper explores the possibility of using generative learning techniques for automatic assessment of creativity. We introduce a new measure, namely DeepCreativity, based on Margaret Boden's definition of creativity as composed by value, novelty and surprise.
  arXiv  Detail & Related papers  (2022-01-16T19:00:01Z)
• Towards creativity characterization of generative models via group-based subset scanning [51.84144826134919]
  We propose group-based subset scanning to quantify, detect, and characterize creative processes. Creative samples generate larger subsets of anomalies than normal or non-creative samples across datasets.
  arXiv  Detail & Related papers  (2021-04-01T14:07:49Z)
• Creativity of Deep Learning: Conceptualization and Assessment [1.5738019181349994]
  We use insights from computational creativity to conceptualize and assess current applications of generative deep learning in creative domains. We highlight parallels between current systems and different models of human creativity as well as their shortcomings.
  arXiv  Detail & Related papers  (2020-12-03T21:44:07Z)
• Explaining Creative Artifacts [69.86890599471202]
  We develop an inverse problem formulation to deconstruct the products of and compositional creativity into associative chains. In particular, our formulation is structured as solving a traveling salesman problem through a knowledge graph of associative elements.
  arXiv  Detail & Related papers  (2020-10-14T14:32:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.