Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems

• URL: http://arxiv.org/abs/2204.07666v1
• Date: Fri, 15 Apr 2022 22:35:23 GMT
• Title: Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems
• Authors: Jeba Rezwana and Mary Lou Maher
• Abstract summary: There is relatively little research about interaction design in the co-creativity field. The primary focus of co-creativity research has been on the abilities of the AI. This paper focuses on the importance of interaction design in co-creative systems with the development of the Co-Creative Framework for Interaction design (COFI)
• Score: 0.7614628596146599
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Human-AI co-creativity involves both humans and AI collaborating on a shared creative product as partners. In a creative collaboration, interaction dynamics, such as turn-taking, contribution type, and communication, are the driving forces of the co-creative process. Therefore the interaction model is a critical and essential component for effective co-creative systems. There is relatively little research about interaction design in the co-creativity field, which is reflected in a lack of focus on interaction design in many existing co-creative systems. The primary focus of co-creativity research has been on the abilities of the AI. This paper focuses on the importance of interaction design in co-creative systems with the development of the Co-Creative Framework for Interaction design (COFI) that describes the broad scope of possibilities for interaction design in co-creative systems. Researchers can use COFI for modeling interaction in co-creative systems by exploring alternatives in this design space of interaction. COFI can also be beneficial while investigating and interpreting the interaction design of existing co-creative systems. We coded a dataset of existing 92 co-creative systems using COFI and analyzed the data to show how COFI provides a basis to categorize the interaction models of existing co-creative systems. We identify opportunities to shift the focus of interaction models in co-creativity to enable more communication between the user and AI leading to human-AI partnerships.

Related papers

• Scaling Large-Language-Model-based Multi-Agent Collaboration [75.5241464256688]
  Pioneering advancements in large language model-powered agents have underscored the design pattern of multi-agent collaboration. Inspired by the neural scaling law, this study investigates whether a similar principle applies to increasing agents in multi-agent collaboration.
  arXiv  Detail & Related papers  (2024-06-11T11:02:04Z)
• AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents [65.16893197330589]
  Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored. We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
  arXiv  Detail & Related papers  (2024-01-12T11:18:00Z)
• Unpacking Human-AI interactions: From interaction primitives to a design space [6.778055454461106]
  We show how these primitives can be combined into a set of interaction patterns. The motivation behind this is to provide a compact generalisation of existing practices. We discuss how this approach can be used towards a design space for Human-AI interactions.
  arXiv  Detail & Related papers  (2024-01-10T12:27:18Z)
• Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models [59.611697856666304]
  Human-object interaction (HOI) detection aims at detecting human-object pairs and predicting their interactions. We propose three prompts with VLM to generate human-centric visual cues within an image from multiple perspectives of humans. We develop a transformer-based multimodal fusion module with multitower architecture to integrate visual cue features into the instance and interaction decoders.
  arXiv  Detail & Related papers  (2023-11-26T09:11:32Z)
• Detecting and Optimising Team Interactions in Software Development [58.720142291102135]
  This paper presents a data-driven approach to detect the functional interaction structure for software development teams. Our approach considers differences in the activity levels of team members and uses a block-constrained configuration model. We show how our approach enables teams to compare their functional interaction structure against synthetically created benchmark scenarios.
  arXiv  Detail & Related papers  (2023-02-28T14:53:29Z)
• Team Learning as a Lens for Designing Human-AI Co-Creative Systems [12.24664973838839]
  Generative, ML-driven interactive systems have the potential to change how people interact with computers in creative processes. It is still unclear how we might achieve effective human-AI collaboration in open-ended task domains.
  arXiv  Detail & Related papers  (2022-07-06T22:11:13Z)
• Explainable Computational Creativity [7.258014999708837]
  Human collaboration with systems within the Computational Creativity (CC) field is often restricted to shallow interactions. We propose a set of design principles for CC systems that aim at supporting greater co-creation and collaboration with their human collaborators.
  arXiv  Detail & Related papers  (2022-05-11T05:05:37Z)
• Understanding User Perceptions, Collaborative Experience and User Engagement in Different Human-AI Interaction Designs for Co-Creative Systems [0.7614628596146599]
  Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In many existing co-creative systems users can communicate with the AI, usually using buttons or sliders. This paper presents a study with 38 participants to explore the impact of two interaction designs on user engagement, collaborative experience and user perception of a co-creative AI.
  arXiv  Detail & Related papers  (2022-04-27T22:37:44Z)
• Identifying Ethical Issues in AI Partners in Human-AI Co-Creation [0.7614628596146599]
  Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In many existing co-creative systems, users communicate with the AI using buttons or sliders. This paper explores the impact of AI-to-human communication on user perception and engagement in co-creative systems.
  arXiv  Detail & Related papers  (2022-04-15T20:41:54Z)
• A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systems [81.0723729946659]
  The focus of this work is clearly on synchronised collaboration from a distance. A total of 82 unique systems for remote collaboration are discussed, including more than 100 publications and 25 commercial systems.
  arXiv  Detail & Related papers  (2021-02-11T13:33:51Z)
• Cascaded Human-Object Interaction Recognition [175.60439054047043]
  We introduce a cascade architecture for a multi-stage, coarse-to-fine HOI understanding. At each stage, an instance localization network progressively refines HOI proposals and feeds them into an interaction recognition network. With our carefully-designed human-centric relation features, these two modules work collaboratively towards effective interaction understanding.
  arXiv  Detail & Related papers  (2020-03-09T17:05:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.