Content-Centric Prototyping of Generative AI Applications: Emerging
Approaches and Challenges in Collaborative Software Teams
- URL: http://arxiv.org/abs/2402.17721v1
- Date: Tue, 27 Feb 2024 17:56:10 GMT
- Title: Content-Centric Prototyping of Generative AI Applications: Emerging
Approaches and Challenges in Collaborative Software Teams
- Authors: Hari Subramonyam, Divy Thakkar, J\"urgen Dieber, Anoop Sinha
- Abstract summary: Our work aims to understand how collaborative software teams set up and apply design guidelines and values, iteratively prototype prompts, and evaluate prompts to achieve desired outcomes.
Our findings reveal a content-centric prototyping approach in which teams begin with the content they want to generate, then identify specific attributes, constraints, and values, and explore methods to give users the ability to influence and interact with those attributes.
- Score: 2.369736515233951
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Generative AI models are increasingly powering software applications,
offering the capability to produce expressive content across varied contexts.
However, unlike previous iterations of human-AI design, the emerging design
process for generative capabilities primarily hinges on prompt engineering
strategies. Given this fundamental shift in approach, our work aims to
understand how collaborative software teams set up and apply design guidelines
and values, iteratively prototype prompts, and evaluate prompts to achieve
desired outcomes. We conducted design studies with 39 industry professionals,
including designers, software engineers, and product managers. Our findings
reveal a content-centric prototyping approach in which teams begin with the
content they want to generate, then identify specific attributes, constraints,
and values, and explore methods to give users the ability to influence and
interact with those attributes. Based on associated challenges, such as the
lack of model interpretability and overfitting the design to examples, we
outline considerations for generative AI prototyping.
Related papers
- MetaDesigner: Advancing Artistic Typography through AI-Driven, User-Centric, and Multilingual WordArt Synthesis [65.78359025027457]
MetaDesigner revolutionizes artistic typography by leveraging the strengths of Large Language Models (LLMs) to drive a design paradigm centered around user engagement.
A comprehensive feedback mechanism harnesses insights from multimodal models and user evaluations to refine and enhance the design process iteratively.
Empirical validations highlight MetaDesigner's capability to effectively serve diverse WordArt applications, consistently producing aesthetically appealing and context-sensitive results.
arXiv Detail & Related papers (2024-06-28T11:58:26Z) - A Survey on Personalized Content Synthesis with Diffusion Models [57.01364199734464]
PCS aims to customize the subject of interest to specific user-defined prompts.
Over the past two years, more than 150 methods have been proposed.
This paper offers a comprehensive survey of PCS, with a particular focus on the diffusion models.
arXiv Detail & Related papers (2024-05-09T04:36:04Z) - Geometric Deep Learning for Computer-Aided Design: A Survey [85.79012726689511]
This survey offers a comprehensive overview of learning-based methods in computer-aided design.
It includes similarity analysis and retrieval, 2D and 3D CAD model synthesis, and CAD generation from point clouds.
It provides a complete list of benchmark datasets and their characteristics, along with open-source codes that have propelled research in this domain.
arXiv Detail & Related papers (2024-02-27T17:11:35Z) - Design Principles for Generative AI Applications [22.587972924039992]
Generative AI applications present unique design challenges.
There is an urgent need for guidance on how to design user experiences that foster effective and safe use.
We present six principles for the design of generative AI applications.
arXiv Detail & Related papers (2024-01-25T19:38:21Z) - DesignGPT: Multi-Agent Collaboration in Design [4.6272626111555955]
DesignGPT uses artificial intelligence agents to simulate the roles of different positions in the design company and allows human designers to collaborate with them in natural language.
Experimental results show that compared with separate AI tools, DesignGPT improves the performance of designers.
arXiv Detail & Related papers (2023-11-20T08:05:52Z) - Augmenting Character Designers Creativity Using Generative Adversarial
Networks [0.0]
Generative Adversarial Networks (GANs) continue to attract the attention of researchers in different fields.
Most recent GANs are focused on realism, however, generating hyper-realistic output is not a priority for some domains.
We present a comparison between different GAN architectures and their performance when trained from scratch on a new visual characters dataset.
We also explore alternative techniques, such as transfer learning and data augmentation, to overcome computational resource limitations.
arXiv Detail & Related papers (2023-05-28T10:52:03Z) - A Comprehensive Survey of AI-Generated Content (AIGC): A History of
Generative AI from GAN to ChatGPT [63.58711128819828]
ChatGPT and other Generative AI (GAI) techniques belong to the category of Artificial Intelligence Generated Content (AIGC)
The goal of AIGC is to make the content creation process more efficient and accessible, allowing for the production of high-quality content at a faster pace.
arXiv Detail & Related papers (2023-03-07T20:36:13Z) - fAIlureNotes: Supporting Designers in Understanding the Limits of AI
Models for Computer Vision Tasks [32.53515595703429]
fAIlureNotes is a designer-centered failure exploration and analysis tool.
It supports designers in evaluating models and identifying failures across diverse user groups and scenarios.
arXiv Detail & Related papers (2023-02-22T23:41:36Z) - Design Space Exploration and Explanation via Conditional Variational
Autoencoders in Meta-model-based Conceptual Design of Pedestrian Bridges [52.77024349608834]
This paper provides a performance-driven design exploration framework to augment the human designer through a Conditional Variational Autoencoder (CVAE)
The CVAE is trained on 18'000 synthetically generated instances of a pedestrian bridge in Switzerland.
arXiv Detail & Related papers (2022-11-29T17:28:31Z) - Investigating Positive and Negative Qualities of Human-in-the-Loop
Optimization for Designing Interaction Techniques [55.492211642128446]
Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives.
Model-based computational design algorithms assist designers by generating design examples during design.
Black box methods for assistance, on the other hand, can work with any design problem.
arXiv Detail & Related papers (2022-04-15T20:40:43Z) - Towards A Process Model for Co-Creating AI Experiences [16.767362787750418]
Thinking of technology as a design material is appealing to designers.
As a material, AI resists this approach because its properties emerge as part of the design process itself.
We investigate the co-creation process through a design study with 10 pairs of designers and engineers.
arXiv Detail & Related papers (2021-04-15T16:53:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.