"She was useful, but a bit too optimistic": Augmenting Design with Interactive Virtual Personas

• URL: http://arxiv.org/abs/2508.19463v2
• Date: Fri, 26 Sep 2025 00:50:33 GMT
• Title: "She was useful, but a bit too optimistic": Augmenting Design with Interactive Virtual Personas
• Authors: Paluck Deep, Monica Bharadhidasan, A. Baki Kocaballi,
• Abstract summary: This paper introduces Interactive Virtual Personas (IVPs): multimodal, conversational user simulations that designers can interview, brainstorm with, and gather feedback from in real time via voice interface.<n>Our findings demonstrate the potential of IVPs to expedite information gathering, inspire design solutions, and provide rapid user-like feedback.<n>Designers raised concerns about biases, over-optimism, the challenge of ensuring authenticity without real stakeholder input, and the inability of the IVP to fully replicate the nuances of human interaction.
• Score: 0.6117371161379209
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Personas have been widely used to understand and communicate user needs in human-centred design. Despite their utility, they may fail to meet the demands of iterative workflows due to their static nature, limited engagement, and inability to adapt to evolving design needs. Recent advances in large language models (LLMs) pave the way for more engaging and adaptive approaches to user representation. This paper introduces Interactive Virtual Personas (IVPs): multimodal, LLM-driven, conversational user simulations that designers can interview, brainstorm with, and gather feedback from in real time via voice interface. We conducted a qualitative study with eight professional UX designers, employing an IVP named "Alice" across three design activities: user research, ideation, and prototype evaluation. Our findings demonstrate the potential of IVPs to expedite information gathering, inspire design solutions, and provide rapid user-like feedback. However, designers raised concerns about biases, over-optimism, the challenge of ensuring authenticity without real stakeholder input, and the inability of the IVP to fully replicate the nuances of human interaction. Our participants emphasised that IVPs should be viewed as a complement to, not a replacement for, real user engagement. We discuss strategies for prompt engineering, human-in-the-loop integration, and ethical considerations for effective and responsible IVP use in design. Finally, our work contributes to the growing body of research on generative AI in the design process by providing insights into UX designers' experiences of LLM-powered interactive personas.

Related papers

• Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMs [25.55641344754412]
  Personagram is an interactive system powered by multimodal large language models (MLLMs)<n>It helps designers explore detailed census-based personas, extract product features inferred from persona attributes, and recombine them for specific customer segments.<n>In a study with 12 professional designers, we show that Personagram facilitates more actionable ideation by structuring multimodal thinking from persona attributes to product design features.
  arXiv  Detail & Related papers  (2026-02-05T21:14:33Z)
• Training Proactive and Personalized LLM Agents [107.57805582180315]
  We introduce PPP, a multi-objective reinforcement learning approach that jointly optimize all three dimensions: Productivity, Proactivity, and Personalization.<n>Experiments show that agents trained with PPP achieve substantial improvements over strong baselines such as GPT-5 (+21.6 on average)<n>This work demonstrates that explicitly optimizing for user-centered interaction is critical for building practical and effective AI agents.
  arXiv  Detail & Related papers  (2025-11-04T02:59:36Z)
• StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagation [13.425907817210184]
  Design processes involve exploration, iteration, and movement across interconnected stages such as persona creation, problem framing, solution ideation, and prototyping.<n>To better understand these challenges, we conducted a formative study with 15 participants-comprised of UX practitioners, students, and instructors.<n>Based on the findings, we developed StoryEnsemble, a tool that integrates AI into a node-link interface and leverages forward and backward propagation to support dynamic exploration and iteration across the design process.
  arXiv  Detail & Related papers  (2025-08-05T07:47:23Z)
• Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent [56.61028117645315]
  We propose a novel thought-augmented interactive recommender agent system (TAIRA) that addresses complex user intents through distilled thought patterns.<n>Specifically, TAIRA is designed as an LLM-powered multi-agent system featuring a manager agent that orchestrates recommendation tasks by decomposing user needs and planning subtasks.<n>Through comprehensive experiments conducted across multiple datasets, TAIRA exhibits significantly enhanced performance compared to existing methods.
  arXiv  Detail & Related papers  (2025-06-30T03:15:50Z)
• FeedQUAC: Quick Unobtrusive AI-Generated Commentary [8.057486493973304]
  We introduce FeedQUAC, a design companion that delivers real-time AI-generated commentary from a variety of perspectives.<n>We discuss the role of AI feedback, its strengths and limitations, and how to integrate it into existing design.<n>Our findings suggest that ambient interaction is a valuable consideration for both the design and evaluation of future creativity support systems.
  arXiv  Detail & Related papers  (2025-04-23T04:48:00Z)
• Survey of User Interface Design and Interaction Techniques in Generative AI Applications [79.55963742878684]
  We aim to create a compendium of different user-interaction patterns that can be used as a reference for designers and developers alike. We also strive to lower the entry barrier for those attempting to learn more about the design of generative AI applications.
  arXiv  Detail & Related papers  (2024-10-28T23:10:06Z)
• Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping [55.98643055756135]
  We introduce Sketch2Code, a benchmark that evaluates state-of-the-art Vision Language Models (VLMs) on automating the conversion of rudimentary sketches into webpage prototypes. We analyze ten commercial and open-source models, showing that Sketch2Code is challenging for existing VLMs. A user study with UI/UX experts reveals a significant preference for proactive question-asking over passive feedback reception.
  arXiv  Detail & Related papers  (2024-10-21T17:39:49Z)
• Constraining Participation: Affordances of Feedback Features in Interfaces to Large Language Models [49.74265453289855]
  Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces. This paper examines the affordances of interactive feedback features in ChatGPT's interface, analysing how they shape user input and participation in iteration.
  arXiv  Detail & Related papers  (2024-08-27T13:50:37Z)
• I-Design: Personalized LLM Interior Designer [57.00412237555167]
  I-Design is a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database.
  arXiv  Detail & Related papers  (2024-04-03T16:17:53Z)
• Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience [42.73738624139124]
  Designers face hurdles understanding AI technologies, such as pre-trained language models, as design materials. This limits their ability to ideate and make decisions about whether, where, and how to use AI. Our study highlights the pivotal role that UX designers can play in Responsible AI.
  arXiv  Detail & Related papers  (2023-02-21T02:06:24Z)
• Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques [55.492211642128446]
  Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives. Model-based computational design algorithms assist designers by generating design examples during design. Black box methods for assistance, on the other hand, can work with any design problem.
  arXiv  Detail & Related papers  (2022-04-15T20:40:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.