The System Model and the User Model: Exploring AI Dashboard Design

• URL: http://arxiv.org/abs/2305.02469v1
• Date: Thu, 4 May 2023 00:22:49 GMT
• Title: The System Model and the User Model: Exploring AI Dashboard Design
• Authors: Fernanda Vi\'egas and Martin Wattenberg
• Abstract summary: We argue that sophisticated AI systems should have dashboards, just like all other complicated devices. We conjecture that, for many systems, the two most important models will be of the user and of the system itself. Finding ways to identify, interpret, and display these two models should be a core part of interface research for AI.
• Score: 79.81291473899591
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This is a speculative essay on interface design and artificial intelligence. Recently there has been a surge of attention to chatbots based on large language models, including widely reported unsavory interactions. We contend that part of the problem is that text is not all you need: sophisticated AI systems should have dashboards, just like all other complicated devices. Assuming the hypothesis that AI systems based on neural networks will contain interpretable models of aspects of the world around them, we discuss what data such dashboards might display. We conjecture that, for many systems, the two most important models will be of the user and of the system itself. We call these the System Model and User Model. We argue that, for usability and safety, interfaces to dialogue-based AI systems should have a parallel display based on the state of the System Model and the User Model. Finding ways to identify, interpret, and display these two models should be a core part of interface research for AI.

Related papers

• The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems [0.0]
  There still exists a gap between principles and practices in AI ethics. One major obstacle organisations face when attempting to operationalise AI Ethics is the lack of a well-defined material scope.
  arXiv  Detail & Related papers  (2024-07-07T12:16:01Z)
• Generative AI Systems: A Systems-based Perspective on Generative AI [12.400966570867322]
  Large Language Models (LLMs) have revolutionized AI systems by enabling communication with machines using natural language. Recent developments in Generative AI (GenAI) have shown great promise in using LLMs as multimodal systems. This paper aims to explore and state new research directions in Generative AI Systems.
  arXiv  Detail & Related papers  (2024-06-25T12:51:47Z)
• LVLM-Interpret: An Interpretability Tool for Large Vision-Language Models [50.259006481656094]
  We present a novel interactive application aimed towards understanding the internal mechanisms of large vision-language models. Our interface is designed to enhance the interpretability of the image patches, which are instrumental in generating an answer. We present a case study of how our application can aid in understanding failure mechanisms in a popular large multi-modal model: LLaVA.
  arXiv  Detail & Related papers  (2024-04-03T23:57:34Z)
• Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents [111.15288256221764]
  Grounded-decoding project aims to solve complex, long-horizon tasks in a robotic setting by leveraging the knowledge of both models. We frame this as a problem similar to probabilistic filtering: decode a sequence that both has high probability under the language model and high probability under a set of grounded model objectives. We demonstrate how such grounded models can be obtained across three simulation and real-world domains, and that the proposed decoding strategy is able to solve complex, long-horizon tasks in a robotic setting by leveraging the knowledge of both models.
  arXiv  Detail & Related papers  (2023-03-01T22:58:50Z)
• GenNI: Human-AI Collaboration for Data-Backed Text Generation [102.08127062293111]
  Table2Text systems generate textual output based on structured data utilizing machine learning. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text.
  arXiv  Detail & Related papers  (2021-10-19T18:07:07Z)
• The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identity [41.43519695929595]
  We aim to understand how system designers might allow their systems to confirm its non-human identity. We collect over 2,500 phrasings related to the intent of Are you a robot?" We compare classifiers to recognize the intent and discuss the precision/recall and model complexity tradeoffs.
  arXiv  Detail & Related papers  (2021-06-04T20:04:33Z)
• Scholarly AI system diagrams as an access point to mental models [6.233820957059352]
  Complex systems, such as Artificial Intelligence (AI) systems, are comprised of many interrelated components. In order to represent these systems, demonstrating the relations between components is essential. Diagrams, as "icons of relation", are a prevalent medium for signifying complex systems.
  arXiv  Detail & Related papers  (2021-04-30T07:55:18Z)
• The Adapter-Bot: All-In-One Controllable Conversational Model [66.48164003532484]
  We propose a dialogue model that uses a fixed backbone model such as DialGPT and triggers on-demand dialogue skills via different adapters. Depending on the skills, the model is able to process multiple knowledge types, such as text, tables, and emphatic responses. We evaluate our model using automatic evaluation by comparing it with existing state-of-the-art conversational models.
  arXiv  Detail & Related papers  (2020-08-28T10:59:31Z)
• Machine Common Sense [77.34726150561087]
  Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI) This article deals with the aspects of modeling commonsense reasoning focusing on such domain as interpersonal interactions.
  arXiv  Detail & Related papers  (2020-06-15T13:59:47Z)
• What Would You Ask the Machine Learning Model? Identification of User Needs for Model Explanations Based on Human-Model Conversations [5.802346990263708]
  This study is the first to use a conversational system to collect the needs of human operators from the interactive and iterative dialogue explorations of a predictive model. We developed dr_ant to talk about machine learning model trained to predict survival odds on Titanic. Having collected a corpus of 1000+ dialogues, we analyse the most common types of questions that users would like to ask.
  arXiv  Detail & Related papers  (2020-02-07T15:59:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.