Project CLAI: Instrumenting the Command Line as a New Environment for AI
Agents
- URL: http://arxiv.org/abs/2002.00762v2
- Date: Wed, 17 Jun 2020 23:11:15 GMT
- Title: Project CLAI: Instrumenting the Command Line as a New Environment for AI
Agents
- Authors: Mayank Agarwal, Jorge J. Barroso, Tathagata Chakraborti, Eli M. Dow,
Kshitij Fadnis, Borja Godoy, Madhavan Pallan, Kartik Talamadupula
- Abstract summary: CLAI aims to bring the power of AI to the command line interface (CLI)
We discuss the design and implementation of the platform in detail, through illustrative use cases of new end user interaction patterns.
We report on some early user feedback on CLAI's features from an internal survey.
- Score: 12.310004080500082
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This whitepaper reports on Project CLAI (Command Line AI), which aims to
bring the power of AI to the command line interface (CLI). The CLAI platform
sets up the CLI as a new environment for AI researchers to conquer by surfacing
the command line as a generic environment that researchers can interface to
using a simple sense-act API, much like the traditional AI agent architecture.
In this paper, we discuss the design and implementation of the platform in
detail, through illustrative use cases of new end user interaction patterns
enabled by this design, and through quantitative evaluation of the system
footprint of a CLAI-enabled terminal. We also report on some early user
feedback on CLAI's features from an internal survey.
Related papers
- Large Language Models Meet User Interfaces: The Case of Provisioning Feedback [6.626949691937476]
We present a framework for incorporating GenAI into educational tools and demonstrate its application in our tool, Feedback Copilot.
This work charts a course for the future of GenAI in education.
arXiv Detail & Related papers (2024-04-17T05:05:05Z) - Farsight: Fostering Responsible AI Awareness During AI Application Prototyping [32.235398722593544]
We present Farsight, a novel in situ interactive tool that helps people identify potential harms from the AI applications they are prototyping.
Based on a user's prompt, Farsight highlights news articles about relevant AI incidents and allows users to explore and edit LLM-generated use cases, stakeholders, and harms.
We report design insights from a co-design study with 10 AI prototypers and findings from a user study with 42 AI prototypers.
arXiv Detail & Related papers (2024-02-23T14:38:05Z) - CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation [61.68049335444254]
Multimodal large language models (MLLMs) have shown remarkable potential as human-like autonomous language agents to interact with real-world environments.
We propose a Comprehensive Cognitive LLM Agent, CoCo-Agent, with two novel approaches, comprehensive environment perception (CEP) and conditional action prediction (CAP)
With our technical design, our agent achieves new state-of-the-art performance on AITW and META-GUI benchmarks, showing promising abilities in realistic scenarios.
arXiv Detail & Related papers (2024-02-19T08:29:03Z) - Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains [31.080896878139402]
We propose the concept of AI chain and introduce the best principles and practices that have been accumulated in software engineering for decades into AI chain engineering.
We also develop a no-code integrated development environment, Prompt Sapper, which embodies these AI chain engineering principles and patterns naturally in the process of building AI chains.
arXiv Detail & Related papers (2023-06-21T05:31:00Z) - AI-in-the-Loop -- The impact of HMI in AI-based Application [0.0]
We introduce the AI-in-the-loop concept that combines AI's and humans' strengths.
By enabling HMI during an AI uses inference, we will introduce the AI-in-the-loop concept that combines AI's and humans' strengths.
arXiv Detail & Related papers (2023-03-21T00:04:33Z) - Developing an AI-enabled IIoT platform -- Lessons learned from early use
case validation [47.37985501848305]
We introduce the design of this platform and discuss an early evaluation in terms of a demonstrator for AI-enabled visual quality inspection.
This is complemented by insights and lessons learned during this early evaluation activity.
arXiv Detail & Related papers (2022-07-10T18:51:12Z) - MONAI Label: A framework for AI-assisted Interactive Labeling of 3D
Medical Images [49.664220687980006]
The lack of annotated datasets is a major bottleneck for training new task-specific supervised machine learning models.
We present MONAI Label, a free and open-source framework that facilitates the development of applications based on artificial intelligence (AI) models.
arXiv Detail & Related papers (2022-03-23T12:33:11Z) - Composing Complex and Hybrid AI Solutions [52.00820391621739]
We describe an extension of the Acumos system towards enabling the above features for general AI applications.
Our extensions include support for more generic components with gRPC/Protobuf interfaces.
We provide examples of deployable solutions and their interfaces.
arXiv Detail & Related papers (2022-02-25T08:57:06Z) - Towards an Interface Description Template for AI-enabled Systems [77.34726150561087]
Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components.
There is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed.
We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component.
arXiv Detail & Related papers (2020-07-13T20:30:26Z) - Plato Dialogue System: A Flexible Conversational AI Research Platform [64.82999992143448]
Plato is a flexible Conversational AI platform written in Python that supports any kind of conversational agent architecture.
Plato has been designed to be easy to understand and debug and is agnostic to the underlying learning frameworks that train each component.
arXiv Detail & Related papers (2020-01-17T18:27:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.