Signifiers as a First-class Abstraction in Hypermedia Multi-Agent
Systems
- URL: http://arxiv.org/abs/2302.06970v1
- Date: Tue, 14 Feb 2023 10:54:46 GMT
- Title: Signifiers as a First-class Abstraction in Hypermedia Multi-Agent
Systems
- Authors: Danai Vachtsevanou, Andrei Ciortea, Simon Mayer, J\'er\'emy Lem\'ee
- Abstract summary: We build on concepts and methods from Affordance Theory and Human-Computer Interaction to introduce signifiers as a first-class abstraction in Web-based Multi-Agent Systems.
We define a formal model for the contextual exposure of signifiers in hypermedia environments that aims to drive affordance exploitation.
- Score: 0.6595290783361959
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Hypermedia APIs enable the design of reusable hypermedia clients that
discover and exploit affordances on the Web. However, the reusability of such
clients remains limited since they cannot plan and reason about interaction.
This paper provides a conceptual bridge between hypermedia-driven affordance
exploitation on the Web and methods for representing and reasoning about
actions that have been extensively explored for Multi-Agent Systems (MAS) and,
more broadly, Artificial Intelligence. We build on concepts and methods from
Affordance Theory and Human-Computer Interaction that support interaction
efficiency in open and evolvable environments to introduce signifiers as a
first-class abstraction in Web-based MAS: Signifiers are designed with respect
to the agent-environment context of their usage and enable agents with
heterogeneous abilities to act and to reason about action. We define a formal
model for the contextual exposure of signifiers in hypermedia environments that
aims to drive affordance exploitation. We demonstrate our approach with a
prototypical Web-based MAS where two agents with different reasoning abilities
proactively discover how to interact with their environment by perceiving only
the signifiers that fit their abilities. We show that signifier exposure can be
inherently managed based on the dynamic agent-environment context towards
facilitating effective and efficient interactions on the Web.
Related papers
- Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence [79.5316642687565]
Existing multi-agent frameworks often struggle with integrating diverse capable third-party agents.
We propose the Internet of Agents (IoA), a novel framework that addresses these limitations.
IoA introduces an agent integration protocol, an instant-messaging-like architecture design, and dynamic mechanisms for agent teaming and conversation flow control.
arXiv Detail & Related papers (2024-07-09T17:33:24Z) - On the Multi-turn Instruction Following for Conversational Web Agents [83.51251174629084]
We introduce a new task of Conversational Web Navigation, which necessitates sophisticated interactions that span multiple turns with both the users and the environment.
We propose a novel framework, named self-reflective memory-augmented planning (Self-MAP), which employs memory utilization and self-reflection techniques.
arXiv Detail & Related papers (2024-02-23T02:18:12Z) - An Interactive Agent Foundation Model [49.77861810045509]
We propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents.
Our training paradigm unifies diverse pre-training strategies, including visual masked auto-encoders, language modeling, and next-action prediction.
We demonstrate the performance of our framework across three separate domains -- Robotics, Gaming AI, and Healthcare.
arXiv Detail & Related papers (2024-02-08T18:58:02Z) - Affordable Generative Agents [17.564711490225612]
We develop a framework for enabling the generation of believable and low-cost interactions on both agent-environment and inter-agents levels.
Extensive experiments on multiple environments show the effectiveness and efficiency of our proposed framework.
arXiv Detail & Related papers (2024-02-03T06:16:28Z) - Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
"Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data.
We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
arXiv Detail & Related papers (2024-01-07T19:11:18Z) - AgentCF: Collaborative Learning with Autonomous Language Agents for
Recommender Systems [112.76941157194544]
We propose AgentCF for simulating user-item interactions in recommender systems through agent-based collaborative filtering.
We creatively consider not only users but also items as agents, and develop a collaborative learning approach that optimize both kinds of agents together.
Overall, the optimized agents exhibit diverse interaction behaviors within our framework, including user-item, user-user, item-item, and collective interactions.
arXiv Detail & Related papers (2023-10-13T16:37:14Z) - Agent-Environment Network for Temporal Action Proposal Generation [10.74737201306622]
Temporal action proposal generation aims at localizing temporal intervals containing human actions in untrimmed videos.
Based on the action definition that a human, known as an agent, interacts with the environment and performs an action that affects the environment, we propose a contextual Agent-Environment Network.
Our proposed contextual AEN involves (i) agent pathway, operating at a local level to tell about which humans/agents are acting and (ii) environment pathway operating at a global level to tell about how the agents interact with the environment.
arXiv Detail & Related papers (2021-07-17T23:24:49Z) - Intelligent Software Web Agents: A Gap Analysis [0.0]
We examine the status quo in terms of intelligent software web agents, guided by research with respect to requirements and architectural components.
We propose a hybrid semantic web agent architecture, discuss the role played by existing semantic web standards, and point to existing work in the broader semantic web community any beyond that could help us to make the semantic web agent vision a reality.
arXiv Detail & Related papers (2021-02-12T16:32:02Z) - SPA: Verbal Interactions between Agents and Avatars in Shared Virtual
Environments using Propositional Planning [61.335252950832256]
Sense-Plan-Ask, or SPA, generates plausible verbal interactions between virtual human-like agents and user avatars in shared virtual environments.
We find that our algorithm creates a small runtime cost and enables agents to complete their goals more effectively than agents without the ability to leverage natural-language communication.
arXiv Detail & Related papers (2020-02-08T23:15:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.