Designing Interaction for Multi-agent Cooperative System in an Office Environment

• URL: http://arxiv.org/abs/2002.06417v1
• Date: Sat, 15 Feb 2020 17:36:00 GMT
• Title: Designing Interaction for Multi-agent Cooperative System in an Office Environment
• Authors: Chao Wang, Stephan Hasler, Manuel Muehlig, Frank Joublin, Antonello Ceravola, Joerg Deigmoeller, Lydia Fischer
• Abstract summary: Future intelligent system will involve very various types of artificial agents, such as mobile robots, smart home infrastructure or personal devices. This paper presents the design and implementation of the human-machine interface of Intelligent Cyber-Physical system (ICPS) ICPS is a multi-entity coordination system of robots and other smart devices in a working environment.
• Score: 2.2430284460908605
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Future intelligent system will involve very various types of artificial agents, such as mobile robots, smart home infrastructure or personal devices, which share data and collaborate with each other to execute certain tasks.Designing an efficient human-machine interface, which can support users to express needs to the system, supervise the collaboration progress of different entities and evaluate the result, will be challengeable. This paper presents the design and implementation of the human-machine interface of Intelligent Cyber-Physical system (ICPS),which is a multi-entity coordination system of robots and other smart devices in a working environment. ICPS gathers sensory data from entities and then receives users' command, then optimizes plans to utilize the capability of different entities to serve people. Using multi-model interaction methods, e.g. graphical interfaces, speech interaction, gestures and facial expressions, ICPS is able to receive inputs from users through different entities, keep users aware of the progress and accomplish the task efficiently

Related papers

• Human-Artificial Interaction in the Age of Agentic AI: A System-Theoretical Approach [0.0]
  This paper presents a novel perspective on human-computer interaction (HCI), framing it as a dynamic interplay between human and computational agents. A key distinction is made between multi-agent systems (MAS) and Centaurian systems, which represent two different paradigms of human-AI collaboration. Our research has practical applications in autonomous robotics, human-in-the-loop decision making, and AI-driven cognitive architectures.
  arXiv  Detail & Related papers  (2025-02-19T07:55:34Z)
• GUI Agents: A Survey [129.94551809688377]
  Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. Motivated by the growing interest and fundamental importance of GUI agents, we provide a comprehensive survey that categorizes their benchmarks, evaluation metrics, architectures, and training methods.
  arXiv  Detail & Related papers  (2024-12-18T04:48:28Z)
• Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface [38.76937539085164]
  This paper presents a human-centered efficient agent planning method -- Interactive Speculative Planning. We aim at enhancing the efficiency of agent planning through both system design and human-AI interaction.
  arXiv  Detail & Related papers  (2024-09-30T16:52:51Z)
• SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering [79.07755560048388]
  SWE-agent is a system that facilitates LM agents to autonomously use computers to solve software engineering tasks. SWE-agent's custom agent-computer interface (ACI) significantly enhances an agent's ability to create and edit code files, navigate entire repositories, and execute tests and other programs. We evaluate SWE-agent on SWE-bench and HumanEvalFix, achieving state-of-the-art performance on both with a pass@1 rate of 12.5% and 87.7%, respectively.
  arXiv  Detail & Related papers  (2024-05-06T17:41:33Z)
• Socially Pertinent Robots in Gerontological Healthcare [78.35311825198136]
  This paper is an attempt to partially answer the question, via two waves of experiments with patients and companions in a day-care gerontological facility in Paris with a full-sized humanoid robot endowed with social and conversational interaction capabilities. Overall, the users are receptive to this technology, especially when the robot perception and action skills are robust to environmental clutter and flexible to handle a plethora of different interactions.
  arXiv  Detail & Related papers  (2024-04-11T08:43:37Z)
• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systems [11.427320283363326]
  We conduct a human participant study with 185 participants to understand how users want to interact with differently configured MI-CC systems. We find that MI-CC systems with more extensive coverage of the design space are rated higher or on par on a variety of creative and goal-completion metrics.
  arXiv  Detail & Related papers  (2023-05-03T22:32:37Z)
• Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robots [3.7311680121118345]
  We reflect on the organization of decision modules in human-robot interaction platforms. We show that most practical HRI architectures tend to be either robot-centric or dialogue-centric. We contend that architectures placing action managers'' and interaction managers'' on an equal footing may provide the best path forward for future human-robot interaction systems.
  arXiv  Detail & Related papers  (2023-03-15T09:18:32Z)
• A Unified Architecture for Dynamic Role Allocation and Collaborative Task Planning in Mixed Human-Robot Teams [0.0]
  We present a novel architecture for dynamic role allocation and collaborative task planning in a mixed human-robot team of arbitrary size. The architecture capitalizes on a centralized reactive and modular task-agnostic planning method based on Behavior Trees (BTs) Different metrics used as MILP cost allow the architecture to favor various aspects of the collaboration.
  arXiv  Detail & Related papers  (2023-01-19T12:30:56Z)
• A ROS Architecture for Personalised HRI with a Bartender Social Robot [61.843727637976045]
  BRILLO project has the overall goal of creating an autonomous robotic bartender that can interact with customers while accomplishing its bartending tasks. We present the developed three-layers ROS architecture integrating a perception layer managing the processing of different social signals, a decision-making layer for handling multi-party interactions, and an execution layer controlling the behaviour of a complex robot composed of arms and a face.
  arXiv  Detail & Related papers  (2022-03-13T11:33:06Z)
• Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together [68.44697646919515]
  This paper presents several human-robot systems that utilize spatial computing to enable novel robot use cases. The combination of spatial computing and egocentric sensing on mixed reality devices enables them to capture and understand human actions and translate these to actions with spatial meaning.
  arXiv  Detail & Related papers  (2022-02-03T10:04:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.