A Picture is Worth a Collaboration: Accumulating Design Knowledge for
Computer-Vision-based Hybrid Intelligence Systems
- URL: http://arxiv.org/abs/2104.11600v1
- Date: Fri, 23 Apr 2021 13:47:57 GMT
- Title: A Picture is Worth a Collaboration: Accumulating Design Knowledge for
Computer-Vision-based Hybrid Intelligence Systems
- Authors: Patrick Zschech, Jannis Walk, Kai Heinrich, Michael V\"ossing, Niklas
K\"uhl
- Abstract summary: We apply a reflective, practice-inspired design science approach and accumulate design knowledge from six comprehensive CV projects.
We identify four design-related mechanisms that inform our derived meta-requirements and design principles.
This can serve as a basis for further socio-technical research on CV-based HI systems.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Computer vision (CV) techniques try to mimic human capabilities of visual
perception to support labor-intensive and time-consuming tasks like the
recognition and localization of critical objects. Nowadays, CV increasingly
relies on artificial intelligence (AI) to automatically extract useful
information from images that can be utilized for decision support and business
process automation. However, the focus of extant research is often exclusively
on technical aspects when designing AI-based CV systems while neglecting
socio-technical facets, such as trust, control, and autonomy. For this purpose,
we consider the design of such systems from a hybrid intelligence (HI)
perspective and aim to derive prescriptive design knowledge for CV-based HI
systems. We apply a reflective, practice-inspired design science approach and
accumulate design knowledge from six comprehensive CV projects. As a result, we
identify four design-related mechanisms (i.e., automation, signaling,
modification, and collaboration) that inform our derived meta-requirements and
design principles. This can serve as a basis for further socio-technical
research on CV-based HI systems.
Related papers
- PADTHAI-MM: A Principled Approach for Designing Trustable,
Human-centered AI systems using the MAST Methodology [5.38932801848643]
The Multisource AI Scorecard Table (MAST), a checklist rating system, addresses this gap in designing and evaluating AI-enabled decision support systems.
We propose the Principled Approach for Designing Trustable Human-centered AI systems using MAST methodology.
We show that MAST-guided design can improve trust perceptions, and that MAST criteria can be linked to performance, process, and purpose information.
arXiv Detail & Related papers (2024-01-24T23:15:44Z) - Toward General-Purpose Robots via Foundation Models: A Survey and
Meta-Analysis [73.89558418030418]
Most existing robotic systems have been designed for specific tasks, trained on specific datasets, and deployed within specific environments.
Motivated by the impressive open-set performance and content generation capabilities of web-scale, large-capacity pre-trained models, we devote this survey to exploring how foundation models can be applied to robotics.
arXiv Detail & Related papers (2023-12-14T10:02:55Z) - Stabilizing Contrastive RL: Techniques for Robotic Goal Reaching from
Offline Data [101.43350024175157]
Self-supervised learning has the potential to decrease the amount of human annotation and engineering effort required to learn control strategies.
Our work builds on prior work showing that the reinforcement learning (RL) itself can be cast as a self-supervised problem.
We demonstrate that a self-supervised RL algorithm based on contrastive learning can solve real-world, image-based robotic manipulation tasks.
arXiv Detail & Related papers (2023-06-06T01:36:56Z) - Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering.
In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
arXiv Detail & Related papers (2022-03-06T10:12:56Z) - Towards a Reference Software Architecture for Human-AI Teaming in Smart
Manufacturing [0.0]
We developed a reference software architecture based on knowledge graphs, tracking and scene analysis, and components for relational machine learning.
The empirical validation of this software architecture will be conducted in cooperation with three large-scale companies in the automotive, energy systems, and precision machining domain.
arXiv Detail & Related papers (2022-01-13T10:43:49Z) - Human-Robot Collaboration and Machine Learning: A Systematic Review of
Recent Research [69.48907856390834]
Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot.
This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
arXiv Detail & Related papers (2021-10-14T15:14:33Z) - The future of human-AI collaboration: a taxonomy of design knowledge for
hybrid intelligence systems [0.0]
We identify the need for developing socio-technological ensembles of humans and machines.
We present a structured overview of interdisciplinary research on the role of humans in the machine learning pipeline.
Second, we envision hybrid intelligence systems and conceptualize the relevant dimensions for system design.
arXiv Detail & Related papers (2021-05-07T16:10:44Z) - Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
We have developed a proven systems engineering approach for machine learning development and deployment.
Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
arXiv Detail & Related papers (2021-01-11T15:54:48Z) - Towards CRISP-ML(Q): A Machine Learning Process Model with Quality
Assurance Methodology [53.063411515511056]
We propose a process model for the development of machine learning applications.
The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project.
The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications.
arXiv Detail & Related papers (2020-03-11T08:25:49Z) - Engineering AI Systems: A Research Agenda [9.84673609667263]
We provide a conceptualization of the typical evolution patterns that companies experience when employing machine learning.
The main contribution of the paper is a research agenda for AI engineering that provides an overview of the key engineering challenges surrounding ML solutions.
arXiv Detail & Related papers (2020-01-16T20:29:48Z) - A Survey of Knowledge Representation in Service Robotics [10.220366465518262]
We focus on knowledge representations and how knowledge is typically gathered, represented, and reproduced to solve problems.
In accordance with the definition of knowledge representations, we discuss the key distinction between such representations and useful learning models.
We discuss key principles that should be considered when designing an effective knowledge representation.
arXiv Detail & Related papers (2018-07-05T22:18:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.