Use case cards: a use case reporting framework inspired by the European
AI Act
- URL: http://arxiv.org/abs/2306.13701v1
- Date: Fri, 23 Jun 2023 15:47:19 GMT
- Title: Use case cards: a use case reporting framework inspired by the European
AI Act
- Authors: Isabelle Hupont, David Fern\'andez-Llorca, Sandra Baldassarri, Emilia
G\'omez
- Abstract summary: We propose a new framework for the documentation of use cases, that we call "use case cards"
Unlike other documentation methodologies, we focus on the purpose and operational use of an AI system.
The proposed framework is the result of a co-design process involving a relevant team of EU policy experts and scientists.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Despite recent efforts by the Artificial Intelligence (AI) community to move
towards standardised procedures for documenting models, methods, systems or
datasets, there is currently no methodology focused on use cases aligned with
the risk-based approach of the European AI Act (AI Act). In this paper, we
propose a new framework for the documentation of use cases, that we call "use
case cards", based on the use case modelling included in the Unified Markup
Language (UML) standard. Unlike other documentation methodologies, we focus on
the intended purpose and operational use of an AI system. It consists of two
main parts. Firstly, a UML-based template, tailored to allow implicitly
assessing the risk level of the AI system and defining relevant requirements.
Secondly, a supporting UML diagram designed to provide information about the
system-user interactions and relationships. The proposed framework is the
result of a co-design process involving a relevant team of EU policy experts
and scientists. We have validated our proposal with 11 experts with different
backgrounds and a reasonable knowledge of the AI Act as a prerequisite. We
provide the 5 "use case cards" used in the co-design and validation process.
"Use case cards" allows framing and contextualising use cases in an effective
way, and we hope this methodology can be a useful tool for policy makers and
providers for documenting use cases, assessing the risk level, adapting the
different requirements and building a catalogue of existing usages of AI.
Related papers
- Establishing Knowledge Preference in Language Models [80.70632813935644]
Language models are known to encode a great amount of factual knowledge through pretraining.
Such knowledge might be insufficient to cater to user requests.
When answering questions about ongoing events, the model should use recent news articles to update its response.
When some facts are edited in the model, the updated facts should override all prior knowledge learned by the model.
arXiv Detail & Related papers (2024-07-17T23:16:11Z) - Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning [50.47568731994238]
Key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL)
This paper presents a general framework model for integrating and learning structured reasoning into AI agents' policies.
arXiv Detail & Related papers (2023-12-22T17:57:57Z) - Model Reporting for Certifiable AI: A Proposal from Merging EU
Regulation into AI Development [2.9620297386658185]
Despite large progress in Explainable and Safe AI, practitioners suffer from a lack of regulation and standards for AI safety.
We propose the use of standardized cards to document AI applications throughout the development process.
arXiv Detail & Related papers (2023-07-21T12:13:54Z) - SAILER: Structure-aware Pre-trained Language Model for Legal Case
Retrieval [75.05173891207214]
Legal case retrieval plays a core role in the intelligent legal system.
Most existing language models have difficulty understanding the long-distance dependencies between different structures.
We propose a new Structure-Aware pre-traIned language model for LEgal case Retrieval.
arXiv Detail & Related papers (2023-04-22T10:47:01Z) - Dynamic Documentation for AI Systems [0.0]
We show the limits of present documentation protocols for AI systems.
We argue for dynamic documentation as a new paradigm for understanding and evaluating AI systems.
arXiv Detail & Related papers (2023-03-20T04:23:07Z) - Documenting use cases in the affective computing domain using Unified
Modeling Language [0.0]
There is no standard methodology for use case documentation covering the context of use, scope, functional requirements and risks of an AI system.
Our approach builds upon an assessment of use case information needs documented in the research literature and the recently proposed European regulatory framework for AI.
From this assessment, we adopt and adapt the Unified Modeling Language (UML), which has been used in the last two decades mostly by software engineers.
arXiv Detail & Related papers (2022-09-19T10:04:18Z) - Evaluating a Methodology for Increasing AI Transparency: A Case Study [8.265282762929509]
Given growing concerns about the potential harms of artificial intelligence, societies have begun to demand more transparency about how AI models and systems are created and used.
To address these concerns, several efforts have proposed documentation templates containing questions to be answered by model developers.
No single template can cover the needs of diverse documentation consumers.
arXiv Detail & Related papers (2022-01-24T20:01:01Z) - Knowledge-Aware Procedural Text Understanding with Multi-Stage Training [110.93934567725826]
We focus on the task of procedural text understanding, which aims to comprehend such documents and track entities' states and locations during a process.
Two challenges, the difficulty of commonsense reasoning and data insufficiency, still remain unsolved.
We propose a novel KnOwledge-Aware proceduraL text understAnding (KOALA) model, which effectively leverages multiple forms of external knowledge.
arXiv Detail & Related papers (2020-09-28T10:28:40Z) - Towards an Interface Description Template for AI-enabled Systems [77.34726150561087]
Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components.
There is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed.
We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component.
arXiv Detail & Related papers (2020-07-13T20:30:26Z) - A Methodology for Creating AI FactSheets [67.65802440158753]
This paper describes a methodology for creating the form of AI documentation we call FactSheets.
Within each step of the methodology, we describe the issues to consider and the questions to explore.
This methodology will accelerate the broader adoption of transparent AI documentation.
arXiv Detail & Related papers (2020-06-24T15:08:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.