Measuring Ethics in AI with AI: A Methodology and Dataset Construction

• URL: http://arxiv.org/abs/2107.11913v1
• Date: Mon, 26 Jul 2021 00:26:12 GMT
• Title: Measuring Ethics in AI with AI: A Methodology and Dataset Construction
• Authors: Pedro H.C. Avelar and Rafael B. Audibert and Anderson R. Tavares and Lu\'is C. Lamb
• Abstract summary: We propose to use such newfound capabilities of AI technologies to augment our AI measuring capabilities. We do so by training a model to classify publications related to ethical issues and concerns. We highlight the implications of AI metrics, in particular their contribution towards developing trustful and fair AI-based tools and technologies.
• Score: 1.6861004263551447
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recently, the use of sound measures and metrics in Artificial Intelligence has become the subject of interest of academia, government, and industry. Efforts towards measuring different phenomena have gained traction in the AI community, as illustrated by the publication of several influential field reports and policy documents. These metrics are designed to help decision takers to inform themselves about the fast-moving and impacting influences of key advances in Artificial Intelligence in general and Machine Learning in particular. In this paper we propose to use such newfound capabilities of AI technologies to augment our AI measuring capabilities. We do so by training a model to classify publications related to ethical issues and concerns. In our methodology we use an expert, manually curated dataset as the training set and then evaluate a large set of research papers. Finally, we highlight the implications of AI metrics, in particular their contribution towards developing trustful and fair AI-based tools and technologies. Keywords: AI Ethics; AI Fairness; AI Measurement. Ethics in Computer Science.

Related papers

• Domain-Specific Evaluation Strategies for AI in Journalism [3.2566808526538873]
  We consider different aspects of AI evaluation that can benefit from domain-specific tailoring. In doing so, we lay out a potential framework to guide AI evaluation in journalism.
  arXiv  Detail & Related papers  (2024-03-26T17:47:25Z)
• The Ethics of AI in Education [0.0]
  The transition of Artificial Intelligence from a lab-based science to live human contexts brings into sharp focus many historic, socio-cultural biases, inequalities, and moral dilemmas. Questions that have been raised regarding the broader ethics of AI are also relevant for AI in Education (AIED) AIED raises further challenges related to the impact of its technologies on users, how such technologies might be used to reinforce or alter the way that we learn and teach, and what we, as a society and individuals, value as outcomes of education.
  arXiv  Detail & Related papers  (2024-03-22T11:41:37Z)
• Selected Trends in Artificial Intelligence for Space Applications [69.3474006357492]
  This chapter focuses on differentiable intelligence and on-board machine learning. We discuss a few selected projects originating from the European Space Agency's (ESA) Advanced Concepts Team (ACT)
  arXiv  Detail & Related papers  (2022-12-10T07:49:50Z)
• The Role of AI in Drug Discovery: Challenges, Opportunities, and Strategies [97.5153823429076]
  The benefits, challenges and drawbacks of AI in this field are reviewed. The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
  arXiv  Detail & Related papers  (2022-12-08T23:23:39Z)
• On the Evolution of A.I. and Machine Learning: Towards a Meta-level Measuring and Understanding Impact, Influence, and Leadership at Premier A.I. Conferences [0.26999000177990923]
  We present measures allowing the analyses of AI and machine learning researchers' impact, influence, and leadership over the last decades. We look at papers published at the flagship AI and machine learning conferences since the first International Joint Conference on Artificial Intelligence (IJCAI) held in 1969.
  arXiv  Detail & Related papers  (2022-05-26T03:41:12Z)
• Metaethical Perspectives on 'Benchmarking' AI Ethics [81.65697003067841]
  Benchmarks are seen as the cornerstone for measuring technical progress in Artificial Intelligence (AI) research. An increasingly prominent research area in AI is ethics, which currently has no set of benchmarks nor commonly accepted way for measuring the 'ethicality' of an AI system. We argue that it makes more sense to talk about 'values' rather than 'ethics' when considering the possible actions of present and future AI systems.
  arXiv  Detail & Related papers  (2022-04-11T14:36:39Z)
• Actionable Approaches to Promote Ethical AI in Libraries [7.1492901819376415]
  The widespread use of artificial intelligence (AI) in many domains has revealed numerous ethical issues. No practical guidance currently exists for libraries to plan for, evaluate, or audit the ethics of intended or deployed AI. We report on several promising approaches for promoting ethical AI that can be adapted from other contexts.
  arXiv  Detail & Related papers  (2021-09-20T16:38:49Z)
• A Classification of Artificial Intelligence Systems for Mathematics Education [3.718476964451589]
  This chapter provides an overview of the different Artificial Intelligence (AI) systems that are being used in digital tools for Mathematics Education (ME) It is aimed at researchers in AI and Machine Learning (ML), for whom we shed some light on the specific technologies that are being used in educational applications.
  arXiv  Detail & Related papers  (2021-07-13T12:09:10Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit-risk assessment practices: Towards a comprehensive qualification matrix of AI programs and devices (pre-print 2020) [55.41644538483948]
  This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems.
  arXiv  Detail & Related papers  (2021-05-07T12:01:31Z)
• Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things [98.10037444792444]
  We show how AI can empower the IoT to make it faster, smarter, greener, and safer. First, we present progress in AI research for IoT from four perspectives: perceiving, learning, reasoning, and behaving. Finally, we summarize some promising applications of AIoT that are likely to profoundly reshape our world.
  arXiv  Detail & Related papers  (2020-11-17T13:14:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.