Impact Matters! An Audit Method to Evaluate AI Projects and their Impact for Sustainability and Public Interest

• URL: http://arxiv.org/abs/2601.13936v1
• Date: Tue, 20 Jan 2026 13:12:20 GMT
• Title: Impact Matters! An Audit Method to Evaluate AI Projects and their Impact for Sustainability and Public Interest
• Authors: Theresa Züger, Laura State, Lena Winter,
• Abstract summary: We introduce the Impact-AI-method, a qualitative audit method to evaluate concrete AI projects with respect to public interest and sustainability.<n>The method captures a project's governance structure, its theory of change, AI model and data characteristics, and social, environmental, and economic impacts.<n>It is intended as a reusable blueprint that both informs public debate about AI 'for good' claims and supports the creation of transparency of AI systems.
• Score: 1.417190985719517
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The overall rapid increase of artificial intelligence (AI) use is linked to various initiatives that propose AI 'for good'. However, there is a lack of transparency in the goals of such projects, as well as a missing evaluation of their actual impacts on society and the planet. We close this gap by proposing public interest and sustainability as a regulatory dual-concept, together creating the necessary framework for a just and sustainable development that can be operationalized and utilized for the assessment of AI systems. Based on this framework, and building on existing work in auditing, we introduce the Impact-AI-method, a qualitative audit method to evaluate concrete AI projects with respect to public interest and sustainability. The interview-based method captures a project's governance structure, its theory of change, AI model and data characteristics, and social, environmental, and economic impacts. We also propose a catalog of assessment criteria to rate the outcome of the audit as well as to create an accessible output that can be debated broadly by civil society. The Impact-AI-method, developed in a transdisciplinary research setting together with NGOs and a multi-stakeholder research council, is intended as a reusable blueprint that both informs public debate about AI 'for good' claims and supports the creation of transparency of AI systems that purport to contribute to a just and sustainable development.

Related papers

• Trust and Transparency in AI: Industry Voices on Data, Ethics, and Compliance [0.7099737083842057]
  The rapid adoption of AI in the industry has outpaced ethical evaluation frameworks.<n>This paper investigates practical approaches and challenges in the development and assessment of Trustworthy AI.
  arXiv  Detail & Related papers  (2025-09-23T20:58:01Z)
• The AI Imperative: Scaling High-Quality Peer Review in Machine Learning [49.87236114682497]
  We argue that AI-assisted peer review must become an urgent research and infrastructure priority.<n>We propose specific roles for AI in enhancing factual verification, guiding reviewer performance, assisting authors in quality improvement, and supporting ACs in decision-making.
  arXiv  Detail & Related papers  (2025-06-09T18:37:14Z)
• Bridging the Gap: Integrating Ethics and Environmental Sustainability in AI Research and Practice [57.94036023167952]
  We argue that the efforts aiming to study AI's ethical ramifications should be made in tandem with those evaluating its impacts on the environment.<n>We propose best practices to better integrate AI ethics and sustainability in AI research and practice.
  arXiv  Detail & Related papers  (2025-04-01T13:53:11Z)
• Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits [54.648819983899614]
  General purpose AI seems to have lowered the barriers for the public to use AI and harness its power. We introduce PARTICIP-AI, a framework for laypeople to speculate and assess AI use cases and their impacts.
  arXiv  Detail & Related papers  (2024-03-21T19:12:37Z)
• AI Sustainability in Practice Part One: Foundations for Sustainable AI Projects [0.46671368497079174]
  AI projects are responsive to the transformative effects as well as short-, medium-, and long-term impacts on individuals and society. This workbook is the first part of a pair that provides the concepts and tools needed to put AI Sustainability into practice.
  arXiv  Detail & Related papers  (2024-02-19T22:52:14Z)
• AI in ESG for Financial Institutions: An Industrial Survey [4.893954917947095]
  The paper surveys the industrial landscape to delineate the necessity and impact of AI in bolstering ESG frameworks. Our survey categorizes AI applications across three main pillars of ESG, illustrating how AI enhances analytical capabilities, risk assessment, customer engagement, reporting accuracy and more. The paper also addresses the imperative of responsible and sustainable AI, emphasizing the ethical dimensions of AI deployment in ESG-related banking processes.
  arXiv  Detail & Related papers  (2024-02-03T02:14:47Z)
• The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice [64.29355073494125]
  This article aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation. We articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners.
  arXiv  Detail & Related papers  (2023-10-02T05:30:42Z)
• Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir" [76.44130385507894]
  This paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices. Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design.
  arXiv  Detail & Related papers  (2021-11-01T17:57:04Z)
• Enhanced well-being assessment as basis for the practical implementation of ethical and rights-based normative principles for AI [0.0]
  We propose the practical application of an enhanced well-being impact assessment framework for Autonomous and Intelligent Systems. This process could enable a human-centered algorithmically-supported approach to the understanding of the impacts of AI systems.
  arXiv  Detail & Related papers  (2020-07-29T13:26:05Z)
• Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims [59.64274607533249]
  AI developers need to make verifiable claims to which they can be held accountable. This report suggests various steps that different stakeholders can take to improve the verifiability of claims made about AI systems. We analyze ten mechanisms for this purpose--spanning institutions, software, and hardware--and make recommendations aimed at implementing, exploring, or improving those mechanisms.
  arXiv  Detail & Related papers  (2020-04-15T17:15:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.