Open Veins of Algorithmic Auditing: Why AI Assessment Lags Behind Its Deployment in the Global South

• URL: http://arxiv.org/abs/2607.21317v1
• Date: Thu, 23 Jul 2026 13:39:38 GMT
• Title: Open Veins of Algorithmic Auditing: Why AI Assessment Lags Behind Its Deployment in the Global South
• Abstract summary: Artificial intelligence is being deployed across the Global South at a pace matching or exceeding the Global North.<n>Yet AI governance has not kept pace, and the gap is far wider in the South.<n>This paper documents patterns in the sparse field of Global South AI evaluation and explains why it so rarely occurs.
• Score: 45.88028371034407
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Artificial intelligence is being deployed across the Global South at a pace matching or exceeding the Global North, yet AI governance has not kept pace, and the gap is far wider in the South. Drawing on a decade of AI audit practice across Latin America, Sub-Saharan Africa, and Asia Pacific (the only fully published second-party audit of a deployed system in the region, Robot Laura in Brazil; two completed but unreleased national audits, of a child-welfare risk model and a public-employment matching algorithm; thirteen Responsible AI Assessments; and a regional landscape analysis), this paper documents patterns in the sparse field of Global South AI evaluation and explains why it so rarely occurs. We count fewer than twenty published second- and third-party audits of deployed systems across the region over the past decade, against hundreds of documented public-sector algorithms and multibillion-dollar national AI investments. We find four cross-cutting patterns: proxy targets that substitute predictability for validity, performance claims that collapse under prevalence analysis, populations scored by models that never saw them in training, and structural bias that persists even after protected attributes are removed. We then draw five lessons for evaluation, regulation, and funding that emerge outside the regulatory, linguistic, and data conditions of the North. We argue the gap is not, at root, a capacity problem but a funding problem: capacity follows funded demand, and no actor is currently required, or funded, to hold deployed systems to account. The actor best placed to close it is the small number of development and philanthropic funders behind most consequential AI in the region, whose funding conditions can require independent evaluation where no regulator yet does. We close with recommendations for funders, governments, and the design of evaluation itself.

Related papers

• Agents' Last Exam [275.79071391137074]
  Agents' Last Exam (ALE) is a benchmark designed to evaluate AI agents on long horizon, economically valuable, real world tasks with verifiable outcomes.<n>Developed in collaboration with 250+ industry experts, ALE covers non-physical industries defined with reference to O*NET / SOC 2018.<n>Current results show that the hardest tier remains far from saturated: across mainstream harness and backbone configurations, the average full pass rate is below 1%.
  arXiv  Detail & Related papers  (2026-06-03T20:20:46Z)
• Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named [0.0]
  Autonomous AI agents now plan, decide, and act on behalf of users across healthcare, financial services, and workplace contexts.<n> Existing AI literacy frameworks were built for a world in which humans evaluate AI outputs and decide whether to act.<n>This paper names the resulting problem agentic literacy debt: the accumulating societal deficit that grows when agentic AI systems are deployed at scale without corresponding literacy infrastructure.
  arXiv  Detail & Related papers  (2026-04-21T15:43:57Z)
• The Invisibility Hypothesis: Promises of AGI and the Future of the Global South [2.0390620658820433]
  We argue that the availability of highly autonomous, general-purpose cognitive systems does not guarantee equitable outcomes.<n>In the best case, geographic location is no longer relevant as AGI fully democratizes access to knowledge and essential services for everyone in the globe.<n>In the worst case, existing structural constraints are severely amplified, rendering already marginalized populations functionally irrelevant to global systems.
  arXiv  Detail & Related papers  (2026-03-02T08:46:18Z)
• Global AI Bias Audit for Technical Governance [0.0]
  This paper presents the outputs of the exploratory phase of a global audit of Large Language Models (LLMs) project.<n>I used the Global AI dataset (GAID) Project as a framework to stress-test the Llama-3 8B model and evaluate geographic and socioeconomic biases in technical AI governance awareness.<n>The findings reveal that AI's technical knowledge is heavily concentrated in higher-income regions, while lower-income countries from the Global South are subject to disproportionate systemic information gaps.
  arXiv  Detail & Related papers  (2026-02-01T19:45:21Z)
• Never Compromise to Vulnerabilities: A Comprehensive Survey on AI Governance [211.5823259429128]
  We propose a comprehensive framework integrating technical and societal dimensions, structured around three interconnected pillars: Intrinsic Security, Derivative Security, and Social Ethics.<n>We identify three core challenges: (1) the generalization gap, where defenses fail against evolving threats; (2) inadequate evaluation protocols that overlook real-world risks; and (3) fragmented regulations leading to inconsistent oversight.<n>Our framework offers actionable guidance for researchers, engineers, and policymakers to develop AI systems that are not only robust and secure but also ethically aligned and publicly trustworthy.
  arXiv  Detail & Related papers  (2025-08-12T09:42:56Z)
• Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits [54.648819983899614]
  General purpose AI seems to have lowered the barriers for the public to use AI and harness its power. We introduce PARTICIP-AI, a framework for laypeople to speculate and assess AI use cases and their impacts.
  arXiv  Detail & Related papers  (2024-03-21T19:12:37Z)
• Computing Power and the Governance of Artificial Intelligence [51.967584623262674]
  Governments and companies have started to leverage compute as a means to govern AI. compute-based policies and technologies have the potential to assist in these areas, but there is significant variation in their readiness for implementation. naive or poorly scoped approaches to compute governance carry significant risks in areas like privacy, economic impacts, and centralization of power.
  arXiv  Detail & Related papers  (2024-02-13T21:10:21Z)
• Ten Hard Problems in Artificial Intelligence We Must Get Right [72.99597122935903]
  We explore the AI2050 "hard problems" that block the promise of AI and cause AI risks. For each problem, we outline the area, identify significant recent work, and suggest ways forward.
  arXiv  Detail & Related papers  (2024-02-06T23:16:41Z)
• Can apparent bystanders distinctively shape an outcome? Global south countries and global catastrophic risk-focused governance of artificial intelligence [0.0]
  We argue that global south countries like India and Singapore could be fairly consequential in the global catastrophic risk-focused governance of AI. We also suggest some ways through which global south countries can play a positive role in designing, strengthening and operationalizing global catastrophic risk-focused AI governance.
  arXiv  Detail & Related papers  (2023-12-07T18:54:16Z)
• Fairness in AI and Its Long-Term Implications on Society [68.8204255655161]
  We take a closer look at AI fairness and analyze how lack of AI fairness can lead to deepening of biases over time. We discuss how biased models can lead to more negative real-world outcomes for certain groups. If the issues persist, they could be reinforced by interactions with other risks and have severe implications on society in the form of social unrest.
  arXiv  Detail & Related papers  (2023-04-16T11:22:59Z)
• AI in the "Real World": Examining the Impact of AI Deployment in Low-Resource Contexts [1.90365714903665]
  This paper examines the deployment of AI by large industry labs situated in low-resource contexts. It highlights factors impacting unanticipated deployments, and reflects on the state of AI deployment within the Global South.
  arXiv  Detail & Related papers  (2020-11-28T01:49:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.