Invisible Agents, Uninformed Patients: Towards Responsible Deployment Of Autonomous AI Diagnostic Agents In Sub-Saharan Africa

• URL: http://arxiv.org/abs/2608.21326v1
• Date: Fri, 21 Aug 2026 17:34:19 GMT
• Title: Invisible Agents, Uninformed Patients: Towards Responsible Deployment Of Autonomous AI Diagnostic Agents In Sub-Saharan Africa
• Abstract summary: This paper synthesizes existing research on informed consent, algorithmic accountability, and explainable AI.<n>It highlights three distinct challenges introduced by deploying AI agents in the sub-Saharan African context.<n>The paper proposes three foundational principles; agent-aware informed consent, human override as a structural requirement and contextually adapted explainability.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous AI diagnostic agents, systems that analyse patient-specific clinical data and produce diagnostic outputs or triage decisions without mandatory real-time human review, are increasingly deployed across eHealth platforms in sub-Saharan Africa at a pace that has outrun the governance infrastructure needed to oversee them. While significant bodies of work address AI accountability, transparency and explainability in healthcare, existing frameworks are largely clinician-centered and assume regulatory conditions that do not uniformly exist in low-resource settings. A patient-centered analysis of the disparity in patient awareness regarding autonomous agents, which results in a structural accountability gap, is mostly missing from the literature. This paper synthesizes existing research on informed consent, algorithmic accountability, and explainable AI to highlight three distinct challenges introduced by deploying AI agents in the sub-Saharan African context. Drawing on three documented deployment cases, including computer-aided tuberculosis detection in Tanzania, diabetic retinopathy and TB screening in Zambia, and mobile health chat-bot triage in Ghana, it demonstrates that these gaps are already present in active deployments across the region. In response, the paper proposes three foundational principles; agent-aware informed consent, human override as a structural requirement and contextually adapted explainability. This triad of principles lays a practical minimum standard for developers, health system administrators and policymakers in contexts where formal AI regulation remains nascent.

Related papers

• "Where is this coming from?" Uncovering Trustworthiness Ideals in AI-powered Peripartum Information Seeking [10.118301488103064]
  Current AI and NLP-powered systems aim to improve access to vetted maternal health information.<n>In high-stakes health contexts shaped by historical inequities, trustworthiness must be inspectable and not asserted.<n>We propose design artifacts that are mistrust-aware and promote principled governance mechanisms for transparent, pluralistic AI systems.
  arXiv  Detail & Related papers  (2026-06-08T20:36:57Z)
• Six Interventions for the Responsible and Ethical Implementation of Medical AI Agents [0.0]
  Large language model (LLM)-based AI agents may soon participate in medical decision-making with limited or no real-time human oversight.<n>This shift raises fundamental questions about how the core principles of medical ethics can be upheld when the clinical responsibility extends to autonomous systems.<n>Here we propose an ethics-by-design framework for medical AI agents comprising six practical interventions.
  arXiv  Detail & Related papers  (2026-03-14T04:28:59Z)
• Before the Clinic: Transparent and Operable Design Principles for Healthcare AI [42.994619952353396]
  We propose two foundational design principles to operationalize pre-clinical technical requirements for healthcare AI.<n>We ground these principles in established XAI frameworks, map them to documented clinician needs, and demonstrate their alignment with emerging governance requirements.<n>This pre-clinical playbook provides actionable guidance for development teams, accelerates the path to clinical evaluation, and establishes a shared vocabulary bridging AI researchers, healthcare practitioners, and regulatory stakeholders.
  arXiv  Detail & Related papers  (2025-10-31T04:05:09Z)
• A Comprehensive Review of Datasets for Clinical Mental Health AI Systems [55.67299586253951]
  We present the first comprehensive survey of clinical mental health datasets relevant to the training and development of AI-powered clinical assistants.<n>Our survey identifies critical gaps such as a lack of longitudinal data, limited cultural and linguistic representation, inconsistent collection and annotation standards, and a lack of modalities in synthetic data.
  arXiv  Detail & Related papers  (2025-08-13T13:42:35Z)
• DeepSeek reshaping healthcare in China's tertiary hospitals [0.0]
  DeepSeek is a leading AI system, widely deployed across China's tertiary hospitals since January 2025.<n>With continued technological advancements, AI is expected to integrate multimodal data sources, such as genomics and radiomics.<n>The future of AI in healthcare depends on the development of transparent regulatory structures, industry collaboration, and adaptive governance frameworks.
  arXiv  Detail & Related papers  (2025-02-23T22:09:17Z)
• Ethical Challenges and Evolving Strategies in the Integration of Artificial Intelligence into Clinical Practice [1.0301404234578682]
  We focus on five critical ethical concerns: justice and fairness, transparency, patient consent and confidentiality, accountability, and patient-centered and equitable care.<n>The paper explores how bias, lack of transparency, and challenges in maintaining patient trust can undermine the effectiveness and fairness of AI applications in healthcare.
  arXiv  Detail & Related papers  (2024-11-18T00:52:22Z)
• Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios [46.729092855387165]
  We study the choice of the backbone LLM for medical AI agents, which is the foundation for the agent's overall reasoning and action generation.<n>Our findings demonstrate o1's ability to enhance diagnostic accuracy and consistency, paving the way for smarter, more responsive AI tools.
  arXiv  Detail & Related papers  (2024-11-16T18:19:53Z)
• Explainable Artificial Intelligence for Medical Applications: A Review [42.33274794442013]
  This article reviews recent research grounded in explainable artificial intelligence (XAI)<n>It focuses on medical practices within the visual, audio, and multimodal perspectives.<n>We endeavour to categorise and synthesise these practices, aiming to provide support and guidance for future researchers and healthcare professionals.
  arXiv  Detail & Related papers  (2024-11-15T11:31:06Z)
• Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Framework [13.215318138576713]
  The paper reviews interpretable AI processes, methods, applications, and the challenges of implementation in healthcare. It aims to foster a comprehensive understanding of the crucial role of a robust interpretability approach in healthcare.
  arXiv  Detail & Related papers  (2023-11-18T12:29:18Z)
• FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare [73.78776682247187]
  Concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare.
  arXiv  Detail & Related papers  (2023-08-11T10:49:05Z)
• Organizational Governance of Emerging Technologies: AI Adoption in Healthcare [43.02293389682218]
  The Health AI Partnership aims to better define the requirements for adequate organizational governance of AI systems in healthcare settings. This is one of the most detailed qualitative analyses to date of the current governance structures and processes involved in AI adoption by health systems in the United States. We hope these findings can inform future efforts to build capabilities to promote the safe, effective, and responsible adoption of emerging technologies in healthcare.
  arXiv  Detail & Related papers  (2023-04-25T18:30:47Z)
• IAC: A Framework for Enabling Patient Agency in the Use of AI-Enabled Healthcare [1.0878040851638]
  We present IAC (Informing, Assessment, and Consent), a framework for evaluating patient response to the introduction of AI-enabled digital technologies in healthcare settings. The framework is composed of three core principles that guide how healthcare practitioners can inform patients about the use of AI in their healthcare. We propose that the principles composing this framework can be translated into guidelines that improve practitioner-patient relationships and, concurrently, patient agency regarding the use of AI in healthcare.
  arXiv  Detail & Related papers  (2021-10-29T16:13:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.