"Accessibility people, you go work on that thing of yours over there": Addressing Disability Inclusion in AI Product Organizations

• URL: http://arxiv.org/abs/2508.16607v2
• Date: Wed, 05 Nov 2025 16:58:10 GMT
• Title: "Accessibility people, you go work on that thing of yours over there": Addressing Disability Inclusion in AI Product Organizations
• Authors: Sanika Moharana, Cynthia L. Bennett, Erin Buehler, Michael Madaio, Vinita Tibdewal, Shaun K. Kane,
• Abstract summary: We report on an interview study with 25 AI practitioners about how their work processes and artifacts may impact end users with disabilities.<n>We found that practitioners experienced friction when triaging problems at the intersection of responsible AI and accessibility practices.<n>We offer suggestions for new resources and process changes to better support people with disabilities as end users of AI.
• Score: 15.672286378805234
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rapid emergence of generative AI has changed the way that technology is designed, constructed, maintained, and evaluated. Decisions made when creating AI-powered systems may impact some users disproportionately, such as people with disabilities. In this paper, we report on an interview study with 25 AI practitioners across multiple roles (engineering, research, UX, and responsible AI) about how their work processes and artifacts may impact end users with disabilities. We found that practitioners experienced friction when triaging problems at the intersection of responsible AI and accessibility practices, navigated contradictions between accessibility and responsible AI guidelines, identified gaps in data about users with disabilities, and gathered support for addressing the needs of disabled stakeholders by leveraging informal volunteer and community groups within their company. Based on these findings, we offer suggestions for new resources and process changes to better support people with disabilities as end users of AI.

Related papers

• Augmenting Human Cognition With Generative AI: Lessons From AI-Assisted Decision-Making [2.1680671785663654]
  In both AI-assisted decision-making and generative AI, a popular approach is to suggest AI-generated end-to-end solutions to users.<n>Alternatively, AI tools could offer more incremental support to help users solve tasks themselves.
  arXiv  Detail & Related papers  (2025-04-04T06:40:03Z)
• Accessibility Considerations in the Development of an AI Action Plan [10.467658828071057]
  We argue that there is a need for Accessibility to be represented in several important domains.<n>Data security and privacy and privacy risks including data collected by AI based accessibility technologies.<n> Disability-specific AI risks and biases including both direct bias (during AI use by the disabled person) and indirect bias (when AI is used by someone else on data relating to a disabled person)
  arXiv  Detail & Related papers  (2025-03-14T21:57:23Z)
• AI Automatons: AI Systems Intended to Imitate Humans [54.19152688545896]
  There is a growing proliferation of AI systems designed to mimic people's behavior, work, abilities, likenesses, or humanness.<n>The research, design, deployment, and availability of such AI systems have prompted growing concerns about a wide range of possible legal, ethical, and other social impacts.
  arXiv  Detail & Related papers  (2025-03-04T03:55:38Z)
• How Performance Pressure Influences AI-Assisted Decision Making [52.997197698288936]
  We show how pressure and explainable AI (XAI) techniques interact with AI advice-taking behavior.<n>Our results show complex interaction effects, with different combinations of pressure and XAI techniques either improving or worsening AI advice taking behavior.
  arXiv  Detail & Related papers  (2024-10-21T22:39:52Z)
• AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges [60.56413461109281]
  Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions.
  arXiv  Detail & Related papers  (2023-04-10T15:38:12Z)
• Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems [13.484359389266864]
  This paper addresses whether the Dunning-Kruger Effect (DKE) can hinder appropriate reliance on AI systems. DKE is a metacognitive bias due to which less-competent individuals overestimate their own skill and performance. We found that participants who overestimate their performance tend to exhibit under-reliance on AI systems.
  arXiv  Detail & Related papers  (2023-01-25T14:26:10Z)
• The Role of AI in Drug Discovery: Challenges, Opportunities, and Strategies [97.5153823429076]
  The benefits, challenges and drawbacks of AI in this field are reviewed. The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
  arXiv  Detail & Related papers  (2022-12-08T23:23:39Z)
• Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare [8.351355707564153]
  We examine the problem of trustworthy AI and explore what delivering this means in practice. We argue here that this overlooks the important part played by organisational accountability in how people reason about and trust AI in socio-technical settings.
  arXiv  Detail & Related papers  (2022-11-29T18:22:23Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• What Do End-Users Really Want? Investigation of Human-Centered XAI for Mobile Health Apps [69.53730499849023]
  We present a user-centered persona concept to evaluate explainable AI (XAI) Results show that users' demographics and personality, as well as the type of explanation, impact explanation preferences. Our insights bring an interactive, human-centered XAI closer to practical application.
  arXiv  Detail & Related papers  (2022-10-07T12:51:27Z)
• Transcending XAI Algorithm Boundaries through End-User-Inspired Design [27.864338632191608]
  Lacking explainability-focused functional support for end users may hinder the safe and responsible use of AI in high-stakes domains. Our work shows that grounding the technical problem in end users' use of XAI can inspire new research questions. Such end-user-inspired research questions have the potential to promote social good by democratizing AI and ensuring the responsible use of AI in critical domains.
  arXiv  Detail & Related papers  (2022-08-18T09:44:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.