Evolutionary Computation and Explainable AI: A Roadmap to Transparent Intelligent Systems

• URL: http://arxiv.org/abs/2406.07811v1
• Date: Wed, 12 Jun 2024 02:06:24 GMT
• Title: Evolutionary Computation and Explainable AI: A Roadmap to Transparent Intelligent Systems
• Authors: Ryan Zhou, Jaume Bacardit, Alexander Brownlee, Stefano Cagnoni, Martin Fyvie, Giovanni Iacca, John McCall, Niki van Stein, David Walker, Ting Hu,
• Abstract summary: We provide an introduction to explainable artificial intelligence (XAI) and review various techniques in current use for explaining machine learning (ML) models. We then focus on how EC can be used in XAI, and review some XAI approaches which incorporate EC techniques.
• Score: 37.02462866600066
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: AI methods are finding an increasing number of applications, but their often black-box nature has raised concerns about accountability and trust. The field of explainable artificial intelligence (XAI) has emerged in response to the need for human understanding of AI models. Evolutionary computation (EC), as a family of powerful optimization and learning tools, has significant potential to contribute to XAI. In this paper, we provide an introduction to XAI and review various techniques in current use for explaining machine learning (ML) models. We then focus on how EC can be used in XAI, and review some XAI approaches which incorporate EC techniques. Additionally, we discuss the application of XAI principles within EC itself, examining how these principles can shed some light on the behavior and outcomes of EC algorithms in general, on the (automatic) configuration of these algorithms, and on the underlying problem landscapes that these algorithms optimize. Finally, we discuss some open challenges in XAI and opportunities for future research in this field using EC. Our aim is to demonstrate that EC is well-suited for addressing current problems in explainability and to encourage further exploration of these methods to contribute to the development of more transparent and trustworthy ML models and EC algorithms.

Related papers

• Applications of Explainable artificial intelligence in Earth system science [12.454478986296152]
  This review aims to provide a foundational understanding of explainable AI (XAI) XAI offers a set of powerful tools that make the models more transparent. We identify four significant challenges that XAI faces within the Earth system science (ESS) A visionary outlook for ESS envisions a harmonious blend where process-based models govern the known, AI models explore the unknown, and XAI bridges the gap by providing explanations.
  arXiv  Detail & Related papers  (2024-06-12T15:05:29Z)
• Toward enriched Cognitive Learning with XAI [44.99833362998488]
  We introduce an intelligent system (CL-XAI) for Cognitive Learning which is supported by artificial intelligence (AI) tools. The use of CL-XAI is illustrated with a game-inspired virtual use case where learners tackle problems to enhance problem-solving skills.
  arXiv  Detail & Related papers  (2023-12-19T16:13:47Z)
• Evolutionary approaches to explainable machine learning [6.274453963224799]
  Machine learning models are increasingly being used in critical sectors, but their black-box nature has raised concerns about accountability and trust. The field of explainable artificial intelligence (XAI) or explainable machine learning (XML) has emerged in response to the need for human understanding of these models. Evolutionary computing, as a family of powerful optimization and learning tools, has significant potential to contribute to XAI/XML.
  arXiv  Detail & Related papers  (2023-06-23T16:47:49Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• Towards Human Cognition Level-based Experiment Design for Counterfactual Explanations (XAI) [68.8204255655161]
  The emphasis of XAI research appears to have turned to a more pragmatic explanation approach for better understanding. An extensive area where cognitive science research may substantially influence XAI advancements is evaluating user knowledge and feedback. We propose a framework to experiment with generating and evaluating the explanations on the grounds of different cognitive levels of understanding.
  arXiv  Detail & Related papers  (2022-10-31T19:20:22Z)
• Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI [65.44737844681256]
  A lack of consensus on how to evaluate explainable AI (XAI) hinders the advancement of the field. We argue that one way to close the gap is to develop evaluation methods that account for different user requirements.
  arXiv  Detail & Related papers  (2022-06-22T05:17:33Z)
• Human-Centered Explainable AI (XAI): From Algorithms to User Experiences [29.10123472973571]
  explainable AI (XAI) has produced a vast collection of algorithms in recent years. The field is starting to embrace inter-disciplinary perspectives and human-centered approaches.
  arXiv  Detail & Related papers  (2021-10-20T21:33:46Z)
• An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit-risk assessment practices: Towards a comprehensive qualification matrix of AI programs and devices (pre-print 2020) [55.41644538483948]
  This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems.
  arXiv  Detail & Related papers  (2021-05-07T12:01:31Z)
• Explainable Artificial Intelligence (XAI): An Engineering Perspective [0.0]
  XAI is a set of techniques and methods to convert the so-called black-box AI algorithms to white-box algorithms. We discuss the stakeholders in XAI and describe the mathematical contours of XAI from engineering perspective. This work is an exploratory study to identify new avenues of research in the field of XAI.
  arXiv  Detail & Related papers  (2021-01-10T19:49:12Z)
• Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey [2.7086321720578623]
  Black-box nature of deep neural networks challenges its use in mission critical applications. XAI promotes a set of tools, techniques, and algorithms that can generate high-quality interpretable, intuitive, human-understandable explanations of AI decisions.
  arXiv  Detail & Related papers  (2020-06-16T02:58:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.