Towards a Transparent and Interpretable AI Model for Medical Image Classifications

• URL: http://arxiv.org/abs/2509.16685v1
• Date: Sat, 20 Sep 2025 13:26:31 GMT
• Title: Towards a Transparent and Interpretable AI Model for Medical Image Classifications
• Authors: Binbin Wen, Yihang Wu, Tareef Daqqaq, Ahmad Chaddad,
• Abstract summary: This paper focuses on investigating the application of explainable artificial intelligence (XAI) methods.<n>Our research focuses on implementing simulations using various medical datasets to elucidate the internal workings of the XAI model.<n>In addition to a survey of the main XAI methods and simulations, ongoing challenges in the XAI field are discussed.
• Score: 5.574793555270349
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The integration of artificial intelligence (AI) into medicine is remarkable, offering advanced diagnostic and therapeutic possibilities. However, the inherent opacity of complex AI models presents significant challenges to their clinical practicality. This paper focuses primarily on investigating the application of explainable artificial intelligence (XAI) methods, with the aim of making AI decisions transparent and interpretable. Our research focuses on implementing simulations using various medical datasets to elucidate the internal workings of the XAI model. These dataset-driven simulations demonstrate how XAI effectively interprets AI predictions, thus improving the decision-making process for healthcare professionals. In addition to a survey of the main XAI methods and simulations, ongoing challenges in the XAI field are discussed. The study highlights the need for the continuous development and exploration of XAI, particularly from the perspective of diverse medical datasets, to promote its adoption and effectiveness in the healthcare domain.

Related papers

• Beyond Explainable AI (XAI): An Overdue Paradigm Shift and Post-XAI Research Directions [95.59915390053588]
  This study focuses on Explainable Artificial Intelligence (XAI) approaches-focusing on deep neural networks (DNNs) and large language models (LLMs)<n>We discuss critical symptoms that stem from deeper root causes (i.e., two paradoxes, two conceptual confusions, and five false assumptions)<n>To move beyond XAI's limitations, we propose a four-pronged paradigm shift toward reliable and certified AI development.
  arXiv  Detail & Related papers  (2026-02-27T16:58:27Z)
• Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios [46.729092855387165]
  We study the choice of the backbone LLM for medical AI agents, which is the foundation for the agent's overall reasoning and action generation.<n>Our findings demonstrate o1's ability to enhance diagnostic accuracy and consistency, paving the way for smarter, more responsive AI tools.
  arXiv  Detail & Related papers  (2024-11-16T18:19:53Z)
• Explainable Artificial Intelligence for Medical Applications: A Review [42.33274794442013]
  This article reviews recent research grounded in explainable artificial intelligence (XAI)<n>It focuses on medical practices within the visual, audio, and multimodal perspectives.<n>We endeavour to categorise and synthesise these practices, aiming to provide support and guidance for future researchers and healthcare professionals.
  arXiv  Detail & Related papers  (2024-11-15T11:31:06Z)
• Breast Cancer Diagnosis: A Comprehensive Exploration of Explainable Artificial Intelligence (XAI) Techniques [37.9243470221619]
  Article explores the application of Explainable Artificial Intelligence (XAI) techniques in the detection and diagnosis of breast cancer.<n>Aims to highlight the potential of XAI in bridging the gap between complex AI models and practical healthcare applications.
  arXiv  Detail & Related papers  (2024-06-01T18:50:03Z)
• A Survey of Artificial Intelligence in Gait-Based Neurodegenerative Disease Diagnosis [51.07114445705692]
  neurodegenerative diseases (NDs) traditionally require extensive healthcare resources and human effort for medical diagnosis and monitoring.<n>As a crucial disease-related motor symptom, human gait can be exploited to characterize different NDs.<n>The current advances in artificial intelligence (AI) models enable automatic gait analysis for NDs identification and classification.
  arXiv  Detail & Related papers  (2024-05-21T06:44:40Z)
• Enhancing Breast Cancer Diagnosis in Mammography: Evaluation and Integration of Convolutional Neural Networks and Explainable AI [0.0]
  The study presents an integrated framework combining Convolutional Neural Networks (CNNs) and Explainable Artificial Intelligence (XAI) for the enhanced diagnosis of breast cancer. The methodology encompasses an elaborate data preprocessing pipeline and advanced data augmentation techniques to counteract dataset limitations. A focal point of our study is the evaluation of XAI's effectiveness in interpreting model predictions.
  arXiv  Detail & Related papers  (2024-04-05T05:00:21Z)
• How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey [48.97104365617498]
  The emerging area of em Explainable Interfaces (EIs) focuses on the user interface and user experience design aspects of XAI. This paper presents a systematic survey of 53 publications to identify current trends in human-XAI interaction and promising directions for EI design and development.
  arXiv  Detail & Related papers  (2024-03-21T15:44:56Z)
• From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality? [8.423877102146433]
  "eXplainable and Interpretable Artificial Intelligence" (XIAI) is introduced to distinguish XAI from IAI. Our analysis shows that attention mechanisms are the most prevalent emerging IAI technique. The major challenges identified are that most XIAI does not explore "global" modelling processes, the lack of best practices, and the lack of systematic evaluation and benchmarks.
  arXiv  Detail & Related papers  (2024-03-18T15:53:33Z)
• An Explainable AI Framework for Artificial Intelligence of Medical Things [2.7774194651211217]
  We leverage a custom XAI framework, incorporating techniques such as Local Interpretable Model-Agnostic Explanations (LIME), SHapley Additive exPlanations (SHAP), and Gradient-weighted Class Activation Mapping (Grad-Cam) The proposed framework enhances the effectiveness of strategic healthcare methods and aims to instill trust and promote understanding in AI-driven medical applications. We apply the XAI framework to brain tumor detection as a use case demonstrating accurate and transparent diagnosis.
  arXiv  Detail & Related papers  (2024-03-07T01:08:41Z)
• A Brief Review of Explainable Artificial Intelligence in Healthcare [7.844015105790313]
  XAI refers to the techniques and methods for building AI applications. Model explainability and interpretability are vital successful deployment of AI models in healthcare practices.
  arXiv  Detail & Related papers  (2023-04-04T05:41:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.