A comparative analysis of machine learning models in SHAP analysis

• URL: http://arxiv.org/abs/2604.07258v1
• Date: Wed, 08 Apr 2026 16:22:28 GMT
• Title: A comparative analysis of machine learning models in SHAP analysis
• Abstract summary: Large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex data patterns.<n>The deficiency of these methods is their inability to explain the prediction process, making them untrustworthy and their use precarious in high-stakes situations.<n>Shapley Additive exPlanations (SHAP) analysis is an explainable AI method growing in popularity for its ability to explain model predictions in terms of the original features.
• Score: 1.3965477771846408
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this growing age of data and technology, large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex data patterns. The deficiency of these methods, however, is their inability to explain the prediction process, making them untrustworthy and their use precarious in high-stakes situations. SHapley Additive exPlanations (SHAP) analysis is an explainable AI method growing in popularity for its ability to explain model predictions in terms of the original features. For each sample and feature in the data set, an associated SHAP value quantifies the contribution of that feature to the prediction of that sample. Analysis of these SHAP values provides valuable insight into the model's decision-making process, which can be leveraged to create data-driven solutions. The interpretation of these SHAP values, however, is model-dependent, so there does not exist a universal analysis procedure. To aid in these efforts, we present a detailed investigation of SHAP analysis across various machine learning models and data sets. In uncovering the details and nuance behind SHAP analysis, we hope to empower analysts in this less-explored territory. We also present a novel generalization of the waterfall plot to the multi-classification problem.

Related papers

• SHAPCA: Consistent and Interpretable Explanations for Machine Learning Models on Spectroscopy Data [3.6869511677142373]
  High dimensionality and strong collinearity of spectroscopy data pose a fundamental challenge to model explainability.<n>This study proposes SHAPCA, an explainable machine learning pipeline that combines Principal Component Analysis (for dimensionality reduction) and Shapely Additive exPlanations (for post hoc explanation)<n>The proposed framework enables analysis from both global and local perspectives, revealing the spectral bands that drive overall model behaviour.
  arXiv  Detail & Related papers  (2026-03-19T16:58:31Z)
• Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation [192.53529928861818]
  Learning with high-resource data has demonstrated substantial success in artificial intelligence (AI)<n>However, the costs associated with data annotation and model training remain significant.<n>This survey employs active sampling theory to analyze the generalization error and label complexity associated with learning from low-resource data.
  arXiv  Detail & Related papers  (2025-10-10T03:15:42Z)
• SHAP-Based Supervised Clustering for Sample Classification and the Generalized Waterfall Plot [1.3965477771846408]
  Large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex input-output relationships.<n>The deficiency of these methods is their inability to explain the prediction process, making them untrustworthy and their use precarious in high-stakes situations.<n>Shapley Additive exPlanations (SHAP) analysis is an explainable AI method growing in popularity for its ability to explain model predictions in terms of the original features.
  arXiv  Detail & Related papers  (2025-10-09T18:45:43Z)
• A Method for Evaluating the Interpretability of Machine Learning Models in Predicting Bond Default Risk Based on LIME and SHAP [7.7133862848321835]
  This paper uses bond market default prediction as a case study, applying commonly used machine learning algorithms within AI models.<n>The results of this analysis are consistent with the intuitive understanding and logical expectations regarding the interpretability of these models.
  arXiv  Detail & Related papers  (2025-02-26T23:05:34Z)
• A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops [55.07063067759609]
  High-quality data is essential for training large generative models, yet the vast reservoir of real data available online has become nearly depleted.<n>Models increasingly generate their own data for further training, forming Self-consuming Training Loops (STLs)<n>Some models degrade or even collapse, while others successfully avoid these failures, leaving a significant gap in theoretical understanding.
  arXiv  Detail & Related papers  (2025-02-26T06:18:13Z)
• On conditional diffusion models for PDE simulations [53.01911265639582]
  We study score-based diffusion models for forecasting and assimilation of sparse observations. We propose an autoregressive sampling approach that significantly improves performance in forecasting. We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
  arXiv  Detail & Related papers  (2024-10-21T18:31:04Z)
• rTisane: Externalizing conceptual models for data analysis increases engagement with domain knowledge and improves statistical model quality [11.156807472212165]
  Statistical models should accurately reflect analysts' domain knowledge about variables and their relationships. Recent tools let analysts express these assumptions and use them to produce a resulting statistical model. It remains unclear what analysts want to express and how externalization impacts statistical model quality.
  arXiv  Detail & Related papers  (2023-10-25T00:32:52Z)
• Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes [72.13373216644021]
  We study the societal impact of machine learning by considering the collection of models that are deployed in a given context. We find deployed machine learning is prone to systemic failure, meaning some users are exclusively misclassified by all models available. These examples demonstrate ecosystem-level analysis has unique strengths for characterizing the societal impact of machine learning.
  arXiv  Detail & Related papers  (2023-07-12T01:11:52Z)
• Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data [50.23363975709122]
  We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data. We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem. We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
  arXiv  Detail & Related papers  (2022-02-18T22:41:51Z)
• Shapley variable importance clouds for interpretable machine learning [2.830197032154301]
  We propose a Shapley variable importance cloud that pools information across good models to avoid biased assessments in SHAP analyses of final models. We demonstrate the additional insights gain compared to conventional explanations and Dong and Rudin's method using criminal justice and electronic medical records data.
  arXiv  Detail & Related papers  (2021-10-06T03:41:04Z)
• Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanations [64.85696493596821]
  In computer vision applications, generative counterfactual methods indicate how to perturb a model's input to change its prediction. We propose a counterfactual method that learns a perturbation in a disentangled latent space that is constrained using a diversity-enforcing loss. Our model improves the success rate of producing high-quality valuable explanations when compared to previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-03-18T12:57:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.