WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classification

• URL: http://arxiv.org/abs/2603.18752v1
• Date: Thu, 19 Mar 2026 10:57:44 GMT
• Title: WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classification
• Abstract summary: We propose WeNLEX, a weakly supervised model for the generation of natural language explanations for multilabel chest X-ray classification.<n>We empirically demonstrate, through extensive validation on multiple metrics, that WeNLEX is able to produce faithful and plausible explanations.
• Score: 4.164071305580104
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Natural language explanations provide an inherently human-understandable way to explain black-box models, closely reflecting how radiologists convey their diagnoses in textual reports. Most works explicitly supervise the explanation generation process using datasets annotated with explanations. Thus, though plausible, the generated explanations are not faithful to the model's reasoning. In this work, we propose WeNLEX, a weakly supervised model for the generation of natural language explanations for multilabel chest X-ray classification. Faithfulness is ensured by matching images generated from their corresponding natural language explanations with original images, in the black-box model's feature space. Plausibility is maintained via distribution alignment with a small database of clinician-annotated explanations. We empirically demonstrate, through extensive validation on multiple metrics to assess faithfulness, simulatability, diversity, and plausibility, that WeNLEX is able to produce faithful and plausible explanations, using as little as 5 ground-truth explanations per diagnosis. Furthermore, WeNLEX can operate in both post-hoc and in-model settings. In the latter, i.e., when the multilabel classifier is trained together with the rest of the network, WeNLEX improves the classification AUC of the standalone classifier by 2.21%, thus showing that adding interpretability to the training process can actually increase the downstream task performance. Additionally, simply by changing the database, WeNLEX explanations are adaptable to any target audience, and we showcase this flexibility by training a layman version of WeNLEX, where explanations are simplified for non-medical users.

Related papers

• XAI-Grounded Explanation Generation for Speech Deepfake Detection with Training-Free Multimodal Large Language Models [48.03852608747844]
  Speech deepfake detection (SDD) systems require trustworthy explanations for reliable decision-making.<n>Traditional explainable AI (XAI) produces low-level attribution signals tightly coupled with model decisions.<n>Large language model (LLM)-based explanation generation produces generic and ungrounded descriptions.
  arXiv  Detail & Related papers  (2026-06-15T02:55:21Z)
• DEXTER: Diffusion-Guided EXplanations with TExtual Reasoning for Vision Models [49.25757423776323]
  DEXTER is a data-free framework that generates global, textual explanations of visual classifiers.<n>We show that DEXTER produces accurate, interpretable outputs.<n> Experiments on ImageNet, Waterbirds, CelebA, and FairFaces confirm that DEXTER outperforms existing approaches in global model explanation and class-level bias reporting.
  arXiv  Detail & Related papers  (2025-10-16T14:43:25Z)
• Pairwise Matching of Intermediate Representations for Fine-grained Explainability [7.415710605852485]
  We propose a new explainability method (PAIR-X) that generates fine-grained, highly-localized pairwise visual explanations.<n>By improving interpretability, PAIR-X enables humans to better distinguish correct and incorrect matches.
  arXiv  Detail & Related papers  (2025-03-28T21:13:43Z)
• Graph-Guided Textual Explanation Generation Framework [57.2027753204786]
  Natural language explanations (NLEs) are commonly used to provide plausible free-text explanations of a model's reasoning about its predictions.<n>We propose G-Tex, a Graph-Guided Textual Explanation Generation framework designed to enhance the faithfulness of NLEs.
  arXiv  Detail & Related papers  (2024-12-16T19:35:55Z)
• Explanation sensitivity to the randomness of large language models: the case of journalistic text classification [6.240875403446504]
  We study the effect of random elements in the training of large language models on the explainability of their predictions. Using a fine-tuned CamemBERT model and an explanation method based on relevance propagation, we find that training with different random seeds produces models with similar accuracy but variable explanations.
  arXiv  Detail & Related papers  (2024-10-07T14:39:45Z)
• Contrastive Learning with Counterfactual Explanations for Radiology Report Generation [83.30609465252441]
  We propose a textbfCountertextbfFactual textbfExplanations-based framework (CoFE) for radiology report generation. Counterfactual explanations serve as a potent tool for understanding how decisions made by algorithms can be changed by asking what if'' scenarios. Experiments on two benchmarks demonstrate that leveraging the counterfactual explanations enables CoFE to generate semantically coherent and factually complete reports.
  arXiv  Detail & Related papers  (2024-07-19T17:24:25Z)
• Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA [7.141288053123662]
  Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing post-hoc explanations are not always aligned with human logical inference, suffering from the issues on: 1) Deductive unsatisfiability, the generated explanations do not logically lead to the answer; 2) Factual inconsistency, the model falsifies its counterfactual explanation for answers without considering the facts in images; and 3) Semantic perturbation insensitivity, the model can not recognize the semantic changes caused by small perturbations
  arXiv  Detail & Related papers  (2023-12-21T05:51:55Z)
• Explanation Selection Using Unlabeled Data for Chain-of-Thought Prompting [80.9896041501715]
  Explanations that have not been "tuned" for a task, such as off-the-shelf explanations written by nonexperts, may lead to mediocre performance. This paper tackles the problem of how to optimize explanation-infused prompts in a blackbox fashion.
  arXiv  Detail & Related papers  (2023-02-09T18:02:34Z)
• LIREx: Augmenting Language Inference with Relevant Explanation [1.4780878458667916]
  Natural language explanations (NLEs) are a form of data annotation in which annotators identify rationales when assigning labels to data instances. NLEs have been shown to capture human reasoning better, but not as beneficial for natural language inference. We propose a novel framework, LIREx, that incorporates both a rationale-enabled explanation generator and an instance selector to select only relevant NLEs.
  arXiv  Detail & Related papers  (2020-12-16T18:49:29Z)
• Towards Interpretable Natural Language Understanding with Explanations as Latent Variables [146.83882632854485]
  We develop a framework for interpretable natural language understanding that requires only a small set of human annotated explanations for training. Our framework treats natural language explanations as latent variables that model the underlying reasoning process of a neural model.
  arXiv  Detail & Related papers  (2020-10-24T02:05:56Z)
• Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language? [86.60613602337246]
  We introduce a leakage-adjusted simulatability (LAS) metric for evaluating NL explanations. LAS measures how well explanations help an observer predict a model's output, while controlling for how explanations can directly leak the output. We frame explanation generation as a multi-agent game and optimize explanations for simulatability while penalizing label leakage.
  arXiv  Detail & Related papers  (2020-10-08T16:59:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.