TRACE: Training-time Report-guided and Clinically Ordered Concept Editing
- URL: http://arxiv.org/abs/2608.20809v1
- Date: Fri, 21 Aug 2026 07:26:39 GMT
- Title: TRACE: Training-time Report-guided and Clinically Ordered Concept Editing
- Abstract summary: We propose Training-time Report-guided and Clinically Ordered Concept Editing (TRACE)<n>TRACE refines image-derived concepts through a teacher-guided editing mechanism within a malignancy-aware ordered concept space.<n>We introduce Strategic Concept Missing Training (SCMT) and train an image-only self-editor via edit distillation for autonomous concept refinement.
- Score: 9.375094449682043
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Breast ultrasound diagnosis relies on clinically meaningful semantic concepts, yet most deep learning methods adopt end-to-end image-to-label paradigms that lack interpretability and robustness. While concept-based approaches offer a promising alternative, they often assume complete annotations or require multimodal inputs at inference, which significantly limits their real-world applicability. To tackle these issues, we propose Training-time Report-guided and Clinically Ordered Concept Editing (TRACE), a training-time report-guided framework that leverages structured radiology reports as privileged concept supervision while enabling image-only diagnosis at test time. TRACE refines image-derived concepts through a teacher-guided editing mechanism within a malignancy-aware ordered concept space. To address incomplete annotations, we introduce Strategic Concept Missing Training (SCMT) and train an image-only self-editor via edit distillation for autonomous concept refinement. Besides, we introduce BUSC, a concept-enriched benchmark linking images, labels, and structured attributes. Experiments across multiple datasets demonstrate that TRACE achieves superior performance and improved cross-domain robustness compared to existing methods.
Related papers
- Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation [66.62662330558906]
CORAL is a multimodal framework that integrates spatial grounding and concept-level supervision into a unified reasoning process.<n>CORAL employs a prompt-driven medical segmentation model to localize lesions and predicts multi-class clinical attributes through a Concept Bottleneck module.<n>Experiments on BUS-CoT and IU X-ray datasets demonstrate consistent improvements in diagnostic accuracy, concept consistency, and report quality over strong general-purpose and medical MLLMs.
arXiv Detail & Related papers (2026-09-14T10:21:23Z) - ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning [134.61875033137514]
Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding.<n>We formalize concept segmentation through a three-level taxonomy consisting of context-independent (CI), context-dependent (CD), and context-reasoning (CR) concepts.<n>We propose ConceptSeg-R1, a unified framework that reformulates concept segmentation as rule-induced concept grounding.
arXiv Detail & Related papers (2026-05-19T18:35:38Z) - DCG-Net: Dual Cross-Attention with Concept-Value Graph Reasoning for Interpretable Medical Diagnosis [14.035057926904559]
Concept Bottleneck Models (CBMs) structure predictions through human-interpretable clinical concepts.<n>Existing CBMs typically overlook the contextual dependencies among concepts.<n>We propose an end-to-end interpretable framework emphDCG-Net that integrates multimodal alignment with structured concept reasoning.
arXiv Detail & Related papers (2026-03-20T01:11:58Z) - SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysis [7.4746628878102195]
We introduce Concept CCA (CoCCA), a framework that aligns cross-modal embeddings while enabling interpretable concept decomposition.<n>We propose Sparse Concept CCA (SCoCCA), which enforces sparsity to produce more disentangled and discriminative concepts.<n>Our approach generalizes concept-based explanations to multi-modal embeddings and facilitates state-of-the-art performance in concept discovery.
arXiv Detail & Related papers (2026-03-14T10:45:59Z) - Beyond Heuristic Prompting: A Concept-Guided Bayesian Framework for Zero-Shot Image Recognition [81.2779530670268]
Vision-Language Models (VLMs) have significantly advanced zero-shot image recognition.<n>This paper enhances prompt by incorporating class-specific concepts.<n>Our method consistently outperforms state-of-the-art approaches.
arXiv Detail & Related papers (2026-03-09T03:11:11Z) - Training-Free Multi-Concept Image Editing [14.75123947134721]
Concept Distillation Sampling (CDS) is a training-free framework for target-less, multi-concept image editing.<n>It overcomes the linguistic bottleneck of previous methods by integrating a highly stable distillation backbone.<n>Our method preserves instance fidelity without requiring reference samples of the desired edit.
arXiv Detail & Related papers (2026-02-24T12:27:51Z) - CoPA: Hierarchical Concept Prompting and Aggregating Network for Explainable Diagnosis [8.56688324078793]
Concept Prompting and Aggregating (CoPA) is a novel framework designed to capture multilayer concepts under prompt guidance.<n>Visual representations from each layer are aggregated to align with textual concept representations.<n>CoPA outperforms state-of-the-art methods on three public datasets.
arXiv Detail & Related papers (2025-10-04T10:29:15Z) - Training-free Test-time Improvement for Explainable Medical Image Classification [11.320534249593171]
We propose a training-free confusion concept identification strategy for medical image classification.<n>Our approach enhances out-of-domain performance without sacrificing source domain accuracy.<n>Our method is validated on both skin and white blood cell images.
arXiv Detail & Related papers (2025-06-22T15:37:13Z) - Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts [79.18608192761512]
Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable.<n>We propose a Few-Shot Prototypical Concept Classification framework that mitigates two key challenges under low-data regimes: parametric imbalance and representation misalignment.<n>Our approach consistently outperforms existing SEMs by a notable margin, with 4.2%-8.7% relative gains in 5-way 5-shot classification.
arXiv Detail & Related papers (2025-06-05T06:39:43Z) - Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adapter [57.49476151976054]
We propose a tuning-free method for multi-concept personalization that can effectively customize both object and abstract concepts without test-time fine-tuning.<n>Our method achieves state-of-the-art performance in multi-concept personalization, supported by quantitative, qualitative, and human evaluations.
arXiv Detail & Related papers (2025-05-24T09:21:32Z) - Non-confusing Generation of Customized Concepts in Diffusion Models [135.4385383284657]
We tackle the common challenge of inter-concept visual confusion in compositional concept generation using text-guided diffusion models (TGDMs)
Existing customized generation methods only focus on fine-tuning the second stage while overlooking the first one.
We propose a simple yet effective solution called CLIF: contrastive image-language fine-tuning.
arXiv Detail & Related papers (2024-05-11T05:01:53Z) - Cross-Modal Conceptualization in Bottleneck Models [21.2577097041883]
Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts.
In our approach, we adopt a more moderate assumption and instead use text descriptions, accompanying the images in training, to guide the induction of concepts.
Our cross-modal approach treats concepts as discrete latent variables and promotes concepts that (1) are predictive of the label, and (2) can be predicted reliably from both the image and text.
arXiv Detail & Related papers (2023-10-23T11:00:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.