Boosting Ultrasound Image Classification via Attribute-Guided Dual-Branch Framework
- URL: http://arxiv.org/abs/2607.01648v1
- Date: Thu, 02 Jul 2026 03:20:12 GMT
- Title: Boosting Ultrasound Image Classification via Attribute-Guided Dual-Branch Framework
- Abstract summary: We propose an attribute-guided dual-branch framework for ultrasound classification that introduces domain-agnostic medical attribute priors.<n> Experiments across diverse ultrasound classification tasks demonstrate that our approach can be integrated into multiple backbones and state-of-the-art methods.
- Score: 41.7947778898157
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ultrasound image classification is essential for computer-aided diagnosis. However, current methods often neglect clinical priors, leading to poor generalization in challenging scenarios and a lack of interpretability that limits clinical adoption. To address these issues, we aim to develop a medical-prior module that can be seamlessly integrated into existing pipelines to enhance both diagnostic performance and interpretability. In this paper, we propose an attribute-guided dual-branch framework for ultrasound classification that introduces domain-agnostic medical attribute priors, improving generalization while offering interpretable evidence. Specifically, a baseline branch follows conventional architectures and predicts image categories via a fully connected classifier. An attribute-guided branch injects domain-agnostic attributes as priors and produces human-interpretable decision cues. Finally, an adaptive decision module fuses the two branches in a data-dependent manner to yield the final prediction. Experiments across diverse ultrasound classification tasks demonstrate that our approach can be integrated into multiple backbones and state-of-the-art methods with low overhead, consistently improving accuracy and interpretability. Code is available at: https://github.com/zhaobo253-crypto/AttrGuide.
Related papers
- The Latent Diagnostic Taxonomy: A Framework for Constructing Classifiers and Diagnosing Their Decisions, Applied to Prompt Injection Detection [0.0]
This paper proposes a framework for constructing a classifier as a safeguard layer, and for developing a complementary diagnostic.<n>Applying the framework to a public prompt injection dataset, we find that a substantial fraction of its confident decisions are not robust to removing a single token.<n>For each zone of the taxonomy, we also recommend strategies for remediating diagnosed prompts.
arXiv Detail & Related papers (2026-08-26T21:55:15Z) - Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation [76.6507710204181]
We present Echo-, an agentic multimodal reasoning model for ultrasound interpretation.<n> Echo- is trained to coordinate organ-specific detector outputs, integrate them with global visual context, and convert the resulting evidence into grounded diagnostic decisions.<n>Results suggest that agentic multimodal reasoning can turn specialized detectors into verifiable clinical evidence.
arXiv Detail & Related papers (2026-04-30T15:31:00Z) - From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentation [58.93075548229873]
We propose an Adaptive Prompt EXtraction framework that retrieves input-specific prompts from a learnable prompt memory.<n>The memory stores diverse, domain-discriminative prompt representations and is queried via domain features extracted from the Fourier spectrum.<n>Experiments on two medical segmentation tasks demonstrate that APEX significantly improves generalization across both seen and unseen domains.
arXiv Detail & Related papers (2026-04-19T14:14:10Z) - SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation [12.0982298854338]
Continual Test-Time Adaptation (CTTA) aims to enable pre-trained models to adapt to continuously changing unlabeled domains.<n>We propose a CTTA via Semantic-Prompt-Enhanced Graph Clustering (SPEGC) for medical image segmentation.
arXiv Detail & Related papers (2026-03-12T03:22:43Z) - UltrasoundAgents: Hierarchical Multi-Agent Evidence-Chain Reasoning for Breast Ultrasound Diagnosis [14.027321451902734]
We propose a hierarchical multi-agent framework, termed UltrasoundAgents.<n>A main agent localizes the lesion in the full image and triggers a crop-and-zoom operation.<n>A sub-agent analyzes the local view and predicts four clinically relevant attributes, namely echogenicity pattern, calcification, boundary type, and edge morphology.<n>The main agent then integrates these structured attributes to perform evidence-based reasoning and output the BI-RADS category and the malignancy prediction, while producing reviewable intermediate evidence.
arXiv Detail & Related papers (2026-03-11T15:03:52Z) - RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis [56.373297358647655]
Retrieval-Augmented Diagnosis (RAD) is a novel framework that injects external knowledge into multimodal models directly on downstream tasks.<n>RAD operates through three key mechanisms: retrieval and refinement of disease-centered knowledge from multiple medical sources, a guideline-enhanced contrastive loss transformer, and a dual decoder.
arXiv Detail & Related papers (2025-09-24T10:36:14Z) - MedVQA-TREE: A Multimodal Reasoning and Retrieval Framework for Sarcopenia Prediction [1.7775777785480917]
We propose MedVQA-TREE, a framework that integrates a hierarchical image interpretation module, a gated feature-level fusion mechanism, and a novel multi-hop, multi-query retrieval strategy.<n>A gated fusion mechanism selectively integrates visual features with textual queries, while clinical knowledge is retrieved through a UMLS-guided pipeline accessing PubMed and a sarcopenia-specific external knowledge base.<n>The model achieved up to 99% diagnostic accuracy and outperformed previous state-of-the-art methods by over 10%.
arXiv Detail & Related papers (2025-08-26T13:31:01Z) - Adversarial Hospital-Invariant Feature Learning for WSI Patch Classification [1.3955246652599635]
We present the first systematic study of domain bias in pathology foundation models (PFMs) arising from hospital source characteristics.<n>We propose a lightweight adversarial framework that removes latent hospital-specific features from frozen representations without modifying the encoder itself.
arXiv Detail & Related papers (2025-08-20T15:25:16Z) - Faithful, Interpretable Chest X-ray Diagnosis with Anti-Aliased B-cos Networks [13.303234049048426]
B-cos networks offer a promising solution by replacing standard linear layers with a weight-input alignment mechanism.<n>Standard B-cos models suffer from severe aliasing artifacts in their explanation maps, making them unsuitable for clinical use.<n>We introduce anti-aliasing strategies using FLC and BlurPool to significantly improve explanation quality.
arXiv Detail & Related papers (2025-07-22T16:56:02Z) - Domain Generalization for Medical Imaging Classification with
Linear-Dependency Regularization [59.5104563755095]
We introduce a simple but effective approach to improve the generalization capability of deep neural networks in the field of medical imaging classification.
Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a representative feature space through variational encoding.
arXiv Detail & Related papers (2020-09-27T12:30:30Z) - Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis [102.40869566439514]
We seek to exploit rich labeled data from relevant domains to help the learning in the target task via Unsupervised Domain Adaptation (UDA)
Unlike most UDA methods that rely on clean labeled data or assume samples are equally transferable, we innovatively propose a Collaborative Unsupervised Domain Adaptation algorithm.
We theoretically analyze the generalization performance of the proposed method, and also empirically evaluate it on both medical and general images.
arXiv Detail & Related papers (2020-07-05T11:49:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.