Joint localization and classification of breast tumors on ultrasound
images using a novel auxiliary attention-based framework
- URL: http://arxiv.org/abs/2210.05762v1
- Date: Tue, 11 Oct 2022 20:14:13 GMT
- Title: Joint localization and classification of breast tumors on ultrasound
images using a novel auxiliary attention-based framework
- Authors: Zong Fan, Ping Gong, Shanshan Tang, Christine U. Lee, Xiaohui Zhang,
Pengfei Song, Shigao Chen, Hua Li
- Abstract summary: We propose a novel joint localization and classification model based on the attention mechanism and disentangled semi-supervised learning strategy.
The proposed modularized framework allows flexible network replacement to be generalized for various applications.
- Score: 7.6620616780444974
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic breast lesion detection and classification is an important task in
computer-aided diagnosis, in which breast ultrasound (BUS) imaging is a common
and frequently used screening tool. Recently, a number of deep learning-based
methods have been proposed for joint localization and classification of breast
lesions using BUS images. In these methods, features extracted by a shared
network trunk are appended by two independent network branches to achieve
classification and localization. Improper information sharing might cause
conflicts in feature optimization in the two branches and leads to performance
degradation. Also, these methods generally require large amounts of pixel-level
annotated data for model training. To overcome these limitations, we proposed a
novel joint localization and classification model based on the attention
mechanism and disentangled semi-supervised learning strategy. The model used in
this study is composed of a classification network and an auxiliary
lesion-aware network. By use of the attention mechanism, the auxiliary
lesion-aware network can optimize multi-scale intermediate feature maps and
extract rich semantic information to improve classification and localization
performance. The disentangled semi-supervised learning strategy only requires
incomplete training datasets for model training. The proposed modularized
framework allows flexible network replacement to be generalized for various
applications. Experimental results on two different breast ultrasound image
datasets demonstrate the effectiveness of the proposed method. The impacts of
various network factors on model performance are also investigated to gain deep
insights into the designed framework.
Related papers
- Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learning [1.4053129774629076]
This study presents an unsupervised domain adaptation method aimed at autonomously generating image masks outlining regions of interest (ROIs) for differentiating breast lesions in breast ultrasound (US) imaging.
Our semi-supervised learning approach utilizes a primitive model trained on a small public breast US dataset with true annotations.
This model is then iteratively refined for the domain adaptation task, generating pseudo-masks for our private, unannotated breast US dataset.
arXiv Detail & Related papers (2024-04-18T18:25:00Z) - Augmentation is AUtO-Net: Augmentation-Driven Contrastive Multiview
Learning for Medical Image Segmentation [3.1002416427168304]
This thesis focuses on retinal blood vessel segmentation tasks.
It provides an extensive literature review of deep learning-based medical image segmentation approaches.
It proposes a novel efficient, simple multiview learning framework.
arXiv Detail & Related papers (2023-11-02T06:31:08Z) - Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions.
We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training.
Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
arXiv Detail & Related papers (2023-10-22T02:27:02Z) - Causality-Driven One-Shot Learning for Prostate Cancer Grading from MRI [1.049712834719005]
We present a novel method to automatically classify medical images that learns and leverages weak causal signals in the image.
Our framework consists of a convolutional neural network backbone and a causality-extractor module.
Our findings show that causal relationships among features play a crucial role in enhancing the model's ability to discern relevant information.
arXiv Detail & Related papers (2023-09-19T16:08:33Z) - A novel adversarial learning strategy for medical image classification [9.253330143870427]
auxiliary convolutional neural networks (AuxCNNs) have been employed on top of traditional classification networks to facilitate the training of intermediate layers.
In this study, we proposed an adversarial learning-based AuxCNN to support the training of deep neural networks for medical image classification.
arXiv Detail & Related papers (2022-06-23T06:57:17Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - Anomaly Detection on Attributed Networks via Contrastive Self-Supervised
Learning [50.24174211654775]
We present a novel contrastive self-supervised learning framework for anomaly detection on attributed networks.
Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair.
A graph neural network-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure.
arXiv Detail & Related papers (2021-02-27T03:17:20Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - Attention Model Enhanced Network for Classification of Breast Cancer
Image [54.83246945407568]
AMEN is formulated in a multi-branch fashion with pixel-wised attention model and classification submodular.
To focus more on subtle detail information, the sample image is enhanced by the pixel-wised attention map generated from former branch.
Experiments conducted on three benchmark datasets demonstrate the superiority of the proposed method under various scenarios.
arXiv Detail & Related papers (2020-10-07T08:44:21Z) - ReMarNet: Conjoint Relation and Margin Learning for Small-Sample Image
Classification [49.87503122462432]
We introduce a novel neural network termed Relation-and-Margin learning Network (ReMarNet)
Our method assembles two networks of different backbones so as to learn the features that can perform excellently in both of the aforementioned two classification mechanisms.
Experiments on four image datasets demonstrate that our approach is effective in learning discriminative features from a small set of labeled samples.
arXiv Detail & Related papers (2020-06-27T13:50:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.