A region and category confidence-based multi-task network for carotid ultrasound image segmentation and classification

• URL: http://arxiv.org/abs/2307.00583v2
• Date: Sun, 19 Nov 2023 03:59:17 GMT
• Title: A region and category confidence-based multi-task network for carotid ultrasound image segmentation and classification
• Authors: Haitao Gan and Ran Zhou and Yanghan Ou and Furong Wang and Xinyao Cheng and Aaron Fenster
• Abstract summary: We propose a multi-task learning framework (RCCM-Net) for ultrasound carotid plaque segmentation and classification. The framework uses a region confidence module (RCM) and a sample category confidence module ( CCM) to exploit the correlation between these two tasks. The results show that the proposed method can improve both segmentation and classification performance compared to existing single-task networks.
• Score: 6.162577404860473
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The segmentation and classification of carotid plaques in ultrasound images play important roles in the treatment of atherosclerosis and assessment for the risk of stroke. Although deep learning methods have been used for carotid plaque segmentation and classification, two-stage methods will increase the complexity of the overall analysis and the existing multi-task methods ignored the relationship between the segmentation and classification. These will lead to suboptimal performance as valuable information might not be fully leveraged across all tasks. Therefore, we propose a multi-task learning framework (RCCM-Net) for ultrasound carotid plaque segmentation and classification, which utilizes a region confidence module (RCM) and a sample category confidence module (CCM) to exploit the correlation between these two tasks. The RCM provides knowledge from the probability of plaque regions to the classification task, while the CCM is designed to learn the categorical sample weight for the segmentation task. A total of 1270 2D ultrasound images of carotid plaques were collected from Zhongnan Hospital (Wuhan, China) for our experiments. The results showed that the proposed method can improve both segmentation and classification performance compared to existing single-task networks (i.e., SegNet, Deeplabv3+, UNet++, EfficientNet, Res2Net, RepVGG, DPN) and multi-task algorithms (i.e., HRNet, MTANet), with an accuracy of 85.82% for classification and a Dice-similarity-coefficient of 84.92% for segmentation. In the ablation study, the results demonstrated that both the designed RCM and CCM were beneficial in improving the network's performance. Therefore, we believe that the proposed method could be useful for carotid plaque analysis in clinical trials and practice.

Related papers

• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images [0.0]
  This work presents a weakly supervised approach to segment anomalies in 2D magnetic resonance images. We train a generative adversarial network (GAN) that converts cancerous images to healthy variants. Non-cancerous variants can also be used to evaluate the segmentations in a weakly supervised fashion.
  arXiv  Detail & Related papers  (2022-11-10T00:04:46Z)
• PCA: Semi-supervised Segmentation with Patch Confidence Adversarial Training [52.895952593202054]
  We propose a new semi-supervised adversarial method called Patch Confidence Adrial Training (PCA) for medical image segmentation. PCA learns the pixel structure and context information in each patch to get enough gradient feedback, which aids the discriminator in convergent to an optimal state. Our method outperforms the state-of-the-art semi-supervised methods, which demonstrates its effectiveness for medical image segmentation.
  arXiv  Detail & Related papers  (2022-07-24T07:45:47Z)
• Improving Classification Model Performance on Chest X-Rays through Lung Segmentation [63.45024974079371]
  We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations. Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
  arXiv  Detail & Related papers  (2022-02-22T15:24:06Z)
• Improved AI-based segmentation of apical and basal slices from clinical cine CMR [1.7647111545685723]
  We aim to investigate the performance of AI algorithms in segmenting basal and apical slices. We trained all our models on a large dataset of clinical CMR studies obtained from two NHS hospitals. We show that the classification and segmentation approach was best at reducing the performance gap across all datasets.
  arXiv  Detail & Related papers  (2021-09-20T10:48:50Z)
• Learning Fuzzy Clustering for SPECT/CT Segmentation via Convolutional Neural Networks [5.3123694982708365]
  Quantitative bone single-photon emission computed tomography (QBSPECT) has the potential to provide a better quantitative assessment of bone metastasis than planar bone scintigraphy. The segmentation of anatomical regions-of-interests (ROIs) still relies heavily on the manual delineation by experts. This work proposes a fast and robust automated segmentation method for partitioning a QBSPECT image into lesion, bone, and background.
  arXiv  Detail & Related papers  (2021-04-17T19:03:52Z)
• Brain Stroke Lesion Segmentation Using Consistent Perception Generative Adversarial Network [22.444373004248217]
  Consistent PerceptionGenerative Adversarial Network (CPGAN) is proposed for semi-supervised stroke lesion segmentation. A similarity connection module (SCM) is designed to capture the information of multi-scale features. An assistant network is constructed to encourage the discriminator to learn meaningful feature representations.
  arXiv  Detail & Related papers  (2020-08-30T07:42:47Z)
• Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification [49.64863177155927]
  We propose a multi-task deep neural network with spatial activation mechanism to segment full retinal vessel, artery and vein simultaneously. The proposed network achieves pixel-wise accuracy of 95.70% for vessel segmentation, and A/V classification accuracy of 94.50%, which is the state-of-the-art performance for both tasks.
  arXiv  Detail & Related papers  (2020-07-18T05:46:47Z)
• VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images [121.31355003451152]
  Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020. We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
  arXiv  Detail & Related papers  (2020-01-24T21:09:18Z)
• Spinal Metastases Segmentation in MR Imaging using Deep Convolutional Neural Networks [0.0]
  This study's objective was to segment spinal metastases in diagnostic MR images using a deep learning-based approach. We used a U-Net like architecture trained with 40 clinical cases including both, lytic and sclerotic lesion types and various MR sequences. Compared to expertly annotated lesion segmentations, the experiments yielded promising results with average Dice scores up to 77.6% and mean sensitivity rates up to 78.9%.
  arXiv  Detail & Related papers  (2020-01-08T10:59:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.