Key-frame Guided Network for Thyroid Nodule Recognition using Ultrasound Videos

• URL: http://arxiv.org/abs/2206.13318v3
• Date: Thu, 30 Jun 2022 04:01:12 GMT
• Title: Key-frame Guided Network for Thyroid Nodule Recognition using Ultrasound Videos
• Authors: Yuchen Wang, Zhongyu Li, Xiangxiang Cui, Liangliang Zhang, Xiang Luo, Meng Yang, and Shi Chang
• Abstract summary: This paper proposes a novel method for the automated recognition of thyroid nodules through an exploration of ultrasound videos and key-frames. We first propose a detection-localization framework to automatically identify the clinical key-frame with a typical nodule in each ultrasound video. Based on the localized key-frame, we develop a key-frame guided video classification model for thyroid recognition.
• Score: 13.765306481109988
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Ultrasound examination is widely used in the clinical diagnosis of thyroid nodules (benign/malignant). However, the accuracy relies heavily on radiologist experience. Although deep learning techniques have been investigated for thyroid nodules recognition. Current solutions are mainly based on static ultrasound images, with limited temporal information used and inconsistent with clinical diagnosis. This paper proposes a novel method for the automated recognition of thyroid nodules through an exhaustive exploration of ultrasound videos and key-frames. We first propose a detection-localization framework to automatically identify the clinical key-frame with a typical nodule in each ultrasound video. Based on the localized key-frame, we develop a key-frame guided video classification model for thyroid nodule recognition. Besides, we introduce a motion attention module to help the network focus on significant frames in an ultrasound video, which is consistent with clinical diagnosis. The proposed thyroid nodule recognition framework is validated on clinically collected ultrasound videos, demonstrating superior performance compared with other state-of-the-art methods.

Related papers

• Privacy-Preserving Federated Foundation Model for Generalist Ultrasound Artificial Intelligence [83.02106623401885]
  We present UltraFedFM, an innovative privacy-preserving ultrasound foundation model. UltraFedFM is collaboratively pre-trained using federated learning across 16 distributed medical institutions in 9 countries. It achieves an average area under the receiver operating characteristic curve of 0.927 for disease diagnosis and a dice similarity coefficient of 0.878 for lesion segmentation.
  arXiv  Detail & Related papers  (2024-11-25T13:40:11Z)
• Generative Adversarial Networks in Ultrasound Imaging: Extending Field of View Beyond Conventional Limits [1.6588671405657123]
  TTE ultrasound imaging faces inherent limitations, notably the trade-off between field of view (FoV) and resolution. This paper introduces a novel application of conditional Generative Adversarial Networks (cGANs) Our proposed cGAN architecture, termed echoGAN, demonstrates the capability to generate realistic anatomical structures through outpainting.
  arXiv  Detail & Related papers  (2024-05-31T16:26:30Z)
• SSASS: Semi-Supervised Approach for Stenosis Segmentation [9.767759441883008]
  The complexity of coronary artery structures combined with the inherent noise in X-ray images poses a considerable challenge to this task. We introduce a semi-supervised approach for cardiovascular stenosis segmentation. Our approach demonstrated an exceptional performance in the Automatic Region-based Coronary Artery Disease diagnostics.
  arXiv  Detail & Related papers  (2023-11-17T02:01:19Z)
• Show from Tell: Audio-Visual Modelling in Clinical Settings [58.88175583465277]
  We consider audio-visual modelling in a clinical setting, providing a solution to learn medical representations without human expert annotation. A simple yet effective multi-modal self-supervised learning framework is proposed for this purpose. The proposed approach is able to localise anatomical regions of interest during ultrasound imaging, with only speech audio as a reference.
  arXiv  Detail & Related papers  (2023-10-25T08:55:48Z)
• Automatic nodule identification and differentiation in ultrasound videos to facilitate per-nodule examination [12.75726717324889]
  Sonographers usually discriminate different nodules by examining the nodule features and the surrounding structures. We built a reidentification system that consists of two parts: an extractor based on the deep learning model that can extract feature vectors from the input video clips and a real-time clustering algorithm that automatically groups feature vectors by nodules.
  arXiv  Detail & Related papers  (2023-10-10T06:20:14Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• Identifying Visible Tissue in Intraoperative Ultrasound Images during Brain Surgery: A Method and Application [1.4408275800058263]
  Intraoperative ultrasound scanning is a demanding visuotactile task. It requires operators to simultaneously localise the ultrasound perspective and manually perform slight adjustments to the pose of the probe. We propose a method for the identification of the visible tissue, which enables the analysis of ultrasound probe and tissue contact.
  arXiv  Detail & Related papers  (2023-06-01T23:06:14Z)
• Less is More: Adaptive Curriculum Learning for Thyroid Nodule Diagnosis [50.231954872304314]
  We propose an Adaptive Curriculum Learning framework, which adaptively discovers and discards the samples with inconsistent labels. We also contribute TNCD: a Thyroid Nodule Classification dataset.
  arXiv  Detail & Related papers  (2022-07-02T11:50:02Z)
• SpineOne: A One-Stage Detection Framework for Degenerative Discs and Vertebrae [54.751251046196494]
  We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices. SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
  arXiv  Detail & Related papers  (2021-10-28T12:59:06Z)
• Deep Learning for Ultrasound Beamforming [120.12255978513912]
  Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain. Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing. Deep learning methods can play a compelling role in the digital beamforming pipeline.
  arXiv  Detail & Related papers  (2021-09-23T15:15:21Z)
• A systematic review on the role of artificial intelligence in sonographic diagnosis of thyroid cancer: Past, present and future [0.6523396727243321]
  This review follows a methodology-based classification of the different techniques available for thyroid cancer diagnosis. We reflect on the trends and challenges of the field of sonographic diagnosis of thyroid malignancies. Machine learning will continue to play a fundamental role in the development of future thyroid cancer diagnosis frameworks.
  arXiv  Detail & Related papers  (2020-06-10T14:38:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.