BAAF: A Benchmark Attention Adaptive Framework for Medical Ultrasound
Image Segmentation Tasks
- URL: http://arxiv.org/abs/2310.00919v1
- Date: Mon, 2 Oct 2023 06:15:50 GMT
- Title: BAAF: A Benchmark Attention Adaptive Framework for Medical Ultrasound
Image Segmentation Tasks
- Authors: Gongping Chen, Lei Zhao, Xiaotao Yin, Liang Cui, Jianxun Zhang, Yu Dai
- Abstract summary: We propose a Benchmark Attention Adaptive Framework (BAAF) to assist doctors segment or diagnose lesions and tissues in ultrasound images.
BAAF consists of a parallel hybrid attention module (PHAM) and an adaptive calibration mechanism (ACM)
The design of BAAF further optimize the "what" and "where" focus and selection problems in CNNs and seeks to improve the segmentation accuracy of lesions or tissues in medical ultrasound images.
- Score: 15.998631461609968
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The AI-based assisted diagnosis programs have been widely investigated on
medical ultrasound images. Complex scenario of ultrasound image, in which the
coupled interference of internal and external factors is severe, brings a
unique challenge for localize the object region automatically and precisely in
ultrasound images. In this study, we seek to propose a more general and robust
Benchmark Attention Adaptive Framework (BAAF) to assist doctors segment or
diagnose lesions and tissues in ultrasound images more quickly and accurately.
Different from existing attention schemes, the BAAF consists of a parallel
hybrid attention module (PHAM) and an adaptive calibration mechanism (ACM).
Specifically, BAAF first coarsely calibrates the input features from the
channel and spatial dimensions, and then adaptively selects more robust lesion
or tissue characterizations from the coarse-calibrated feature maps. The design
of BAAF further optimizes the "what" and "where" focus and selection problems
in CNNs and seeks to improve the segmentation accuracy of lesions or tissues in
medical ultrasound images. The method is evaluated on four medical ultrasound
segmentation tasks, and the adequate experimental results demonstrate the
remarkable performance improvement over existing state-of-the-art methods. In
addition, the comparison with existing attention mechanisms also demonstrates
the superiority of BAAF. This work provides the possibility for automated
medical ultrasound assisted diagnosis and reduces reliance on human accuracy
and precision.
Related papers
- Generative Adversarial Networks in Ultrasound Imaging: Extending Field of View Beyond Conventional Limits [1.6588671405657123]
TTE ultrasound imaging faces inherent limitations, notably the trade-off between field of view (FoV) and resolution.
This paper introduces a novel application of conditional Generative Adversarial Networks (cGANs)
Our proposed cGAN architecture, termed echoGAN, demonstrates the capability to generate realistic anatomical structures through outpainting.
arXiv Detail & Related papers (2024-05-31T16:26:30Z) - SEGSRNet for Stereo-Endoscopic Image Super-Resolution and Surgical Instrument Segmentation [0.5461938536945723]
SEGSRNet addresses the challenge of precisely identifying surgical instruments in low-resolution stereo endoscopic images.
Our innovative framework enhances image clarity and segmentation accuracy by applying state-of-the-art super-resolution techniques before segmentation.
arXiv Detail & Related papers (2024-04-20T09:27:05Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - Ultrasound Image Enhancement using CycleGAN and Perceptual Loss [4.428854369140015]
This work introduces an advanced framework designed to enhance ultrasound images, especially those captured by portable hand-held devices.
We utilize an enhanced generative adversarial network (CycleGAN) model for ultrasound image enhancement across five organ systems.
arXiv Detail & Related papers (2023-12-18T23:21:00Z) - Breast Ultrasound Report Generation using LangChain [58.07183284468881]
We propose the integration of multiple image analysis tools through a LangChain using Large Language Models (LLM) into the breast reporting process.
Our method can accurately extract relevant features from ultrasound images, interpret them in a clinical context, and produce comprehensive and standardized reports.
arXiv Detail & Related papers (2023-12-05T00:28:26Z) - AiAReSeg: Catheter Detection and Segmentation in Interventional
Ultrasound using Transformers [75.20925220246689]
endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature.
This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
arXiv Detail & Related papers (2023-09-25T19:34:12Z) - LOTUS: Learning to Optimize Task-based US representations [39.81131738128329]
Anatomical segmentation of organs in ultrasound images is essential to many clinical applications.
Existing deep neural networks require a large amount of labeled data for training in order to achieve clinically acceptable performance.
In this paper, we propose a novel approach for learning to optimize task-based ultra-sound image representations.
arXiv Detail & Related papers (2023-07-29T16:29:39Z) - Preservation of High Frequency Content for Deep Learning-Based Medical
Image Classification [74.84221280249876]
An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists.
We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
arXiv Detail & Related papers (2022-05-08T15:29:54Z) - Factored Attention and Embedding for Unstructured-view Topic-related
Ultrasound Report Generation [70.7778938191405]
We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation.
The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
arXiv Detail & Related papers (2022-03-12T15:24:03Z) - Deep Learning for Ultrasound Beamforming [120.12255978513912]
Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain.
Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing.
Deep learning methods can play a compelling role in the digital beamforming pipeline.
arXiv Detail & Related papers (2021-09-23T15:15:21Z) - RCA-IUnet: A residual cross-spatial attention guided inception U-Net
model for tumor segmentation in breast ultrasound imaging [0.6091702876917281]
The article introduces an efficient residual cross-spatial attention guided inception U-Net (RCA-IUnet) model with minimal training parameters for tumor segmentation.
The RCA-IUnet model follows U-Net topology with residual inception depth-wise separable convolution and hybrid pooling layers.
Cross-spatial attention filters are added to suppress the irrelevant features and focus on the target structure.
arXiv Detail & Related papers (2021-08-05T10:35:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.