Attention Mechanisms in Medical Image Segmentation: A Survey
- URL: http://arxiv.org/abs/2305.17937v1
- Date: Mon, 29 May 2023 08:00:54 GMT
- Title: Attention Mechanisms in Medical Image Segmentation: A Survey
- Authors: Yutong Xie, Bing Yang, Qingbiao Guan, Jianpeng Zhang, Qi Wu, Yong Xia
- Abstract summary: This paper systematically reviews the basic principles of attention mechanisms and their applications in medical image segmentation.
We surveyed over 300 articles related to medical image segmentation, and divided them into two groups based on their attention mechanisms, non-Transformer attention and Transformer attention.
- Score: 41.093501592520326
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Medical image segmentation plays an important role in computer-aided
diagnosis. Attention mechanisms that distinguish important parts from
irrelevant parts have been widely used in medical image segmentation tasks.
This paper systematically reviews the basic principles of attention mechanisms
and their applications in medical image segmentation. First, we review the
basic concepts of attention mechanism and formulation. Second, we surveyed over
300 articles related to medical image segmentation, and divided them into two
groups based on their attention mechanisms, non-Transformer attention and
Transformer attention. In each group, we deeply analyze the attention
mechanisms from three aspects based on the current literature work, i.e., the
principle of the mechanism (what to use), implementation methods (how to use),
and application tasks (where to use). We also thoroughly analyzed the
advantages and limitations of their applications to different tasks. Finally,
we summarize the current state of research and shortcomings in the field, and
discuss the potential challenges in the future, including task specificity,
robustness, standard evaluation, etc. We hope that this review can showcase the
overall research context of traditional and Transformer attention methods,
provide a clear reference for subsequent research, and inspire more advanced
attention research, not only in medical image segmentation, but also in other
image analysis scenarios.
Related papers
- Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methods [1.0043008463279772]
Deep learning-based object detection methods are commonly used for biomedical image segmentation.
Existing surveys often lack a standardized approach or focus on broader segmentation techniques.
We critically analyzed these methods, identified the key challenges, and discussed the future directions.
This SLR aims to provide the research community with a quick yet deeper understanding of these segmentation models.
arXiv Detail & Related papers (2024-08-06T18:38:55Z) - Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insights [5.798431829723857]
This paper provides a comprehensive exploration of techniques and insights for designing attention mechanisms in Vision Transformer (ViT) networks.
We present a systematic taxonomy of various attention mechanisms within ViTs, employing redesigned approaches.
The analysis includes an exploration of the novelty, strengths, weaknesses, and an in-depth evaluation of the different proposed strategies.
arXiv Detail & Related papers (2024-03-28T23:31:59Z) - A hybrid approach for improving U-Net variants in medical image
segmentation [0.0]
The technique of splitting a medical image into various segments or regions of interest is known as medical image segmentation.
The segmented images that are produced can be used for many different things, including diagnosis, surgery planning, and therapy evaluation.
This research aims to reduce the network parameter requirements using depthwise separable convolutions.
arXiv Detail & Related papers (2023-07-31T07:43:45Z) - A survey on attention mechanisms for medical applications: are we moving
towards better algorithms? [2.8101673772585736]
This paper extensively reviews the use of attention mechanisms in machine learning for several medical applications.
It proposes a critical analysis of the claims and potentialities of attention mechanisms presented in the literature.
It proposes future research lines in medical applications that may benefit from these frameworks.
arXiv Detail & Related papers (2022-04-26T16:04:19Z) - Attention Mechanisms in Computer Vision: A Survey [75.6074182122423]
We provide a comprehensive review of various attention mechanisms in computer vision.
We categorize them according to approach, such as channel attention, spatial attention, temporal attention and branch attention.
We suggest future directions for attention mechanism research.
arXiv Detail & Related papers (2021-11-15T09:18:40Z) - MEDUSA: Multi-scale Encoder-Decoder Self-Attention Deep Neural Network
Architecture for Medical Image Analysis [71.2022403915147]
We introduce MEDUSA, a multi-scale encoder-decoder self-attention mechanism tailored for medical image analysis.
We obtain state-of-the-art performance on challenging medical image analysis benchmarks including COVIDx, RSNA RICORD, and RSNA Pneumonia Challenge.
arXiv Detail & Related papers (2021-10-12T15:05:15Z) - Studying the Effects of Self-Attention for Medical Image Analysis [42.12044020360494]
We compare various state-of-the-art self-attention mechanisms across multiple medical image analysis tasks.
We aim to provide a deeper understanding of the effects of self-attention in medical computer vision tasks.
arXiv Detail & Related papers (2021-09-02T07:07:16Z) - Micro-expression spotting: A new benchmark [74.69928316848866]
Micro-expressions (MEs) are brief and involuntary facial expressions that occur when people are trying to hide their true feelings or conceal their emotions.
In the computer vision field, the study of MEs can be divided into two main tasks, spotting and recognition.
This paper introduces an extension of the SMIC-E database, namely the SMIC-E-Long database, which is a new challenging benchmark for ME spotting.
arXiv Detail & Related papers (2020-07-24T09:18:41Z) - Survey on Visual Sentiment Analysis [87.20223213370004]
This paper reviews pertinent publications and tries to present an exhaustive overview of the field of Visual Sentiment Analysis.
The paper also describes principles of design of general Visual Sentiment Analysis systems from three main points of view.
A formalization of the problem is discussed, considering different levels of granularity, as well as the components that can affect the sentiment toward an image in different ways.
arXiv Detail & Related papers (2020-04-24T10:15:22Z) - Robust Medical Instrument Segmentation Challenge 2019 [56.148440125599905]
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions.
Our challenge was based on a surgical data set comprising 10,040 annotated images acquired from a total of 30 surgical procedures.
The results confirm the initial hypothesis, namely that algorithm performance degrades with an increasing domain gap.
arXiv Detail & Related papers (2020-03-23T14:35:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.