CNN Attention Guidance for Improved Orthopedics Radiographic Fracture
Classification
- URL: http://arxiv.org/abs/2203.10690v1
- Date: Mon, 21 Mar 2022 01:07:42 GMT
- Title: CNN Attention Guidance for Improved Orthopedics Radiographic Fracture
Classification
- Authors: Zhibin Liao, Kewen Liao, Haifeng Shen, Marouska F. van Boxel, Jasper
Prijs, Ruurd L. Jaarsma, Job N. Doornberg, Anton van den Hengel, Johan W.
Verjans
- Abstract summary: Convolutional neural networks (CNNs) have gained significant popularity in orthopedic imaging in recent years due to their ability to solve fracture classification problems.
A common criticism of CNNs is their opaque learning and reasoning process, making it difficult to trust machine diagnosis and the subsequent adoption of such algorithms in clinical setting.
This paper explores the effectiveness of regularizing CNN network with human-provided attention guidance on where in the image the network should look for answering clues.
- Score: 37.07168182420638
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Convolutional neural networks (CNNs) have gained significant popularity in
orthopedic imaging in recent years due to their ability to solve fracture
classification problems. A common criticism of CNNs is their opaque learning
and reasoning process, making it difficult to trust machine diagnosis and the
subsequent adoption of such algorithms in clinical setting. This is especially
true when the CNN is trained with limited amount of medical data, which is a
common issue as curating sufficiently large amount of annotated medical imaging
data is a long and costly process. While interest has been devoted to
explaining CNN learnt knowledge by visualizing network attention, the
utilization of the visualized attention to improve network learning has been
rarely investigated. This paper explores the effectiveness of regularizing CNN
network with human-provided attention guidance on where in the image the
network should look for answering clues. On two orthopedics radiographic
fracture classification datasets, through extensive experiments we demonstrate
that explicit human-guided attention indeed can direct correct network
attention and consequently significantly improve classification performance.
The development code for the proposed attention guidance is publicly available
on GitHub.
Related papers
- Class Attention to Regions of Lesion for Imbalanced Medical Image
Recognition [59.28732531600606]
We propose a framework named textbfClass textbfAttention to textbfREgions of the lesion (CARE) to handle data imbalance issues.
The CARE framework needs bounding boxes to represent the lesion regions of rare diseases.
Results show that the CARE variants with automated bounding box generation are comparable to the original CARE framework.
arXiv Detail & Related papers (2023-07-19T15:19:02Z) - Data-Efficient Vision Transformers for Multi-Label Disease
Classification on Chest Radiographs [55.78588835407174]
Vision Transformers (ViTs) have not been applied to this task despite their high classification performance on generic images.
ViTs do not rely on convolutions but on patch-based self-attention and in contrast to CNNs, no prior knowledge of local connectivity is present.
Our results show that while the performance between ViTs and CNNs is on par with a small benefit for ViTs, DeiTs outperform the former if a reasonably large data set is available for training.
arXiv Detail & Related papers (2022-08-17T09:07:45Z) - Preservation of High Frequency Content for Deep Learning-Based Medical
Image Classification [74.84221280249876]
An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists.
We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
arXiv Detail & Related papers (2022-05-08T15:29:54Z) - Follow My Eye: Using Gaze to Supervise Computer-Aided Diagnosis [54.60796004113496]
We demonstrate that the eye movement of radiologists reading medical images can be a new form of supervision to train the DNN-based computer-aided diagnosis (CAD) system.
We record the tracks of the radiologists' gaze when they are reading images.
The gaze information is processed and then used to supervise the DNN's attention via an Attention Consistency module.
arXiv Detail & Related papers (2022-04-06T08:31:05Z) - CapsNet for Medical Image Segmentation [8.612958742534673]
Convolutional Neural Networks (CNNs) have been successful in solving tasks in computer vision.
CNNs are sensitive to rotation and affine transformation and their success relies on huge-scale labeled datasets.
CapsNet is a new architecture that has achieved better robustness in representation learning.
arXiv Detail & Related papers (2022-03-16T21:15:07Z) - Gaze-Guided Class Activation Mapping: Leveraging Human Attention for
Network Attention in Chest X-rays Classification [3.8637285238278434]
This paper describes a gaze-guided class activation mapping (GG-CAM) method to directly regulate the formation of network attention.
GG-CAM is a lightweight ($3$ additional trainable parameters for regulating the learning process) and generic extension that can be easily applied to most classification convolutional neural networks (CNN)
Comparative experiments suggest that two standard CNNs with the GG-CAM extension achieve significantly greater classification performance.
arXiv Detail & Related papers (2022-02-15T00:33:23Z) - Leveraging Multiple CNNs for Triaging Medical Workflow [0.0]
Convolutional neural networks (CNNs) can effectively differentiate critical from non-critical images.
System trains on weighted skin disease images re-labelled as critical or non-critical.
A critical index offers a more comprehensive rating system compared to binary critical/non-critical labels.
arXiv Detail & Related papers (2021-09-27T03:59:23Z) - CA-Net: Comprehensive Attention Convolutional Neural Networks for
Explainable Medical Image Segmentation [20.848367370280695]
We make extensive use of multiple attentions in a CNN architecture and propose a comprehensive attention-based CNN (CA-Net) for more accurate and explainable medical image segmentation.
Our proposed CA-Net significantly improved the average segmentation Dice score from 87.77% to 92.08% for skin lesion.
It reduced the model size to around 15 times smaller with close or even better accuracy compared with state-of-the-art DeepLabv3+.
arXiv Detail & Related papers (2020-09-22T13:41:06Z) - Distractor-Aware Neuron Intrinsic Learning for Generic 2D Medical Image
Classifications [30.62607811479386]
We observe that the convolutional neural networks (CNNs) are vulnerable to distractor interference.
In this paper, we explore distractors from the CNN feature space via proposing a neuron intrinsic learning method.
The proposed method performs favorably against the state-of-the-art approaches.
arXiv Detail & Related papers (2020-07-20T09:59:04Z) - Curriculum By Smoothing [52.08553521577014]
Convolutional Neural Networks (CNNs) have shown impressive performance in computer vision tasks such as image classification, detection, and segmentation.
We propose an elegant curriculum based scheme that smoothes the feature embedding of a CNN using anti-aliasing or low-pass filters.
As the amount of information in the feature maps increases during training, the network is able to progressively learn better representations of the data.
arXiv Detail & Related papers (2020-03-03T07:27:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.