A Benchmark for Weakly Semi-Supervised Abnormality Localization in Chest
X-Rays
- URL: http://arxiv.org/abs/2209.01988v1
- Date: Mon, 5 Sep 2022 14:36:07 GMT
- Title: A Benchmark for Weakly Semi-Supervised Abnormality Localization in Chest
X-Rays
- Authors: Haoqin Ji, Haozhe Liu, Yuexiang Li, Jinheng Xie, Nanjun He, Yawen
Huang, Dong Wei, Xinrong Chen, Linlin Shen, Yefeng Zheng
- Abstract summary: We propose to train the CXR abnormality localization framework via a weakly semi-supervised strategy, termed Point Beyond Class.
The core idea behind our PBC is to learn a robust and accurate mapping from the point annotations to the bounding boxes.
Experimental results on RSNA and VinDr-CXR datasets justify the effectiveness of the proposed method.
- Score: 42.1336336144291
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate abnormality localization in chest X-rays (CXR) can benefit the
clinical diagnosis of various thoracic diseases. However, the lesion-level
annotation can only be performed by experienced radiologists, and it is tedious
and time-consuming, thus difficult to acquire. Such a situation results in a
difficulty to develop a fully-supervised abnormality localization system for
CXR. In this regard, we propose to train the CXR abnormality localization
framework via a weakly semi-supervised strategy, termed Point Beyond Class
(PBC), which utilizes a small number of fully annotated CXRs with lesion-level
bounding boxes and extensive weakly annotated samples by points. Such a point
annotation setting can provide weakly instance-level information for
abnormality localization with a marginal annotation cost. Particularly, the
core idea behind our PBC is to learn a robust and accurate mapping from the
point annotations to the bounding boxes against the variance of annotated
points. To achieve that, a regularization term, namely multi-point consistency,
is proposed, which drives the model to generate the consistent bounding box
from different point annotations inside the same abnormality. Furthermore, a
self-supervision, termed symmetric consistency, is also proposed to deeply
exploit the useful information from the weakly annotated data for abnormality
localization. Experimental results on RSNA and VinDr-CXR datasets justify the
effectiveness of the proposed method. When less than 20% box-level labels are
used for training, an improvement of ~5 in mAP can be achieved by our PBC,
compared to the current state-of-the-art method (i.e., Point DETR). Code is
available at https://github.com/HaozheLiu-ST/Point-Beyond-Class.
Related papers
- RECIST Weakly Supervised Lesion Segmentation via Label-Space Co-Training [30.938824115941603]
We propose a weakly supervised framework to exploit the rich RECIST annotations for pixel-wise lesion segmentation.
A pair of under- and over-segmenting masks are constructed for each lesion based on its RECIST annotation.
Experiments are conducted on a public dataset to demonstrate the superiority of the proposed framework.
arXiv Detail & Related papers (2023-03-01T03:15:31Z) - Self-Supervised Equivariant Regularization Reconciles Multiple Instance
Learning: Joint Referable Diabetic Retinopathy Classification and Lesion
Segmentation [3.1671604920729224]
Lesion appearance is a crucial clue for medical providers to distinguish referable diabetic retinopathy (rDR) from non-referable DR.
Most existing large-scale DR datasets contain only image-level labels rather than pixel-based annotations.
This paper leverages self-supervised equivariant learning and attention-based multi-instance learning to tackle this problem.
We conduct extensive validation experiments on the Eyepacs dataset, achieving an area under the receiver operating characteristic curve (AU ROC) of 0.958, outperforming current state-of-the-art algorithms.
arXiv Detail & Related papers (2022-10-12T06:26:05Z) - Localization supervision of chest x-ray classifiers using label-specific
eye-tracking annotation [4.8035104863603575]
Eye-tracking (ET) data can be collected in a non-intrusive way during the clinical workflow of a radiologist.
We use ET data recorded from radiologists while dictating CXR reports to train CNNs.
We extract snippets from the ET data by associating them with the dictation of keywords and use them to supervise the localization of abnormalities.
arXiv Detail & Related papers (2022-07-20T09:26:29Z) - Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest
X-rays [17.15666977702355]
We propose an Anatomy-Guided chest X-ray Network (AGXNet) to address weak annotation issues.
Our framework consists of a cascade of two networks, one responsible for identifying anatomical abnormalities and the second responsible for pathological observations.
Our results on the MIMIC-CXR dataset demonstrate the effectiveness of AGXNet in disease and anatomical abnormality localization.
arXiv Detail & Related papers (2022-06-25T18:33:27Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - Label Cleaning Multiple Instance Learning: Refining Coarse Annotations
on Single Whole-Slide Images [83.7047542725469]
Annotating cancerous regions in whole-slide images (WSIs) of pathology samples plays a critical role in clinical diagnosis, biomedical research, and machine learning algorithms development.
We present a method, named Label Cleaning Multiple Instance Learning (LC-MIL), to refine coarse annotations on a single WSI without the need of external training data.
Our experiments on a heterogeneous WSI set with breast cancer lymph node metastasis, liver cancer, and colorectal cancer samples show that LC-MIL significantly refines the coarse annotations, outperforming the state-of-the-art alternatives, even while learning from a single slide.
arXiv Detail & Related papers (2021-09-22T15:06:06Z) - Towards Unbiased COVID-19 Lesion Localisation and Segmentation via
Weakly Supervised Learning [66.36706284671291]
We propose a data-driven framework supervised by only image-level labels to support unbiased lesion localisation.
The framework can explicitly separate potential lesions from original images, with the help of a generative adversarial network and a lesion-specific decoder.
arXiv Detail & Related papers (2021-03-01T06:05:49Z) - Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for
Thoracic Disease Identification [83.6017225363714]
deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance.
For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming.
In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
arXiv Detail & Related papers (2021-02-26T02:29:30Z) - Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions
Segmentation [79.58311369297635]
We propose a new weakly-supervised lesions transfer framework, which can explore transferable domain-invariant knowledge across different datasets.
A Wasserstein quantified transferability framework is developed to highlight widerange transferable contextual dependencies.
A novel self-supervised pseudo label generator is designed to equally provide confident pseudo pixel labels for both hard-to-transfer and easy-to-transfer target samples.
arXiv Detail & Related papers (2020-12-08T02:26:03Z) - Localization of Critical Findings in Chest X-Ray without Local
Annotations Using Multi-Instance Learning [0.0]
deep learning models commonly suffer from a lack of explainability.
Deep learning models require locally annotated training data in form of pixel level labels or bounding box coordinates.
In this work, we address these shortcomings with an interpretable DL algorithm based on multi-instance learning.
arXiv Detail & Related papers (2020-01-23T21:29:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.