A Structure-Aware Relation Network for Thoracic Diseases Detection and
Segmentation
- URL: http://arxiv.org/abs/2104.10326v1
- Date: Wed, 21 Apr 2021 02:57:02 GMT
- Title: A Structure-Aware Relation Network for Thoracic Diseases Detection and
Segmentation
- Authors: Jie Lian and Jingyu Liu and Shu Zhang and Kai Gao and Xiaoqing Liu and
Dingwen Zhang and Yizhou Yu
- Abstract summary: Instance level detection and segmentation of thoracic diseases or abnormalities are crucial for automatic diagnosis in chest X-ray images.
We propose a structure-aware relation network (SAR-Net) extending Mask R-CNN.
We release ChestX-Det, a chest X-Ray dataset with instance-level annotations (boxes and masks)
- Score: 63.76299770460766
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Instance level detection and segmentation of thoracic diseases or
abnormalities are crucial for automatic diagnosis in chest X-ray images.
Leveraging on constant structure and disease relations extracted from domain
knowledge, we propose a structure-aware relation network (SAR-Net) extending
Mask R-CNN. The SAR-Net consists of three relation modules: 1. the anatomical
structure relation module encoding spatial relations between diseases and
anatomical parts. 2. the contextual relation module aggregating clues based on
query-key pair of disease RoI and lung fields. 3. the disease relation module
propagating co-occurrence and causal relations into disease proposals. Towards
making a practical system, we also provide ChestX-Det, a chest X-Ray dataset
with instance-level annotations (boxes and masks). ChestX-Det is a subset of
the public dataset NIH ChestX-ray14. It contains ~3500 images of 13 common
disease categories labeled by three board-certified radiologists. We evaluate
our SAR-Net on it and another dataset DR-Private. Experimental results show
that it can enhance the strong baseline of Mask R-CNN with significant
improvements. The ChestX-Det is released at
https://github.com/Deepwise-AILab/ChestX-Det-Dataset.
Related papers
- RadGenome-Chest CT: A Grounded Vision-Language Dataset for Chest CT Analysis [56.57177181778517]
RadGenome-Chest CT is a large-scale, region-guided 3D chest CT interpretation dataset based on CT-RATE.
We leverage the latest powerful universal segmentation and large language models to extend the original datasets.
arXiv Detail & Related papers (2024-04-25T17:11:37Z) - Revisiting Computer-Aided Tuberculosis Diagnosis [56.80999479735375]
Tuberculosis (TB) is a major global health threat, causing millions of deaths annually.
Computer-aided tuberculosis diagnosis (CTD) using deep learning has shown promise, but progress is hindered by limited training data.
We establish a large-scale dataset, namely the Tuberculosis X-ray (TBX11K) dataset, which contains 11,200 chest X-ray (CXR) images with corresponding bounding box annotations for TB areas.
This dataset enables the training of sophisticated detectors for high-quality CTD.
arXiv Detail & Related papers (2023-07-06T08:27:48Z) - Instrumental Variable Learning for Chest X-ray Classification [52.68170685918908]
We propose an interpretable instrumental variable (IV) learning framework to eliminate the spurious association and obtain accurate causal representation.
Our approach's performance is demonstrated using the MIMIC-CXR, NIH ChestX-ray 14, and CheXpert datasets.
arXiv Detail & Related papers (2023-05-20T03:12:23Z) - CheXRelNet: An Anatomy-Aware Model for Tracking Longitudinal
Relationships between Chest X-Rays [2.9212099078191764]
We propose CheXRelNet, a neural model that can track longitudinal pathology change relations between two Chest X-rays.
CheXRelNet incorporates local and global visual features, utilizes inter-image and intra-image anatomical information, and learns dependencies between anatomical region attributes.
arXiv Detail & Related papers (2022-08-08T02:22:09Z) - Computer-aided Tuberculosis Diagnosis with Attribute Reasoning
Assistance [58.01014026139231]
We propose a new large-scale tuberculosis (TB) chest X-ray dataset (TBX-Att)
We establish an attribute-assisted weakly-supervised framework to classify and localize TB by leveraging the attribute information.
The proposed model is evaluated on the TBX-Att dataset and will serve as a solid baseline for future research.
arXiv Detail & Related papers (2022-07-01T07:50:35Z) - Attention-based Multi-scale Gated Recurrent Encoder with Novel
Correlation Loss for COVID-19 Progression Prediction [3.3070542851160782]
We present a deep learning-based approach to predict lung infiltrate progression from serial chest radiographs (CXRs) of COVID-19 patients.
Our framework predicts zone-wise disease severity for a patient on a given day by learning representations from the previous temporal CXRs.
arXiv Detail & Related papers (2021-07-18T00:37:55Z) - Deep Mining External Imperfect Data for Chest X-ray Disease Screening [57.40329813850719]
We argue that incorporating an external CXR dataset leads to imperfect training data, which raises the challenges.
We formulate the multi-label disease classification problem as weighted independent binary tasks according to the categories.
Our framework simultaneously models and tackles the domain and label discrepancies, enabling superior knowledge mining ability.
arXiv Detail & Related papers (2020-06-06T06:48:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.