Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via
Volumetric Pseudo-Labeling
- URL: http://arxiv.org/abs/2306.03934v1
- Date: Tue, 6 Jun 2023 18:01:08 GMT
- Title: Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via
Volumetric Pseudo-Labeling
- Authors: Constantin Seibold, Alexander Jaus, Matthias A. Fink, Moon Kim, Simon
Rei{\ss}, Ken Herrmann, Jens Kleesiek, Rainer Stiefelhagen
- Abstract summary: We created a large-scale dataset of 10,021 thoracic CTs with 157 labels.
We applied an ensemble of 3D anatomy segmentation models to extract anatomical pseudo-labels.
Our resulting segmentation models demonstrated remarkable performance on CXR.
- Score: 66.75096111651062
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Purpose: Interpreting chest radiographs (CXR) remains challenging due to the
ambiguity of overlapping structures such as the lungs, heart, and bones. To
address this issue, we propose a novel method for extracting fine-grained
anatomical structures in CXR using pseudo-labeling of three-dimensional
computed tomography (CT) scans.
Methods: We created a large-scale dataset of 10,021 thoracic CTs with 157
labels and applied an ensemble of 3D anatomy segmentation models to extract
anatomical pseudo-labels. These labels were projected onto a two-dimensional
plane, similar to the CXR, allowing the training of detailed semantic
segmentation models for CXR without any manual annotation effort.
Results: Our resulting segmentation models demonstrated remarkable
performance on CXR, with a high average model-annotator agreement between two
radiologists with mIoU scores of 0.93 and 0.85 for frontal and lateral anatomy,
while inter-annotator agreement remained at 0.95 and 0.83 mIoU. Our anatomical
segmentations allowed for the accurate extraction of relevant explainable
medical features such as the cardio-thoracic-ratio.
Conclusion: Our method of volumetric pseudo-labeling paired with CT
projection offers a promising approach for detailed anatomical segmentation of
CXR with a high agreement with human annotators. This technique may have
important clinical implications, particularly in the analysis of various
thoracic pathologies.
Related papers
- Anatomy-guided Pathology Segmentation [56.883822515800205]
We develop a generalist segmentation model that combines anatomical and pathological information, aiming to enhance the segmentation accuracy of pathological features.
Our Anatomy-Pathology Exchange (APEx) training utilizes a query-based segmentation transformer which decodes a joint feature space into query-representations for human anatomy.
In doing so, we are able to report the best results across the board on FDG-PET-CT and Chest X-Ray pathology segmentation tasks with a margin of up to 3.3% as compared to strong baseline methods.
arXiv Detail & Related papers (2024-07-08T11:44:15Z) - AGFA-Net: Attention-Guided and Feature-Aggregated Network for Coronary Artery Segmentation using Computed Tomography Angiography [5.583495103569884]
We propose an attention-guided, feature-aggregated 3D deep network (AGFA-Net) for coronary artery segmentation using CCTA images.
AGFA-Net leverages attention mechanisms and feature refinement modules to capture salient features and enhance segmentation accuracy.
Evaluation on a dataset comprising 1,000 CCTA scans demonstrates AGFA-Net's superior performance, achieving an average Dice coefficient similarity of 86.74% and a Hausdorff distance of 0.23 mm.
arXiv Detail & Related papers (2024-06-13T01:04:47Z) - Towards Unifying Anatomy Segmentation: Automated Generation of a
Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelines [113.08940153125616]
We generate a dataset of whole-body CT scans with $142$ voxel-level labels for 533 volumes providing comprehensive anatomical coverage.
Our proposed procedure does not rely on manual annotation during the label aggregation stage.
We release our trained unified anatomical segmentation model capable of predicting $142$ anatomical structures on CT data.
arXiv Detail & Related papers (2023-07-25T09:48:13Z) - Automatic Classification of Symmetry of Hemithoraces in Canine and
Feline Radiographs [0.0]
We propose a hemithoraces segmentation method based on Convolutional Neural Networks (CNNs) and active contours.
To test the robustness of the proposed thorax segmentation method to underexposure and overexposure, we synthetically corrupted properly exposed radiographs.
arXiv Detail & Related papers (2023-02-24T22:46:16Z) - Med-Query: Steerable Parsing of 9-DoF Medical Anatomies with Query
Embedding [15.98677736544302]
We propose a steerable, robust, and efficient computing framework for detection, identification, and segmentation of anatomies in 3D medical data.
Considering complicated shapes, sizes and orientations of anatomies, we present the nine degrees-of-freedom (9-DoF) pose estimation solution in full 3D space.
We have validated the proposed method on three medical imaging parsing tasks of ribs, spine, and abdominal organs.
arXiv Detail & Related papers (2022-12-05T04:04:21Z) - Improving Classification Model Performance on Chest X-Rays through Lung
Segmentation [63.45024974079371]
We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations.
Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
arXiv Detail & Related papers (2022-02-22T15:24:06Z) - Pulmonary Vessel Segmentation based on Orthogonal Fused U-Net++ of Chest
CT Images [1.8692254863855962]
We present an effective framework and refinement process of pulmonary vessel segmentation from chest computed tomographic (CT) images.
The key to our approach is a 2.5D segmentation network applied from three axes, which presents a robust and fully automated pulmonary vessel segmentation result.
Our method outperforms other network structures by a large margin and achieves by far the highest average DICE score of 0.9272 and precision of 0.9310.
arXiv Detail & Related papers (2021-07-03T21:46:29Z) - A Deep Learning-Based Approach to Extracting Periosteal and Endosteal
Contours of Proximal Femur in Quantitative CT Images [25.76523855274612]
A three-dimensional (3D) end-to-end fully convolutional neural network was developed for our segmentation task.
Two models with the same network structures were trained and they achieved a dice similarity coefficient (DSC) of 97.87% and 96.49% for the periosteal and endosteal contours, respectively.
It demonstrated a strong potential for clinical use, including the hip fracture risk prediction and finite element analysis.
arXiv Detail & Related papers (2021-02-03T10:23:41Z) - Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on
2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI.
A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing.
The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
arXiv Detail & Related papers (2020-05-27T20:44:38Z) - A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced
Cardiac Magnetic Resonance Imaging [90.29017019187282]
" 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset.
Analyse of the submitted algorithms using technical and biological metrics was performed.
Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
arXiv Detail & Related papers (2020-04-26T08:49:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.