Crowdsourcing Airway Annotations in Chest Computed Tomography Images

• URL: http://arxiv.org/abs/2011.10433v1
• Date: Fri, 20 Nov 2020 14:54:32 GMT
• Title: Crowdsourcing Airway Annotations in Chest Computed Tomography Images
• Authors: Veronika Cheplygina and Adria Perez-Rovira and Wieying Kuo and Harm A. W. M. Tiddens and Marleen de Bruijne
• Abstract summary: Measuring airways in chest computed tomography (CT) scans is important for characterizing diseases such as cystic fibrosis. Machine learning algorithms offer an alternative, but need large sets of annotated scans for good performance. We generate image slices at known locations of airways in 24 subjects and request the crowd workers to outline the airway wall.
• Score: 3.862190309412109
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Measuring airways in chest computed tomography (CT) scans is important for characterizing diseases such as cystic fibrosis, yet very time-consuming to perform manually. Machine learning algorithms offer an alternative, but need large sets of annotated scans for good performance. We investigate whether crowdsourcing can be used to gather airway annotations. We generate image slices at known locations of airways in 24 subjects and request the crowd workers to outline the airway lumen and airway wall. After combining multiple crowd workers, we compare the measurements to those made by the experts in the original scans. Similar to our preliminary study, a large portion of the annotations were excluded, possibly due to workers misunderstanding the instructions. After excluding such annotations, moderate to strong correlations with the expert can be observed, although these correlations are slightly lower than inter-expert correlations. Furthermore, the results across subjects in this study are quite variable. Although the crowd has potential in annotating airways, further development is needed for it to be robust enough for gathering annotations in practice. For reproducibility, data and code are available online: \url{http://github.com/adriapr/crowdairway.git}.

Related papers

• Guidelines for Cerebrovascular Segmentation: Managing Imperfect Annotations in the context of Semi-Supervised Learning [3.231698506153459]
  Supervised learning methods achieve excellent performances when fed with a sufficient amount of labeled data. Such labels are typically highly time-consuming, error-prone and expensive to produce. Semi-supervised learning approaches leverage both labeled and unlabeled data, and are very useful when only a small fraction of the dataset is labeled.
  arXiv  Detail & Related papers  (2024-04-02T09:31:06Z)
• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• Augmenting Chest X-ray Datasets with Non-Expert Annotations [1.9991771189143435]
  A popular and cost-effective approach is automated annotation extraction from free-text medical reports. We enhance two publicly available chest X-ray datasets by incorporating non-expert annotations. We train a chest drain detector with the non-expert annotations that generalizes well to expert labels.
  arXiv  Detail & Related papers  (2023-09-05T13:52:43Z)
• Annotator Consensus Prediction for Medical Image Segmentation with Diffusion Models [70.3497683558609]
  A major challenge in the segmentation of medical images is the large inter- and intra-observer variability in annotations provided by multiple experts. We propose a novel method for multi-expert prediction using diffusion models.
  arXiv  Detail & Related papers  (2023-06-15T10:01:05Z)
• Detecting Shortcuts in Medical Images -- A Case Study in Chest X-rays [0.22940141855172028]
  We present a case study on chest X-rays using two publicly available datasets. We share annotations for a subset of pneumothorax images with drains.
  arXiv  Detail & Related papers  (2022-11-08T14:36:33Z)
• On the Representation Collapse of Sparse Mixture of Experts [102.83396489230375]
  Sparse mixture of experts provides larger model capacity while requiring a constant computational overhead. It employs the routing mechanism to distribute input tokens to the best-matched experts according to their hidden representations. However, learning such a routing mechanism encourages token clustering around expert centroids, implying a trend toward representation collapse.
  arXiv  Detail & Related papers  (2022-04-20T01:40:19Z)
• Combining Feature and Instance Attribution to Detect Artifacts [62.63504976810927]
  We propose methods to facilitate identification of training data artifacts. We show that this proposed training-feature attribution approach can be used to uncover artifacts in training data. We execute a small user study to evaluate whether these methods are useful to NLP researchers in practice.
  arXiv  Detail & Related papers  (2021-07-01T09:26:13Z)
• Leveraging Self-Supervision for Cross-Domain Crowd Counting [71.75102529797549]
  State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. We train our network to recognize upside-down real images from regular ones and incorporate into it the ability to predict its own uncertainty. This yields an algorithm that consistently outperforms state-of-the-art cross-domain crowd counting ones without any extra computation at inference time.
  arXiv  Detail & Related papers  (2021-03-30T12:37:55Z)
• Towards Unsupervised Learning for Instrument Segmentation in Robotic Surgery with Cycle-Consistent Adversarial Networks [54.00217496410142]
  We propose an unpaired image-to-image translation where the goal is to learn the mapping between an input endoscopic image and a corresponding annotation. Our approach allows to train image segmentation models without the need to acquire expensive annotations. We test our proposed method on Endovis 2017 challenge dataset and show that it is competitive with supervised segmentation methods.
  arXiv  Detail & Related papers  (2020-07-09T01:39:39Z)
• Semi-supervised lung nodule retrieval [2.055949720959582]
  A content based image retrieval (CBIR) system provides as its output a set of images, ranked by similarity to the query image. Ground truth on similarity between dataset elements (e.g. between nodules) is not readily available, thus greatly challenging machine learning methods. The current study suggests a semi-supervised approach that involves two steps: 1) Automatic annotation of a given partially labeled dataset; 2) Learning a semantic similarity metric space based on the predicated annotations. The proposed system is demonstrated in lung nodule retrieval using the LIDC dataset, and shows that it is feasible to learn embedding from predicted ratings.
  arXiv  Detail & Related papers  (2020-05-04T19:26:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.