Probabilistic Integration of Object Level Annotations in Chest X-ray Classification

• URL: http://arxiv.org/abs/2210.06980v1
• Date: Thu, 13 Oct 2022 12:53:42 GMT
• Title: Probabilistic Integration of Object Level Annotations in Chest X-ray Classification
• Authors: Tom van Sonsbeek, Xiantong Zhen, Dwarikanath Mahapatra, Marcel Worring
• Abstract summary: We propose a new probabilistic latent variable model for disease classification in chest X-ray images. Global dataset features are learned in the lower level layers of the model. Specific details and nuances in the fine-grained expert object-level annotations are learned in the final layers.
• Score: 37.99281019411076
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Medical image datasets and their annotations are not growing as fast as their equivalents in the general domain. This makes translation from the newest, more data-intensive methods that have made a large impact on the vision field increasingly more difficult and less efficient. In this paper, we propose a new probabilistic latent variable model for disease classification in chest X-ray images. Specifically we consider chest X-ray datasets that contain global disease labels, and for a smaller subset contain object level expert annotations in the form of eye gaze patterns and disease bounding boxes. We propose a two-stage optimization algorithm which is able to handle these different label granularities through a single training pipeline in a two-stage manner. In our pipeline global dataset features are learned in the lower level layers of the model. The specific details and nuances in the fine-grained expert object-level annotations are learned in the final layers of the model using a knowledge distillation method inspired by conditional variational inference. Subsequently, model weights are frozen to guide this learning process and prevent overfitting on the smaller richly annotated data subsets. The proposed method yields consistent classification improvement across different backbones on the common benchmark datasets Chest X-ray14 and MIMIC-CXR. This shows how two-stage learning of labels from coarse to fine-grained, in particular with object level annotations, is an effective method for more optimal annotation usage.

Related papers

• Enhancing chest X-ray datasets with privacy-preserving large language models and multi-type annotations: a data-driven approach for improved classification [0.6144680854063935]
  In chest X-ray (CXR) image analysis, rule-based systems are usually employed to extract labels from reports for dataset releases. We present MAPLEZ, a novel approach leveraging a locally executable Large Language Model (LLM) to extract and enhance findings labels.
  arXiv  Detail & Related papers  (2024-03-06T20:10:41Z)
• A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels [35.43549147657739]
  We propose SS-StyleGAN, a self-supervised approach for image annotation and classification suitable for extremely small annotated datasets. We show that the proposed method attains strong classification results using small labeled datasets of sizes 50 and even 10.
  arXiv  Detail & Related papers  (2023-12-26T09:46:50Z)
• Diffusion-Based Hierarchical Multi-Label Object Detection to Analyze Panoramic Dental X-rays [1.2239764810898268]
  We develop an end-to-end model that can identify problematic teeth with dental enumeration and associated diagnoses at the same time. To learn from all three hierarchies jointly, we introduce a novel diffusion-based hierarchical multi-label object detection framework. Experimental results show that our method significantly outperforms state-of-the-art object detection methods.
  arXiv  Detail & Related papers  (2023-03-11T21:31:54Z)
• Intra-class Adaptive Augmentation with Neighbor Correction for Deep Metric Learning [99.14132861655223]
  We propose a novel intra-class adaptive augmentation (IAA) framework for deep metric learning. We reasonably estimate intra-class variations for every class and generate adaptive synthetic samples to support hard samples mining. Our method significantly improves and outperforms the state-of-the-art methods on retrieval performances by 3%-6%.
  arXiv  Detail & Related papers  (2022-11-29T14:52:38Z)
• Weakly-supervised segmentation using inherently-explainable classification models and their application to brain tumour classification [0.46873264197900916]
  This paper introduces three inherently-explainable classifiers to tackle both of these problems as one. The models were employed for the task of multi-class brain tumour classification using two different datasets. The obtained accuracy on a subset of tumour-only images outperformed the state-of-the-art glioma tumour grading binary classifiers with the best model achieving 98.7% accuracy.
  arXiv  Detail & Related papers  (2022-06-10T14:44:05Z)
• X-model: Improving Data Efficiency in Deep Learning with A Minimax Model [78.55482897452417]
  We aim at improving data efficiency for both classification and regression setups in deep learning. To take the power of both worlds, we propose a novel X-model. X-model plays a minimax game between the feature extractor and task-specific heads.
  arXiv  Detail & Related papers  (2021-10-09T13:56:48Z)
• Deep Semi-supervised Knowledge Distillation for Overlapping Cervical Cell Instance Segmentation [54.49894381464853]
  We propose to leverage both labeled and unlabeled data for instance segmentation with improved accuracy by knowledge distillation. We propose a novel Mask-guided Mean Teacher framework with Perturbation-sensitive Sample Mining. Experiments show that the proposed method improves the performance significantly compared with the supervised method learned from labeled data only.
  arXiv  Detail & Related papers  (2020-07-21T13:27:09Z)
• Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray Images [0.0]
  We propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision. We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air between the lung and the chest wall.
  arXiv  Detail & Related papers  (2020-07-01T20:48:35Z)
• UniT: Unified Knowledge Transfer for Any-shot Object Detection and Segmentation [52.487469544343305]
  Methods for object detection and segmentation rely on large scale instance-level annotations for training. We propose an intuitive and unified semi-supervised model that is applicable to a range of supervision.
  arXiv  Detail & Related papers  (2020-06-12T22:45:47Z)
• Weakly-Supervised Salient Object Detection via Scribble Annotations [54.40518383782725]
  We propose a weakly-supervised salient object detection model to learn saliency from scribble labels. We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps. Our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models.
  arXiv  Detail & Related papers  (2020-03-17T12:59:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.