Image quality assessment by overlapping task-specific and task-agnostic measures: application to prostate multiparametric MR images for cancer segmentation

• URL: http://arxiv.org/abs/2202.09798v1
• Date: Sun, 20 Feb 2022 11:45:58 GMT
• Title: Image quality assessment by overlapping task-specific and task-agnostic measures: application to prostate multiparametric MR images for cancer segmentation
• Authors: Shaheer U. Saeed, Wen Yan, Yunguan Fu, Francesco Giganti, Qianye Yang, Zachary M. C. Baum, Mirabela Rusu, Richard E. Fan, Geoffrey A. Sonn, Mark Emberton, Dean C. Barratt, Yipeng Hu
• Abstract summary: Image quality assessment (IQA) in medical imaging can be used to ensure that downstream clinical tasks can be reliably performed. A task-specific IQA has recently been proposed to learn an image-amenability-predicting controller simultaneously with a target task predictor. We propose an extension to this task-specific IQA approach, by adding a task-agnostic IQA based on auto-encoding as the target task.
• Score: 0.6109833303919139
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image quality assessment (IQA) in medical imaging can be used to ensure that downstream clinical tasks can be reliably performed. Quantifying the impact of an image on the specific target tasks, also named as task amenability, is needed. A task-specific IQA has recently been proposed to learn an image-amenability-predicting controller simultaneously with a target task predictor. This allows for the trained IQA controller to measure the impact an image has on the target task performance, when this task is performed using the predictor, e.g. segmentation and classification neural networks in modern clinical applications. In this work, we propose an extension to this task-specific IQA approach, by adding a task-agnostic IQA based on auto-encoding as the target task. Analysing the intersection between low-quality images, deemed by both the task-specific and task-agnostic IQA, may help to differentiate the underpinning factors that caused the poor target task performance. For example, common imaging artefacts may not adversely affect the target task, which would lead to a low task-agnostic quality and a high task-specific quality, whilst individual cases considered clinically challenging, which can not be improved by better imaging equipment or protocols, is likely to result in a high task-agnostic quality but a low task-specific quality. We first describe a flexible reward shaping strategy which allows for the adjustment of weighting between task-agnostic and task-specific quality scoring. Furthermore, we evaluate the proposed algorithm using a clinically challenging target task of prostate tumour segmentation on multiparametric magnetic resonance (mpMR) images, from 850 patients. The proposed reward shaping strategy, with appropriately weighted task-specific and task-agnostic qualities, successfully identified samples that need re-acquisition due to defected imaging process.

Related papers

• DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild [54.139923409101044]
  We propose a novel IQA method called diffusion priors-based IQA (DP-IQA) We use pre-trained stable diffusion as the backbone, extract multi-level features from the denoising U-Net, and decode them to estimate the image quality score. We distill the knowledge in the above model into a CNN-based student model, significantly reducing the parameter to enhance applicability.
  arXiv  Detail & Related papers  (2024-05-30T12:32:35Z)
• Adaptive Feature Selection for No-Reference Image Quality Assessment by Mitigating Semantic Noise Sensitivity [55.399230250413986]
  We propose a Quality-Aware Feature Matching IQA Metric (QFM-IQM) to remove harmful semantic noise features from the upstream task. Our approach achieves superior performance to the state-of-the-art NR-IQA methods on eight standard IQA datasets.
  arXiv  Detail & Related papers  (2023-12-11T06:50:27Z)
• Unifying Image Processing as Visual Prompting Question Answering [62.84955983910612]
  Image processing is a fundamental task in computer vision, which aims at enhancing image quality and extracting essential features for subsequent vision applications. Traditionally, task-specific models are developed for individual tasks and designing such models requires distinct expertise. We propose a universal model for general image processing that covers image restoration, image enhancement, image feature extraction tasks.
  arXiv  Detail & Related papers  (2023-10-16T15:32:57Z)
• Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective [93.56647950778357]
  Blind image quality assessment (BIQA) predicts the human perception of image quality without any reference information. We develop a general and automated multitask learning scheme for BIQA to exploit auxiliary knowledge from other tasks.
  arXiv  Detail & Related papers  (2023-03-27T07:58:09Z)
• Explainable Image Quality Assessment for Medical Imaging [0.0]
  Poor-quality medical images may lead to misdiagnosis. We propose an explainable image quality assessment system and validate our idea on two different objectives. We apply a variety of techniques to measure the faithfulness of the saliency detectors. We show that NormGrad has significant gains over other saliency detectors by reaching a repeated Pointing Game score of 0.853 for Object-CXR and 0.611 for LVOT datasets.
  arXiv  Detail & Related papers  (2023-03-25T14:18:39Z)
• UNO-QA: An Unsupervised Anomaly-Aware Framework with Test-Time Clustering for OCTA Image Quality Assessment [4.901218498977952]
  We propose an unsupervised anomaly-aware framework with test-time clustering for optical coherence tomography angiography ( OCTA) image quality assessment. A feature-embedding-based low-quality representation module is proposed to quantify the quality of OCTA images. We perform dimension reduction and clustering of multi-scale image features extracted by the trained OCTA quality representation network.
  arXiv  Detail & Related papers  (2022-12-20T18:48:04Z)
• Image quality assessment for machine learning tasks using meta-reinforcement learning [2.192555579139084]
  We consider image quality assessment (IQA) as a measure of how images are amenable with respect to a given downstream task, or task amenability. We use an IQA controller to predict the task amenability which, itself being parameterised by neural networks, can be trained simultaneously with the task predictor. We demonstrate the efficacy of the proposed task-specific, adaptable IQA approach, using two clinical applications for ultrasound-guided prostate intervention and pneumonia detection on X-ray images.
  arXiv  Detail & Related papers  (2022-03-27T09:42:26Z)
• Adaptable image quality assessment using meta-reinforcement learning of task amenability [2.499394199589254]
  Modern deep learning algorithms rely on subjective (human-based) image quality assessment (IQA) To predict task amenability, an IQA agent is trained using reinforcement learning (RL) with a simultaneously optimised task predictor. In this work, we develop transfer learning or adaptation strategies to increase the adaptability of both the IQA agent and the task predictor.
  arXiv  Detail & Related papers  (2021-07-31T11:29:37Z)
• Learning image quality assessment by reinforcing task amenable data selection [0.3679364886448339]
  We propose to train simultaneously two neural networks for image selection and a target task using reinforcement learning. A controller network learns an image selection policy by maximising an accumulated reward based on the target task performance. The trained controller is able to reject those images that lead to poor accuracy in the target task.
  arXiv  Detail & Related papers  (2021-02-15T15:57:20Z)
• Multi-label Thoracic Disease Image Classification with Cross-Attention Networks [65.37531731899837]
  We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images. We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
  arXiv  Detail & Related papers  (2020-07-21T14:37:00Z)
• Object-QA: Towards High Reliable Object Quality Assessment [71.71188284059203]
  In object recognition applications, object images usually appear with different quality levels. We propose an effective approach named Object-QA to assess high-reliable quality scores for object images.
  arXiv  Detail & Related papers  (2020-05-27T01:46:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.