SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentation

• URL: http://arxiv.org/abs/2411.15513v1
• Date: Sat, 23 Nov 2024 10:27:08 GMT
• Title: SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentation
• Authors: Jiayuan Zhu, Junde Wu, Cheng Ouyang, Konstantinos Kamnitsas, Alison Noble,
• Abstract summary: textbfSPA efficiently adapts to diverse test-time preferences with minimal human interaction. It reduces clinician workload in reaching the preferred segmentation. It demonstrates 1) a significant reduction in clinician time and effort compared with existing interactive segmentation approaches.
• Score: 8.34233304138989
• License:
• Abstract: Medical image segmentation data inherently contain uncertainty, often stemming from both imperfect image quality and variability in labeling preferences on ambiguous pixels, which depend on annotators' expertise and the clinical context of the annotations. For instance, a boundary pixel might be labeled as tumor in diagnosis to avoid under-assessment of severity, but as normal tissue in radiotherapy to prevent damage to sensitive structures. As segmentation preferences vary across downstream applications, it is often desirable for an image segmentation model to offer user-adaptable predictions rather than a fixed output. While prior uncertainty-aware and interactive methods offer adaptability, they are inefficient at test time: uncertainty-aware models require users to choose from numerous similar outputs, while interactive models demand significant user input through click or box prompts to refine segmentation. To address these challenges, we propose \textbf{SPA}, a segmentation framework that efficiently adapts to diverse test-time preferences with minimal human interaction. By presenting users a select few, distinct segmentation candidates that best capture uncertainties, it reduces clinician workload in reaching the preferred segmentation. To accommodate user preference, we introduce a probabilistic mechanism that leverages user feedback to adapt model's segmentation preference. The proposed framework is evaluated on a diverse range of medical image segmentation tasks: color fundus images, CT, and MRI. It demonstrates 1) a significant reduction in clinician time and effort compared with existing interactive segmentation approaches, 2) strong adaptability based on human feedback, and 3) state-of-the-art image segmentation performance across diverse modalities and semantic labels.

Related papers

• Assessing Test-time Variability for Interactive 3D Medical Image Segmentation with Diverse Point Prompts [13.08275555017179]
  We assess the test-time variability for interactive medical image segmentation with diverse point prompts. Our goal is to identify a straightforward and efficient approach for optimal prompt selection during test-time. We suggest an optimal strategy for prompt selection during test-time, supported by comprehensive results.
  arXiv  Detail & Related papers  (2023-11-13T23:40:24Z)
• CGAM: Click-Guided Attention Module for Interactive Pathology Image Segmentation via Backpropagating Refinement [8.590026259176806]
  Tumor region segmentation is an essential task for the quantitative analysis of digital pathology. Recent deep neural networks have shown state-of-the-art performance in various image-segmentation tasks. We propose an interactive segmentation method that allows users to refine the output of deep neural networks through click-type user interactions.
  arXiv  Detail & Related papers  (2023-07-03T13:45:24Z)
• Ambiguous Medical Image Segmentation using Diffusion Models [60.378180265885945]
  We introduce a single diffusion model-based approach that produces multiple plausible outputs by learning a distribution over group insights. Our proposed model generates a distribution of segmentation masks by leveraging the inherent sampling process of diffusion. Comprehensive results show that our proposed approach outperforms existing state-of-the-art ambiguous segmentation networks.
  arXiv  Detail & Related papers  (2023-04-10T17:58:22Z)
• Multi-Modal Evaluation Approach for Medical Image Segmentation [4.989480853499916]
  We propose a novel multi-modal evaluation (MME) approach to measure the effectiveness of different segmentation methods. We introduce new relevant and interpretable characteristics, including detection property, boundary alignment, uniformity, total volume, and relative volume. Our proposed approach is open-source and publicly available for use.
  arXiv  Detail & Related papers  (2023-02-08T15:31:33Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration [10.297081695050457]
  This paper proposes an interactive segmentation framework, called interactive MEdical segmentation with self-adaptive Confidence CAlibration (MECCA) The evaluation is established through a novel action-based confidence network, and the corrective actions are obtained from MARL. Experimental results on various medical image datasets have shown the significant performance of the proposed algorithm.
  arXiv  Detail & Related papers  (2021-11-15T12:38:56Z)
• MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learning [15.01235930304888]
  We propose a novel deep learning-based interactive segmentation method that has high efficiency due to only requiring clicks as user inputs. Our proposed framework achieves accurate results with fewer user interactions and less time compared with state-of-the-art interactive frameworks.
  arXiv  Detail & Related papers  (2021-04-25T14:15:17Z)
• DONet: Dual Objective Networks for Skin Lesion Segmentation [77.9806410198298]
  We propose a simple yet effective framework, named Dual Objective Networks (DONet), to improve the skin lesion segmentation. Our DONet adopts two symmetric decoders to produce different predictions for approaching different objectives. To address the challenge of large variety of lesion scales and shapes in dermoscopic images, we additionally propose a recurrent context encoding module (RCEM)
  arXiv  Detail & Related papers  (2020-08-19T06:02:46Z)
• Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model [71.80319052891817]
  We present a relation-driven semi-supervised framework for medical image classification. It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations. Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
  arXiv  Detail & Related papers  (2020-05-15T06:57:54Z)
• Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
  We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA) Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives. Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
  arXiv  Detail & Related papers  (2020-02-06T13:49:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.