Harmonized Feature Conditioning and Frequency-Prompt Personalization for Multi-Rater Medical Segmentation

• URL: http://arxiv.org/abs/2605.08210v1
• Date: Wed, 06 May 2026 09:13:38 GMT
• Title: Harmonized Feature Conditioning and Frequency-Prompt Personalization for Multi-Rater Medical Segmentation
• Abstract summary: Multi-rater medical image segmentation captures the inherent ambiguity of clinical interpretation.<n>We propose a harmonized probabilistic framework that disentangles acquisition artifacts from genuine annotator variability.<n>A lightweight Harmonizer Network implicitly models scanner-specific artifacts and performs dynamic feature modulation to standardize latent representations.
• Score: 4.894018780140715
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-rater medical image segmentation captures the inherent ambiguity of clinical interpretation, where diagnostic boundaries vary across experts and imaging devices. Existing approaches often reduce this diversity to consensus labels or treat rater differences as noise, resulting in overconfident and poorly calibrated models. We propose a harmonized probabilistic framework that disentangles acquisition artifacts from genuine annotator variability through adaptive feature conditioning and frequency-domain personalization. A lightweight Harmonizer Network implicitly models scanner-specific artifacts and performs dynamic feature modulation to standardize latent representations, ensuring that uncertainty reflects anatomy rather than noise. To represent rater-specific styles, we introduce a novel High-Frequency Prompt Modules that operate in the spectral domain to encode annotator-dependent boundary precision and textural sensitivity. These prompts adaptively modulate harmonized features to produce personalized yet anatomically consistent segmentations. Furthermore, a Generalized Energy Distance based regularization aligns the generative distribution with empirical annotation variability, promoting diversity where experts disagree and consensus where they converge. Experiments on LIDC-IDRI and NPC-170 show SOTA aggregated and individualized segmentation, with notable GED reductions and improved Dice scores, especially on noisy cases. Beyond accuracy, the model exhibits clinically meaningful uncertainty. Confidence rises in agreement regions and declines in ambiguous areas, supporting its use as a reliable and interpretable tool for multi-expert clinical workflows.

Related papers

• AnchorMoE: Interpretable Time Series Classification via Anchor-Routed MoE [51.994752158953084]
  AnchorMoE is an interpretable-by-construction classification framework.<n>It encodes multi-view representations of local patches and routes them to specialized experts.<n>Experiments on real-world and synthetic benchmarks demonstrate that AnchorMoE achieves highly competitive classification performance.
  arXiv  Detail & Related papers  (2026-06-02T13:30:54Z)
• Multi-Rater Calibrated Segmentation Models [1.1043348234031376]
  We improve the probabilistic calibration of medical image segmentation models by reformulating multi-rater supervision as an ordinal learning problem.<n>Results consistently show that ordinal-aware training yields substantially improved calibration with respect to inter-rater agreement without degrading segmentation accuracy.
  arXiv  Detail & Related papers  (2026-05-04T10:35:34Z)
• Green Shielding: A User-Centric Approach Towards Trustworthy AI [19.485991712624095]
  Green Shielding is a user-centric agenda for building evidence-backed deployment guidance.<n>We instantiate Green Shielding in medical diagnosis through HealthCareMagic-Diagnosis.<n>Although instantiated here in medical diagnosis, the agenda extends naturally to other decision-support settings and agentic AI systems.
  arXiv  Detail & Related papers  (2026-04-27T17:04:17Z)
• Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering [58.85421622061983]
  We propose StsPatient for the fine-grained simulation of cognitively impaired patients.<n>We capture domain-specific features by extracting steering vectors from contrastive pairs of instructions and responses.<n>StsPatient significantly outperforms baselines in both clinical authenticity and severity controllability.
  arXiv  Detail & Related papers  (2026-04-14T02:37:46Z)
• Delving Aleatoric Uncertainty in Medical Image Segmentation via Vision Foundation Models [56.29123284262618]
  This work proposes leveraging the universal representation capabilities of visual foundation models to estimate inherent data uncertainty.<n>We analyze the feature diversity of the model's decoded representations and quantify their singular value energy to define the semantic perception scale for each class.<n>Based on this foundation, we design two uncertainty-driven application strategies: (1) the aleatoric uncertainty-aware data filtering mechanism to eliminate potentially noisy samples and enhance model learning quality; and (2) the dynamic uncertainty-aware optimization strategy that adaptively adjusts class-specific loss weights during training based on the semantic perception scale, combined with a label denoising mechanism to improve training stability
  arXiv  Detail & Related papers  (2026-04-13T03:59:54Z)
• Learning Semantic Directions for Feature Augmentation in Domain-Generalized Medical Segmentation [9.669116640409403]
  We propose a domain generalization framework tailored for medical image segmentation.<n>Our approach improves robustness to domain-specific variations by introducing implicit feature perturbations guided by domain statistics.<n>Our framework consistently outperforms existing domain generalization approaches.
  arXiv  Detail & Related papers  (2025-07-31T08:14:26Z)
• Radiomic fingerprints for knee MR images assessment [39.11295870085984]
  Existing radiomic approaches use a fixed set of radiomic features, selected at the population level and applied uniformly to all patients.<n>While interpretable, these signatures are often too constrained to represent individual pathological variations.<n>We propose a novel radiomic fingerprint framework, in which a radiomic feature set (the fingerprint) is dynamically constructed for each patient, selected by a DL model.<n>Unlike the existing radiomic signatures, our fingerprints are derived on a per-patient basis by predicting the feature relevance in a large radiomic feature pool, and selecting only those that are predictive of clinical conditions for individual patients.
  arXiv  Detail & Related papers  (2025-06-25T10:39:22Z)
• Structure-Accurate Medical Image Translation via Dynamic Frequency Balance and Knowledge Guidance [60.33892654669606]
  Diffusion model is a powerful strategy to synthesize the required medical images.<n>Existing approaches still suffer from the problem of anatomical structure distortion due to the overfitting of high-frequency information.<n>We propose a novel method based on dynamic frequency balance and knowledge guidance.
  arXiv  Detail & Related papers  (2025-04-13T05:48:13Z)
• Evidential Calibrated Uncertainty-Guided Interactive Segmentation paradigm for Ultrasound Images [8.010602776500237]
  Evidential Uncertainty-Guided Interactive (EUGIS) is an end-to-end interactive segmentation paradigm based on evidential uncertainty estimation for ultrasound image segmentation.<n>Our method can effectively simulate the interactive behavior of well-trained radiologists, enhancing the targeted of sampling while reducing the number of prompts and iterations required.
  arXiv  Detail & Related papers  (2025-01-02T05:41:25Z)
• Ambiguous Medical Image Segmentation using Diffusion Models [60.378180265885945]
  We introduce a single diffusion model-based approach that produces multiple plausible outputs by learning a distribution over group insights. Our proposed model generates a distribution of segmentation masks by leveraging the inherent sampling process of diffusion. Comprehensive results show that our proposed approach outperforms existing state-of-the-art ambiguous segmentation networks.
  arXiv  Detail & Related papers  (2023-04-10T17:58:22Z)
• Towards Reliable Medical Image Segmentation by Modeling Evidential Calibrated Uncertainty [57.023423137202485]
  Concerns regarding the reliability of medical image segmentation persist among clinicians.<n>We introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks.<n>By leveraging subjective logic theory, we explicitly model probability and uncertainty for medical image segmentation.
  arXiv  Detail & Related papers  (2023-01-01T05:02:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.