MedSeg-R: Medical Image Segmentation with Clinical Reasoning

• URL: http://arxiv.org/abs/2506.18669v1
• Date: Mon, 23 Jun 2025 14:14:09 GMT
• Title: MedSeg-R: Medical Image Segmentation with Clinical Reasoning
• Abstract summary: We propose MedSeg-R, a lightweight, dual-stage framework inspired by inspired by clinical reasoning.<n>Its cognitive stage interprets medical report into structured semantic priors, which are fused via transformer block.<n>In challenging benchmarks, MedSeg-R produces large Dice improvements in overlapping and ambiguous structures.
• Score: 28.33172310047359
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Medical image segmentation is challenging due to overlapping anatomies with ambiguous boundaries and a severe imbalance between the foreground and background classes, which particularly affects the delineation of small lesions. Existing methods, including encoder-decoder networks and prompt-driven variants of the Segment Anything Model (SAM), rely heavily on local cues or user prompts and lack integrated semantic priors, thus failing to generalize well to low-contrast or overlapping targets. To address these issues, we propose MedSeg-R, a lightweight, dual-stage framework inspired by inspired by clinical reasoning. Its cognitive stage interprets medical report into structured semantic priors (location, texture, shape), which are fused via transformer block. In the perceptual stage, these priors modulate the SAM backbone: spatial attention highlights likely lesion regions, dynamic convolution adapts feature filters to expected textures, and deformable sampling refines spatial support. By embedding this fine-grained guidance early, MedSeg-R disentangles inter-class confusion and amplifies minority-class cues, greatly improving sensitivity to small lesions. In challenging benchmarks, MedSeg-R produces large Dice improvements in overlapping and ambiguous structures, demonstrating plug-and-play compatibility with SAM-based systems.

Related papers

• Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation [1.1852406625172218]
  We propose an enhanced segmentation framework that integrates a lightweight Box Predictor module into the MedSAM architecture.<n>The Box Predictor estimates an approximate bounding box from a single user click using localized image embedding features.<n>Our method improves segmentation accuracy and robustness across varied anatomical structures and imaging domains.
  arXiv  Detail & Related papers  (2026-06-03T10:34:15Z)
• Med-DisSeg: Dispersion-Driven Representation Learning for Fine-Grained Medical Image Segmentation [3.182068203318624]
  We propose Med DisSeg, a dispersion driven medical image segmentation framework.<n>Med DisSeg combines a lightweight Dispersive Loss with adaptive attention for fine grained structure segmentation.<n>We show that Med DisSeg achieves competitive results on multi organ CT segmentation, supporting its robustness and cross task applicability.
  arXiv  Detail & Related papers  (2026-05-14T08:49:36Z)
• Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation [51.06355116973389]
  We propose a framework that treats wheat disease segmentation as a coupled task of disease-specific semantic perception and disease boundary localization.<n>Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts.<n>We show that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks.
  arXiv  Detail & Related papers  (2026-04-07T04:19:39Z)
• SegMoTE: Token-Level Mixture of Experts for Medical Image Segmentation [18.723160085156717]
  We propose SegMoTE, an efficient and adaptive framework for medical image segmentation.<n>SegMoTE preserves SAM's original prompt interface, efficient inference, and zero-shot generalization.<n>SegMoTE achieves SOTA performance across diverse imaging modalities and anatomical tasks.
  arXiv  Detail & Related papers  (2026-02-22T14:48:42Z)
• TGC-Net: A Structure-Aware and Semantically-Aligned Framework for Text-Guided Medical Image Segmentation [56.09179939570486]
  We propose TGC-Net, a CLIP-based framework focusing on parameter-efficient, task-specific adaptations.<n>TGC-Net achieves state-of-the-art performance with substantially fewer trainable parameters, including notable Dice gains on challenging benchmarks.
  arXiv  Detail & Related papers  (2025-12-24T12:06:26Z)
• Diffusion Model in Latent Space for Medical Image Segmentation Task [0.0]
  MedSegLatDiff is a diffusion based framework that combines a variational autoencoder (VAE) with a latent diffusion model for efficient medical image segmentation.<n>It achieves state of the art or highly competitive Dice and IoU scores while simultaneously generating diverse segmentation hypotheses and confidence maps.
  arXiv  Detail & Related papers  (2025-12-01T05:26:43Z)
• VesSAM: Efficient Multi-Prompting for Segmenting Complex Vessel [68.24765319399286]
  We present VesSAM, a powerful and efficient framework tailored for 2D vessel segmentation.<n>VesSAM integrates (1) a convolutional adapter to enhance local texture features, (2) a multi-prompt encoder that fuses anatomical prompts, and (3) a lightweight mask decoder to reduce jagged artifacts.<n>VesSAM consistently outperforms state-of-the-art PEFT-based SAM variants by over 10% Dice and 13% IoU.
  arXiv  Detail & Related papers  (2025-11-02T15:47:05Z)
• TABNet: A Triplet Augmentation Self-Recovery Framework with Boundary-Aware Pseudo-Labels for Medical Image Segmentation [4.034121387622003]
  We propose TAB Net, a novel weakly-supervised medical image segmentation framework.<n>It consists of the triplet augmentation self-recovery (TAS) module and the boundary-aware pseudo-label supervision (BAP) module.<n>We show that TAB Net significantly outperforms state-of-the-art methods for scribble-based weakly supervised segmentation.
  arXiv  Detail & Related papers  (2025-07-03T07:50:00Z)
• CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation [32.48945636401865]
  We introduce a novel model named CRISP-SAM2 with CRoss-modal Interaction and Semantic Prompting based on SAM2.<n>This model represents a promising approach to multi-organ medical segmentation guided by textual descriptions of organs.<n>Our method begins by converting visual and textual inputs into cross-modal contextualized semantics.
  arXiv  Detail & Related papers  (2025-06-29T07:05:27Z)
• MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentation [5.389510984268956]
  We introduce MARL-MambaContour, the first contour-based medical image segmentation framework based on Multi-Agent Reinforcement Learning (MARL)<n>Our approach reframes segmentation as a multi-agent cooperation task focused on generate topologically consistent object-level contours.<n>Experiments on five diverse medical imaging datasets demonstrate the state-of-the-art performance of MARL-MambaContour.
  arXiv  Detail & Related papers  (2025-06-23T14:22:49Z)
• Point-supervised Brain Tumor Segmentation with Box-prompted MedSAM [11.861051009791224]
  We introduce an iterative framework to facilitate semantic-aware point-supervised MedSAM. Box-prompt generator (SBPG) module has the capacity to convert the point input into potential pseudo bounding box suggestions. Prompt-guided spatial refinement (PGSR) module harnesses the exceptional generalizability of MedSAM to infer the segmentation mask.
  arXiv  Detail & Related papers  (2024-08-01T16:52:39Z)
• Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
  Medical image segmentation plays a crucial role in computer-aided diagnosis. We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
  arXiv  Detail & Related papers  (2023-12-26T12:56:31Z)
• Self-supervised Semantic Segmentation: Consistency over Transformation [3.485615723221064]
  We propose a novel self-supervised algorithm, textbfS$3$-Net, which integrates a robust framework based on the proposed Inception Large Kernel Attention (I-LKA) modules. We leverage deformable convolution as an integral component to effectively capture and delineate lesion deformations for superior object boundary definition. Our experimental results on skin lesion and lung organ segmentation tasks show the superior performance of our method compared to the SOTA approaches.
  arXiv  Detail & Related papers  (2023-08-31T21:28:46Z)
• Scale-aware Super-resolution Network with Dual Affinity Learning for Lesion Segmentation from Medical Images [50.76668288066681]
  We present a scale-aware super-resolution network to adaptively segment lesions of various sizes from low-resolution medical images. Our proposed network achieved consistent improvements compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-30T14:25:55Z)
• Implicit Anatomical Rendering for Medical Image Segmentation with Stochastic Experts [11.007092387379078]
  We propose MORSE, a generic implicit neural rendering framework designed at an anatomical level to assist learning in medical image segmentation. Our approach is to formulate medical image segmentation as a rendering problem in an end-to-end manner. Our experiments demonstrate that MORSE can work well with different medical segmentation backbones.
  arXiv  Detail & Related papers  (2023-04-06T16:44:03Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• Contextual Information Enhanced Convolutional Neural Networks for Retinal Vessel Segmentation in Color Fundus Images [0.0]
  An automatic retinal vessel segmentation system can effectively facilitate clinical diagnosis and ophthalmological research. A deep learning based method has been proposed and several customized modules have been integrated into the well-known encoder-decoder architecture U-net. As a result, the proposed method outperforms the work of predecessors and achieves state-of-the-art performance in Sensitivity/Recall, F1-score and MCC.
  arXiv  Detail & Related papers  (2021-03-25T06:10:47Z)
• Few-shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding [60.89561661441736]
  We propose a novel method for few-shot medical image segmentation. We construct our few-shot image segmentor using a deep convolutional network trained episodically. We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
  arXiv  Detail & Related papers  (2020-12-10T04:01:07Z)
• Context-Aware Refinement Network Incorporating Structural Connectivity Prior for Brain Midline Delineation [50.868845400939314]
  We propose a context-aware refinement network (CAR-Net) to refine and integrate the feature pyramid representation generated by the UNet. For keeping the structural connectivity of the brain midline, we introduce a novel connectivity regular loss. The proposed method requires fewer parameters and outperforms three state-of-the-art methods in terms of four evaluation metrics.
  arXiv  Detail & Related papers  (2020-07-10T14:01:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.