Diffusion-Guided Mask-Consistent Paired Mixing for Endoscopic Image Segmentation

• URL: http://arxiv.org/abs/2511.03219v1
• Date: Wed, 05 Nov 2025 06:14:19 GMT
• Title: Diffusion-Guided Mask-Consistent Paired Mixing for Endoscopic Image Segmentation
• Authors: Pengyu Jie, Wanquan Liu, Rui He, Yihui Wen, Deyu Meng, Chenqiang Gao,
• Abstract summary: We propose a paired, diffusion-guided paradigm that fuses the strengths of sample mixing and diffusion synthesis.<n>For each real image, a synthetic counterpart is generated under the same mask and the pair is used as a controllable input for Mask-Consistent Paired Mixing (MCPMix)<n>This produces a continuous family of intermediate samples that smoothly bridges synthetic and real appearances under shared geometry.
• Score: 57.37991748282666
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Augmentation for dense prediction typically relies on either sample mixing or generative synthesis. Mixing improves robustness but misaligned masks yield soft label ambiguity. Diffusion synthesis increases apparent diversity but, when trained as common samples, overlooks the structural benefit of mask conditioning and introduces synthetic-real domain shift. We propose a paired, diffusion-guided paradigm that fuses the strengths of both. For each real image, a synthetic counterpart is generated under the same mask and the pair is used as a controllable input for Mask-Consistent Paired Mixing (MCPMix), which mixes only image appearance while supervision always uses the original hard mask. This produces a continuous family of intermediate samples that smoothly bridges synthetic and real appearances under shared geometry, enlarging diversity without compromising pixel-level semantics. To keep learning aligned with real data, Real-Anchored Learnable Annealing (RLA) adaptively adjusts the mixing strength and the loss weight of mixed samples over training, gradually re-anchoring optimization to real data and mitigating distributional bias. Across Kvasir-SEG, PICCOLO, CVC-ClinicDB, a private NPC-LES cohort, and ISIC 2017, the approach achieves state-of-the-art segmentation performance and consistent gains over baselines. The results show that combining label-preserving mixing with diffusion-driven diversity, together with adaptive re-anchoring, yields robust and generalizable endoscopic segmentation.

Related papers

• Rejection Mixing: Fast Semantic Propagation of Mask Tokens for Efficient DLLM Inference [58.189320101488725]
  DLLMs promise fast non-autoregressive inference but suffer a severe quality-speed trade-off in parallel decoding.<n>We address this by integrating continuous representations into the discrete decoding process, as they preserve rich inter-position dependency.<n>We propose ReMix, a framework that introduces a novel Continuous Mixing State as an intermediate between the initial masked state and the final decoded token state.
  arXiv  Detail & Related papers  (2026-02-26T11:08:11Z)
• Two-Step Data Augmentation for Masked Face Detection and Recognition: Turning Fake Masks to Real [5.1215389305751735]
  We propose a two-step generative data augmentation framework that combines rule-based mask warping with unpaired image-to-image translation using GANs.<n>Compared to rule-based warping alone, the proposed approach yields consistent qualitative improvements.<n>We introduce a non-mask loss preservation and noise injection to stabilize training and enhance sample diversity.
  arXiv  Detail & Related papers  (2025-12-13T15:20:08Z)
• Aligning What You Separate: Denoised Patch Mixing for Source-Free Domain Adaptation in Medical Image Segmentation [11.298724831730675]
  Source-Free Domain Adaptation (SFDA) is emerging as a compelling solution for medical image segmentation under privacy constraints.<n>We present a new SFDA framework that leverages Hard Sample Selection and Denoised Patch Mixing to progressively align target distributions.
  arXiv  Detail & Related papers  (2025-10-29T07:05:26Z)
• Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspection [53.137651284042434]
  Anomaly inspection plays a vital role in industrial manufacturing, but the scarcity of anomaly samples limits the effectiveness of existing methods.<n>We propose Generate grained Anomaly (GAA), a region-guided, few-shot anomaly image-mask pair generation framework.<n>GAA generates realistic, diverse, and semantically aligned anomalies using only a small number of samples.
  arXiv  Detail & Related papers  (2025-07-13T12:56:59Z)
• Noise-Consistent Siamese-Diffusion for Medical Image Synthesis and Segmentation [9.795456238314825]
  We introduce Siamese-Diffusion, a novel dual-component model comprising Mask-Diffusion and Image-Diffusion.<n>During training, a Noise Consistency Loss is introduced between these components to enhance the morphological fidelity of Mask-Diffusion.
  arXiv  Detail & Related papers  (2025-05-09T14:07:27Z)
• Adaptive Mix for Semi-Supervised Medical Image Segmentation [22.69909762038458]
  Mix-up is a key technique for consistency regularization-based semi-supervised learning methods.<n>We propose an Adaptive Mix algorithm (AdaMix) for image mix-up in a self-paced learning manner.
  arXiv  Detail & Related papers  (2024-07-31T13:19:39Z)
• PowMix: A Versatile Regularizer for Multimodal Sentiment Analysis [71.8946280170493]
  This paper introduces PowMix, a versatile embedding space regularizer that builds upon the strengths of unimodal mixing-based regularization approaches. PowMix is integrated before the fusion stage of multimodal architectures and facilitates intra-modal mixing, such as mixing text with text, to act as a regularizer.
  arXiv  Detail & Related papers  (2023-12-19T17:01:58Z)
• Adversarial AutoMixup [50.1874436169571]
  We propose AdAutomixup, an adversarial automatic mixup augmentation approach. It generates challenging samples to train a robust classifier for image classification. Our approach outperforms the state of the art in various classification scenarios.
  arXiv  Detail & Related papers  (2023-12-19T08:55:00Z)
• Harnessing Hard Mixed Samples with Decoupled Regularizer [69.98746081734441]
  Mixup is an efficient data augmentation approach that improves the generalization of neural networks by smoothing the decision boundary with mixed data. In this paper, we propose an efficient mixup objective function with a decoupled regularizer named Decoupled Mixup (DM) DM can adaptively utilize hard mixed samples to mine discriminative features without losing the original smoothness of mixup.
  arXiv  Detail & Related papers  (2022-03-21T07:12:18Z)
• DAMix: Density-Aware Data Augmentation for Unsupervised Domain Adaptation on Single Image Dehazing [2.2678980997015534]
  We propose a density-aware data augmentation method (DAMix) that generates synthetic hazy samples according to the haze density level of the target domain. DAMix ensures that the model learns from examples featuring diverse haze densities. We develop a dual-branch dehazing network involving two branches that can adaptively remove haze according to the haze density of the region.
  arXiv  Detail & Related papers  (2021-09-26T09:45:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.