Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation
- URL: http://arxiv.org/abs/2604.05415v1
- Date: Tue, 07 Apr 2026 04:19:39 GMT
- Title: Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation
- Abstract summary: We propose a framework that treats wheat disease segmentation as a coupled task of disease-specific semantic perception and disease boundary localization.<n>Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts.<n>We show that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks.
- Score: 51.06355116973389
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Wheat disease segmentation is fundamental to precision agriculture but faces severe challenges from significant intra-class temporal variations across growth stages. Such substantial appearance shifts make collecting a representative dataset for training from scratch both labor-intensive and impractical. To address this, we propose SGPer, a Semantic-Geometric Prior Synergization framework that treats wheat disease segmentation under limited data as a coupled task of disease-specific semantic perception and disease boundary localization. Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts, which can be converted into coarse spatial prompts to guide SAM for the precise localization of disease boundaries. Specifically, SGPer designs disease-sensitive adapters with multiple disease-friendly filters and inserts them into both DINOv2 and SAM to align their pretrained representations with disease-specific characteristics. To operationalize this synergy, SGPer transforms DINOv2-derived features into dense, category-specific point prompts to ensure comprehensive spatial coverage of all disease regions. To subsequently eliminate prompt redundancy and ensure highly accurate mask generation, it dynamically filters these dense candidates by cross-referencing SAM's iterative mask confidence with the category-specific semantic consistency derived from DINOv2. Ultimately, SGPer distills a highly informative set of prompts to activate SAM's geometric priors, achieving precise and robust segmentation that remains strictly invariant to temporal appearance changes. Extensive evaluations demonstrate that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks, especially in data-constrained scenarios.
Related papers
- CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation [15.230353995992246]
Cross is a tightly integrated paradigm for referring Remote Sensing Image.<n>First, we introduce Linguistic-Guided Cascaded Distillation (LGCD) to bridge the architectural gap.<n>Second, Perspective-Spatial Contrastive Learning (PSCL) imposes cross-anchored constraints.
arXiv Detail & Related papers (2026-08-04T05:24:05Z) - Re-thinking Mammography Transfer Learning: The Dataset-Informed Transfer Learning (DITL) Framework for Breast Cancer Screening and Lesion Diagnosis [3.616534682321388]
We propose the dataset-informed transfer learning framework, which integrates dataset-derived difficulty signals with neighborhood-based triplet supervision.<n>DITL achieves state-of-the-art performance for whole-image breast density classification, with significant improvements across accuracy, F1-score, and AUC.<n>By bridging small-scale lesion analysis with large-scale density estimation, DITL establishes a clinically relevant, scalable, and generalizable framework for mammography classification.
arXiv Detail & Related papers (2026-07-28T17:52:36Z) - TimeLesSeg: Unified Contrast-Agnostic Cross-Sectional and Longitudinal MS Lesion Segmentation via a Stochastic Generative Model [0.338424069286569]
TimeLesSeg is a unified contrast-agnostic framework designed to segment MS lesions regardless of the presence of a temporal dimension in its inputs.<n>Our approach models pathological priors through lesion masks, which are processed together with the current scan.<n>Cross-sectional processing is enabled by exposing the model to training cases where no prior information is available.
arXiv Detail & Related papers (2026-05-08T16:19:34Z) - Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers [57.54843029965778]
Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail.<n>We propose In-Context Diffusion Transformer (IC-DiT), a layout-aware generative model that incorporates spatial layouts, textual descriptions, and visual embeddings into a unified diffusion transformer.<n>IC-DiT achieves higher fidelity, stronger spatial controllability, and better diagnostic consistency than existing methods.
arXiv Detail & Related papers (2026-03-11T06:14:11Z) - A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
arXiv Detail & Related papers (2025-12-15T10:22:43Z) - The 1st Solution for CARE Liver Task Challenge 2025: Contrast-Aware Semi-Supervised Segmentation with Domain Generalization and Test-Time Adaptation [23.156209918252838]
CoSSeg-TTA is a compact segmentation framework for the GED4 (Gd-EOB-DTPA enhanced hepatobiliary phase MRI) modality built upon nnU-Netv2.<n>A domain adaptation module, incorporating a randomized histogram-based style appearance transfer function and a trainable contrast-aware network, enriches domain diversity and mitigates cross-center variability.
arXiv Detail & Related papers (2025-10-05T15:18:53Z) - Generate Aligned Anomaly: Region-Guided Few-Shot Anomaly Image-Mask Pair Synthesis for Industrial Inspection [53.137651284042434]
Anomaly inspection plays a vital role in industrial manufacturing, but the scarcity of anomaly samples limits the effectiveness of existing methods.<n>We propose Generate grained Anomaly (GAA), a region-guided, few-shot anomaly image-mask pair generation framework.<n>GAA generates realistic, diverse, and semantically aligned anomalies using only a small number of samples.
arXiv Detail & Related papers (2025-07-13T12:56:59Z) - MedSeg-R: Medical Image Segmentation with Clinical Reasoning [28.33172310047359]
We propose MedSeg-R, a lightweight, dual-stage framework inspired by inspired by clinical reasoning.<n>Its cognitive stage interprets medical report into structured semantic priors, which are fused via transformer block.<n>In challenging benchmarks, MedSeg-R produces large Dice improvements in overlapping and ambiguous structures.
arXiv Detail & Related papers (2025-06-23T14:14:09Z) - ConDiSR: Contrastive Disentanglement and Style Regularization for Single Domain Generalization [42.810247034149214]
Medical data often exhibits distribution shifts, which cause test-time performance degradation for deep learning models trained using standard pipelines.
This study highlights the importance and challenges of exploring Single Domain Generalization frameworks in the context of the classification task.
arXiv Detail & Related papers (2024-03-14T13:50:44Z) - TraSeTR: Track-to-Segment Transformer with Contrastive Query for
Instance-level Instrument Segmentation in Robotic Surgery [60.439434751619736]
We propose TraSeTR, a Track-to-Segment Transformer that exploits tracking cues to assist surgical instrument segmentation.
TraSeTR jointly reasons about the instrument type, location, and identity with instance-level predictions.
The effectiveness of our method is demonstrated with state-of-the-art instrument type segmentation results on three public datasets.
arXiv Detail & Related papers (2022-02-17T05:52:18Z) - Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions
Segmentation [79.58311369297635]
We propose a new weakly-supervised lesions transfer framework, which can explore transferable domain-invariant knowledge across different datasets.
A Wasserstein quantified transferability framework is developed to highlight widerange transferable contextual dependencies.
A novel self-supervised pseudo label generator is designed to equally provide confident pseudo pixel labels for both hard-to-transfer and easy-to-transfer target samples.
arXiv Detail & Related papers (2020-12-08T02:26:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.