Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images
- URL: http://arxiv.org/abs/2604.10084v1
- Date: Sat, 11 Apr 2026 08:06:28 GMT
- Title: Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images
- Abstract summary: The study aims to address the challenge of aligning Standard Fundus Images (SFIs) and Ultra-Widefield Fundus Images (UWFIs)<n>Currently, no specialized method exists for this task, and existing image alignment techniques lack accuracy.<n>We propose Active Diffusion Matching (ADM), a novel cross-modal alignment method.
- Score: 43.88837473377858
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Objective: The study aims to address the challenge of aligning Standard Fundus Images (SFIs) and Ultra-Widefield Fundus Images (UWFIs), which is difficult due to their substantial differences in viewing range and the amorphous appearance of the retina. Currently, no specialized method exists for this task, and existing image alignment techniques lack accuracy. Methods: We propose Active Diffusion Matching (ADM), a novel cross-modal alignment method. ADM integrates two interdependent score-based diffusion models to jointly estimate global transformations and local deformations via an iterative Langevin Markov chain. This approach facilitates a stochastic, progressive search for optimal alignment. Additionally, custom sampling strategies are introduced to enhance the adaptability of ADM to given input image pairs. Results: Comparative experimental evaluations demonstrate that ADM achieves state-of-the-art alignment accuracy. This was validated on two datasets: a private dataset of SFI-UWFI pairs and a public dataset of SFI-SFI pairs, with mAUC improvements of 5.2 and 0.4 points on the private and public datasets, respectively, compared to existing state-of-the-art methods. Conclusion: ADM effectively bridges the gap in aligning SFIs and UWFIs, providing an innovative solution to a previously unaddressed challenge. The method's ability to jointly optimize global and local alignment makes it highly effective for cross-modal image alignment tasks. Significance: ADM has the potential to transform the integrated analysis of SFIs and UWFIs, enabling better clinical utility and supporting learning-based image enhancements. This advancement could significantly improve diagnostic accuracy and patient outcomes in ophthalmology.
Related papers
- Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images [48.646448077284276]
We propose Spatial-FAD, a framework for effective few-shot medical anomaly detection.<n>It improves lesion localization by combining VFM spatial priors with CLIP semantics.<n>Our method achieves an average improvement of over 11.4% in Dice score and 1.8% in AUC.
arXiv Detail & Related papers (2026-09-11T05:21:01Z) - Dementia Etiology Diagnosis via Collaborative Meta Knowledge Enhancement [81.27196033392559]
We propose a Collaborative Meta Knowledge Enhancement (COME) framework for dementia etiology diagnosis.<n>COME injects multi-center acquisition semantics, source identifiers, and modality indicators as heterogeneity-aware embeddings into a unified Transformer architecture for scale-up training.<n>Our method achieves state-of-the-art in-domain performance with a mean macro-averaged AUC of 85.62% and a 4.29-point gain over the strongest baseline.
arXiv Detail & Related papers (2026-07-24T04:26:47Z) - Cross-Modal Semantic-Enhanced Diffusion Framework for Diabetic Retinopathy Grading [7.923081487850825]
We propose a vision-language model tailored for diabetic retinopathy (DR) grading as the semantic guidance module.<n>We construct a cross-modal semantic conditioning vector by computing the dot product between image features and the text description features of each DR grade.<n> Experiments on the APTOS 2019 dataset demonstrate that the proposed approach achieves an accuracy of 87.5% and a macro-averaged F1 score of 0.731, outperforming a variety of representative methods.
arXiv Detail & Related papers (2026-05-10T00:58:17Z) - Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization [9.744491531292393]
A key technique in multi-modal processing, infrared and visible image fusion (IVIF) plays a crucial role in integrating complementary spectral information for visual enhancement and downstream vision tasks.<n>We propose DPOFusion, a direct preference optimization (DPO) framework integrating the property-aligned latent diffusion model (PALDM) and the preference-controllable latent diffusion model (PCLDM)<n>Our framework not only attains precise preference alignment among humans, vision-language models, and task-driven networks, but also sets a new benchmark for adaptive fusion quality and task-oriented transferability.
arXiv Detail & Related papers (2026-05-07T11:34:41Z) - Particle Diffusion Matching: Random Walk Correspondence Search for the Alignment of Standard and Ultra-Widefield Fundus Images [47.944896477309555]
We propose a robust alignment technique for Standard Fundus Images (SFIs) and Ultra-Widefield Fundus Images (UWFIs)<n>Our method, termed Particle Diffusion Matching (PDM), performs alignment through an iterative Random Walk Correspondence Search (RWCS) guided by a diffusion model.<n>PDM achieves state-of-the-art performance across multiple retinal image alignment benchmarks.
arXiv Detail & Related papers (2026-04-11T08:09:53Z) - LatentFM: A Latent Flow Matching Approach for Generative Medical Image Segmentation [0.0]
We propose LatentFM, a flow-based model operating in the latent space for medical image segmentation.<n>By sampling multiple latent representations, our method synthesizes diverse segmentation outputs.<n>Our approach achieves superior segmentation accuracy while remaining highly efficient in the latent space.
arXiv Detail & Related papers (2025-12-04T14:06:08Z) - MDPG: Multi-domain Diffusion Prior Guidance for MRI Reconstruction [0.4893345190925178]
We propose Multi-domain Diffusion Prior Guidance (MDPG) to enhance data consistency in MRI reconstruction tasks.<n> Specifically, we first construct a Visual-Mamba-based backbone, which enables efficient encoding and reconstruction of under-sampled images.<n>A novel Latent Guided Attention (LGA) is proposed for efficient fusion in multi-level latent domains.
arXiv Detail & Related papers (2025-06-30T10:25:08Z) - AMF-MedIT: An Efficient Align-Modulation-Fusion Framework for Medical Image-Tabular Data [7.738256774143484]
AMF-MedIT is an efficient framework for medical image and tabular data integration.<n>It harmonizes dimension discrepancies and dynamically balances modality contributions.<n>It achieves superior accuracy, robustness, and data efficiency across multimodal classification tasks.
arXiv Detail & Related papers (2025-06-24T09:10:35Z) - DMS-Net:Dual-Modal Multi-Scale Siamese Network for Binocular Fundus Image Classification [8.86559854172874]
We propose DMS-Net, a dual-modal multi-scale siamese network for binocular retinal image classification.<n>The framework employs a weight-sharing siamese ResNet-152 architecture to concurrently extract deep semantic features from bilateral fundus images.<n>It achieves state-of-the-art performance with an accuracy of 82.9%, recall of 84.5%, and a Cohen's kappa coefficient of 83.2%.
arXiv Detail & Related papers (2025-04-25T03:27:28Z) - ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic
Diffusion Models [69.9178140563928]
Colonoscopy analysis is essential for assisting clinical diagnosis and treatment.
The scarcity of annotated data limits the effectiveness and generalization of existing methods.
We propose an Adaptive Refinement Semantic Diffusion Model (ArSDM) to generate colonoscopy images that benefit the downstream tasks.
arXiv Detail & Related papers (2023-09-03T07:55:46Z) - Consistency Regularization for Generalizable Source-free Domain
Adaptation [62.654883736925456]
Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset.
Existing SFDA methods ONLY assess their adapted models on the target training set, neglecting the data from unseen but identically distributed testing sets.
We propose a consistency regularization framework to develop a more generalizable SFDA method.
arXiv Detail & Related papers (2023-08-03T07:45:53Z) - Inter-class Discrepancy Alignment for Face Recognition [55.578063356210144]
We propose a unified framework calledInter-class DiscrepancyAlignment(IDA)
IDA-DAO is used to align the similarity scores considering the discrepancy between the images and its neighbors.
IDA-SSE can provide convincing inter-class neighbors by introducing virtual candidate images generated with GAN.
arXiv Detail & Related papers (2021-03-02T08:20:08Z) - Unsupervised Bidirectional Cross-Modality Adaptation via Deeply
Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA)
Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives.
Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
arXiv Detail & Related papers (2020-02-06T13:49:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.