AMD-Mamba: A Phenotype-Aware Multi-Modal Framework for Robust AMD Prognosis
- URL: http://arxiv.org/abs/2508.02957v1
- Date: Mon, 04 Aug 2025 23:47:57 GMT
- Title: AMD-Mamba: A Phenotype-Aware Multi-Modal Framework for Robust AMD Prognosis
- Authors: Puzhen Wu, Mingquan Lin, Qingyu Chen, Emily Y. Chew, Zhiyong Lu, Yifan Peng, Hexin Dong,
- Abstract summary: AMD-Mamba is a novel multi-modal framework for AMD prognosis.<n>It integrates color fundus images with genetic variants and socio-demographic variables.
- Score: 14.878328608023285
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Age-related macular degeneration (AMD) is a leading cause of irreversible vision loss, making effective prognosis crucial for timely intervention. In this work, we propose AMD-Mamba, a novel multi-modal framework for AMD prognosis, and further develop a new AMD biomarker. This framework integrates color fundus images with genetic variants and socio-demographic variables. At its core, AMD-Mamba introduces an innovative metric learning strategy that leverages AMD severity scale score as prior knowledge. This strategy allows the model to learn richer feature representations by aligning learned features with clinical phenotypes, thereby improving the capability of conventional prognosis methods in capturing disease progression patterns. In addition, unlike existing models that use traditional CNN backbones and focus primarily on local information, such as the presence of drusen, AMD-Mamba applies Vision Mamba and simultaneously fuses local and long-range global information, such as vascular changes. Furthermore, we enhance prediction performance through multi-scale fusion, combining image information with clinical variables at different resolutions. We evaluate AMD-Mamba on the AREDS dataset, which includes 45,818 color fundus photographs, 52 genetic variants, and 3 socio-demographic variables from 2,741 subjects. Our experimental results demonstrate that our proposed biomarker is one of the most significant biomarkers for the progression of AMD. Notably, combining this biomarker with other existing variables yields promising improvements in detecting high-risk AMD patients at early stages. These findings highlight the potential of our multi-modal framework to facilitate more precise and proactive management of AMD.
Related papers
- Deep Learning for Retinal Degeneration Assessment: A Comprehensive Analysis of the MARIO AMD Progression Challenge [26.28807646471968]
The MARIO challenge, held at MICCAI 2024, focused on advancing the automated detection and monitoring of age-related macular degeneration (AMD)<n>The primary dataset, sourced from Brest, France, was used by participating teams to train and test their models.<n>An auxiliary dataset from Algeria was used post-challenge to evaluate population and device shifts.
arXiv Detail & Related papers (2025-06-03T15:14:10Z) - Automatic detection and prediction of nAMD activity change in retinal OCT using Siamese networks and Wasserstein Distance for ordinality [0.7832670743787916]
Neovascular age-related macular degeneration (nAMD) is a leading cause of vision loss among older adults.<n>Recent advancements in deep learning offer a promising solution for predicting changes in AMD from optical coherence tomography ( OCT) retinal volumes.
arXiv Detail & Related papers (2025-01-24T08:35:22Z) - Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis [55.959002385347645]
Latent Drifting enables diffusion models to be conditioned for medical images fitted for the complex task of counterfactual image generation.<n>We evaluate our method on three public longitudinal benchmark datasets of brain MRI and chest X-rays for counterfactual image generation.
arXiv Detail & Related papers (2024-12-30T01:59:34Z) - GFE-Mamba: Mamba-based AD Multi-modal Progression Assessment via Generative Feature Extraction from MCI [5.834776094182435]
Alzheimer's Disease (AD) is a progressive, irreversible neurodegenerative disorder that often originates from Mild Cognitive Impairment (MCI)<n>The GFE-Mamba model effectively predicts the progression from MCI to AD and surpasses several leading methods in the field.
arXiv Detail & Related papers (2024-07-22T15:22:33Z) - Phy-Diff: Physics-guided Hourglass Diffusion Model for Diffusion MRI Synthesis [45.074243735766]
We propose a physics-guided diffusion model to generate high-quality dMRI.
Our model introduces the physical principles of dMRI in the noise evolution in the diffusion process.
Our experiment results show that our method outperforms other state-of-the-art methods.
arXiv Detail & Related papers (2024-06-05T07:09:19Z) - Genetic InfoMax: Exploring Mutual Information Maximization in
High-Dimensional Imaging Genetics Studies [50.11449968854487]
Genome-wide association studies (GWAS) are used to identify relationships between genetic variations and specific traits.
Representation learning for imaging genetics is largely under-explored due to the unique challenges posed by GWAS.
We introduce a trans-modal learning framework Genetic InfoMax (GIM) to address the specific challenges of GWAS.
arXiv Detail & Related papers (2023-09-26T03:59:21Z) - Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood [64.95663299945171]
Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming.
There exists a noticeable gap in sample quality between EBMs and other generative frameworks like GANs and diffusion models.
We propose cooperative diffusion recovery likelihood (CDRL), an effective approach to tractably learn and sample from a series of EBMs.
arXiv Detail & Related papers (2023-09-10T22:05:24Z) - AMDNet23: A combined deep Contour-based Convolutional Neural Network and
Long Short Term Memory system to diagnose Age-related Macular Degeneration [0.0]
This study operates on a AMDNet23 system of deep learning that combined the neural networks made up of convolutions (CNN) and short-term and long-term memory (LSTM) to automatically detect aged macular degeneration (AMD) disease from fundus ophthalmology.
The proposed hybrid deep AMDNet23 model demonstrates to detection of AMD ocular disease and the experimental result achieved an accuracy 96.50%, specificity 99.32%, sensitivity 96.5%, and F1-score 96.49.0%.
arXiv Detail & Related papers (2023-08-30T07:48:32Z) - Differentiable Agent-based Epidemiology [71.81552021144589]
We introduce GradABM: a scalable, differentiable design for agent-based modeling that is amenable to gradient-based learning with automatic differentiation.
GradABM can quickly simulate million-size populations in few seconds on commodity hardware, integrate with deep neural networks and ingest heterogeneous data sources.
arXiv Detail & Related papers (2022-07-20T07:32:02Z) - Benchmarking Machine Learning Robustness in Covid-19 Genome Sequence
Classification [109.81283748940696]
We introduce several ways to perturb SARS-CoV-2 genome sequences to mimic the error profiles of common sequencing platforms such as Illumina and PacBio.
We show that some simulation-based approaches are more robust (and accurate) than others for specific embedding methods to certain adversarial attacks to the input sequences.
arXiv Detail & Related papers (2022-07-18T19:16:56Z) - Improving AMD diagnosis by the simultaneous identification of associated
retinal lesions [9.707114016577716]
Age-related Macular Degeneration (AMD) is the predominant cause of blindness in developed countries.
We propose a novel approach based on CNNs that simultaneously performs AMD diagnosis and the classification of its potential lesions.
arXiv Detail & Related papers (2022-05-22T17:52:02Z) - ADAM Challenge: Detecting Age-related Macular Degeneration from Fundus
Images [44.212866865895485]
We set up the Automatic Detection challenge on Age-related Macular degeneration (ADAM) for the first time, held as a satellite event of the I SBI 2020 conference.
ADAM challenge consists of four tasks which cover the main topics in detecting AMD from fundus images.
This paper introduces the challenge, dataset, and evaluation methods, as well as summarizes the methods and analyzes the results of the participating teams of each task.
arXiv Detail & Related papers (2022-02-16T10:49:49Z) - Adversarial Factor Models for the Generation of Improved Autism
Diagnostic Biomarkers [19.48133927082379]
We present applications of adversarial linear factor models in the creation of improved biomarkers for autism spectrum disorder (ASD) diagnosis.
First, we demonstrate that an adversarial linear factor model can be used to remove confounding information from our biomarkers, ensuring that they contain only pertinent information on ASD.
Second, we show this same model can be used to learn a disentangled representation of multimodal biomarkers that results in an increase in predictive performance.
arXiv Detail & Related papers (2021-09-24T21:56:30Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.