Bilinear pooling and metric learning network for early Alzheimer's
disease identification with FDG-PET images
- URL: http://arxiv.org/abs/2111.04985v1
- Date: Tue, 9 Nov 2021 08:17:55 GMT
- Title: Bilinear pooling and metric learning network for early Alzheimer's
disease identification with FDG-PET images
- Authors: Wenju Cui, Caiying Yan, Zhuangzhi Yan, Yunsong Peng, Yilin Leng,
Chenlu Liu, Shuangqing Chen, Xi Jiang
- Abstract summary: FDG-PET reveals altered brain metabolism in individuals with mild cognitive impairment (MCI) and Alzheimer's disease (AD)
In this paper, we propose a novel bilinear pooling and metric learning network (BMNet) which can extract the inter-region representation features and distinguish hard samples by embedding space.
- Score: 0.293168019422713
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: FDG-PET reveals altered brain metabolism in individuals with mild cognitive
impairment (MCI) and Alzheimer's disease (AD). Some biomarkers derived from
FDG-PET by computer-aided-diagnosis (CAD) technologies have been proved that
they can accurately diagnosis normal control (NC), MCI, and AD. However, the
studies of identification of early MCI (EMCI) and late MCI (LMCI) with FDG-PET
images are still insufficient. Compared with studies based on fMRI and DTI
images, the researches of the inter-region representation features in FDG-PET
images are insufficient. Moreover, considering the variability in different
individuals, some hard samples which are very similar with both two classes
limit the classification performance. To tackle these problems, in this paper,
we propose a novel bilinear pooling and metric learning network (BMNet), which
can extract the inter-region representation features and distinguish hard
samples by constructing embedding space. To validate the proposed method, we
collect 998 FDG-PET images from ADNI. Following the common preprocessing steps,
90 features are extracted from each FDG-PET image according to the automatic
anatomical landmark (AAL) template and then sent into the proposed network.
Extensive 5-fold cross-validation experiments are performed for multiple
two-class classifications. Experiments show that most metrics are improved
after adding the bilinear pooling module and metric losses to the Baseline
model respectively. Specifically, in the classification task between EMCI and
LMCI, the specificity improves 6.38% after adding the triple metric loss, and
the negative predictive value (NPV) improves 3.45% after using the bilinear
pooling module.
Related papers
- Multi-modal Evidential Fusion Network for Trusted PET/CT Tumor Segmentation [5.839660501978193]
The quality of PET and CT images varies widely in clinical settings, which leads to uncertainty in the modality information extracted by networks.
This paper proposes a novel Multi-modal Evidential Fusion Network (MEFN) comprising a Cross-Modal Feature Learning (CFL) module and a Multi-modal Trusted Fusion (MTF) module.
Our model can provide radiologists with credible uncertainty of the segmentation results for their decision in accepting or rejecting the automatic segmentation results.
arXiv Detail & Related papers (2024-06-26T13:14:24Z) - Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection.
Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels.
Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
arXiv Detail & Related papers (2024-03-19T09:28:19Z) - PET Tracer Conversion among Brain PET via Variable Augmented Invertible
Network [8.895830601854534]
A tracer conversion invertible neural network (TC-INN) for image projection is developed to map FDG images to DOPA images through deep learning.
Experimental results exhibited excellent generation capability in mapping between FDG and DOPA, suggesting that PET tracer conversion has great potential in the case of limited tracer applications.
arXiv Detail & Related papers (2023-11-01T12:04:33Z) - The effect of data augmentation and 3D-CNN depth on Alzheimer's Disease
detection [51.697248252191265]
This work summarizes and strictly observes best practices regarding data handling, experimental design, and model evaluation.
We focus on Alzheimer's Disease (AD) detection, which serves as a paradigmatic example of challenging problem in healthcare.
Within this framework, we train predictive 15 models, considering three different data augmentation strategies and five distinct 3D CNN architectures.
arXiv Detail & Related papers (2023-09-13T10:40:41Z) - Contrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine
PET Reconstruction [62.29541106695824]
This paper presents a coarse-to-fine PET reconstruction framework that consists of a coarse prediction module (CPM) and an iterative refinement module (IRM)
By delegating most of the computational overhead to the CPM, the overall sampling speed of our method can be significantly improved.
Two additional strategies, i.e., an auxiliary guidance strategy and a contrastive diffusion strategy, are proposed and integrated into the reconstruction process.
arXiv Detail & Related papers (2023-08-20T04:10:36Z) - Mediastinal Lymph Node Detection and Segmentation Using Deep Learning [1.7188280334580195]
In clinical practice, computed tomography (CT) and positron emission tomography (PET) imaging detect abnormal lymph nodes (LNs)
Deep convolutional neural networks frequently segment items in medical photographs.
A well-established deep learning technique UNet was modified using bilinear and total generalized variation (TGV) based up strategy to segment and detect mediastinal lymph nodes.
The modified UNet maintains texture discontinuities, selects noisy areas, searches appropriate balance points through backpropagation, and recreates image resolution.
arXiv Detail & Related papers (2022-11-24T02:55:20Z) - Stacking Ensemble Learning in Deep Domain Adaptation for Ophthalmic
Image Classification [61.656149405657246]
Domain adaptation is effective in image classification tasks where obtaining sufficient label data is challenging.
We propose a novel method, named SELDA, for stacking ensemble learning via extending three domain adaptation methods.
The experimental results using Age-Related Eye Disease Study (AREDS) benchmark ophthalmic dataset demonstrate the effectiveness of the proposed model.
arXiv Detail & Related papers (2022-09-27T14:19:00Z) - ReCasNet: Improving consistency within the two-stage mitosis detection
framework [5.263015177621435]
Existing approaches utilize a two-stage pipeline: the detection stage for identifying the locations of potential mitotic cells and the classification stage for refining prediction confidences.
This pipeline formulation can lead to inconsistencies in the classification stage due to the poor prediction quality of the detection stage and the mismatches in training data distributions.
We propose a Refine Cascade Network (ReCasNet), an enhanced deep learning pipeline that mitigates the aforementioned problems with three improvements.
arXiv Detail & Related papers (2022-02-28T16:03:14Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - Evidential segmentation of 3D PET/CT images [20.65495780362289]
A segmentation method based on belief functions is proposed to segment lymphomas in 3D PET/CT images.
The architecture is composed of a feature extraction module and an evidential segmentation (ES) module.
The method was evaluated on a database of 173 patients with diffuse large b-cell lymphoma.
arXiv Detail & Related papers (2021-04-27T16:06:27Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.