Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of
Alzheimer's Dementia
- URL: http://arxiv.org/abs/2010.01440v2
- Date: Thu, 19 Nov 2020 00:18:59 GMT
- Title: Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of
Alzheimer's Dementia
- Authors: Utkarsh Sarawgi, Wazeer Zulfikar, Rishab Khincha, Pattie Maes
- Abstract summary: We propose an uncertainty-aware boosting technique for multi-modal ensembling to predict Alzheimer's Dementia Severity.
The propagation of uncertainty across acoustic, cognitive, and linguistic features produces an ensemble system robust to heteroscedasticity in the data.
- Score: 39.29536042476913
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Reliability in Neural Networks (NNs) is crucial in safety-critical
applications like healthcare, and uncertainty estimation is a widely researched
method to highlight the confidence of NNs in deployment. In this work, we
propose an uncertainty-aware boosting technique for multi-modal ensembling to
predict Alzheimer's Dementia Severity. The propagation of uncertainty across
acoustic, cognitive, and linguistic features produces an ensemble system robust
to heteroscedasticity in the data. Weighing the different modalities based on
the uncertainty estimates, we experiment on the benchmark ADReSS dataset, a
subject-independent and balanced dataset, to show that our method outperforms
the state-of-the-art methods while also reducing the overall entropy of the
system. This work aims to encourage fair and aware models. The source code is
available at https://github.com/wazeerzulfikar/alzheimers-dementia
Related papers
- Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning [5.318766629972959]
Uncertainty quantification is a crucial but challenging task in many high-dimensional regression or learning problems.
We develop a new data-driven approach for UQ in regression that applies both to classical regression approaches as well as to neural networks.
arXiv Detail & Related papers (2024-07-18T16:42:10Z) - Inadequacy of common stochastic neural networks for reliable clinical
decision support [0.4262974002462632]
Widespread adoption of AI for medical decision making is still hindered due to ethical and safety-related concerns.
Common deep learning approaches, however, have the tendency towards overconfidence under data shift.
This study investigates their actual reliability in clinical applications.
arXiv Detail & Related papers (2024-01-24T18:49:30Z) - Uncertainty Estimation by Fisher Information-based Evidential Deep
Learning [61.94125052118442]
Uncertainty estimation is a key factor that makes deep learning reliable in practical applications.
We propose a novel method, Fisher Information-based Evidential Deep Learning ($mathcalI$-EDL)
In particular, we introduce Fisher Information Matrix (FIM) to measure the informativeness of evidence carried by each sample, according to which we can dynamically reweight the objective loss terms to make the network more focused on the representation learning of uncertain classes.
arXiv Detail & Related papers (2023-03-03T16:12:59Z) - The Unreasonable Effectiveness of Deep Evidential Regression [72.30888739450343]
A new approach with uncertainty-aware regression-based neural networks (NNs) shows promise over traditional deterministic methods and typical Bayesian NNs.
We detail the theoretical shortcomings and analyze the performance on synthetic and real-world data sets, showing that Deep Evidential Regression is a quantification rather than an exact uncertainty.
arXiv Detail & Related papers (2022-05-20T10:10:32Z) - BayesIMP: Uncertainty Quantification for Causal Data Fusion [52.184885680729224]
We study the causal data fusion problem, where datasets pertaining to multiple causal graphs are combined to estimate the average treatment effect of a target variable.
We introduce a framework which combines ideas from probabilistic integration and kernel mean embeddings to represent interventional distributions in the reproducing kernel Hilbert space.
arXiv Detail & Related papers (2021-06-07T10:14:18Z) - Uncertainty-Aware Boosted Ensembling in Multi-Modal Settings [33.25969141014772]
Uncertainty estimation is a widely researched method to highlight the confidence of machine learning systems in deployment.
Sequential and parallel ensemble techniques have shown improved performance of ML systems in multi-modal settings.
We propose an uncertainty-aware boosting technique for multi-modal ensembling in order to focus on the data points with higher associated uncertainty estimates.
arXiv Detail & Related papers (2021-04-21T18:28:13Z) - UNITE: Uncertainty-based Health Risk Prediction Leveraging Multi-sourced
Data [81.00385374948125]
We present UNcertaInTy-based hEalth risk prediction (UNITE) model.
UNITE provides accurate disease risk prediction and uncertainty estimation leveraging multi-sourced health data.
We evaluate UNITE on real-world disease risk prediction tasks: nonalcoholic fatty liver disease (NASH) and Alzheimer's disease (AD)
UNITE achieves up to 0.841 in F1 score for AD detection, up to 0.609 in PR-AUC for NASH detection, and outperforms various state-of-the-art baselines by up to $19%$ over the best baseline.
arXiv Detail & Related papers (2020-10-22T02:28:11Z) - Multimodal Inductive Transfer Learning for Detection of Alzheimer's
Dementia and its Severity [39.57255380551913]
We present a novel architecture that leverages acoustic, cognitive, and linguistic features to form a multimodal ensemble system.
It uses specialized artificial neural networks with temporal characteristics to detect Alzheimer's dementia (AD) and its severity.
Our system achieves state-of-the-art test accuracy, precision, recall, and F1-score of 83.3% each for AD classification, and state-of-the-art test root mean squared error (RMSE) of 4.60 for MMSE score regression.
arXiv Detail & Related papers (2020-08-30T21:47:26Z) - Unlabelled Data Improves Bayesian Uncertainty Calibration under
Covariate Shift [100.52588638477862]
We develop an approximate Bayesian inference scheme based on posterior regularisation.
We demonstrate the utility of our method in the context of transferring prognostic models of prostate cancer across globally diverse populations.
arXiv Detail & Related papers (2020-06-26T13:50:19Z) - Uncertainty Quantification for Inferring Hawkes Networks [13.283258096829146]
We develop a statistical inference framework to learn causal relationships between nodes from networked data.
We provide uncertainty quantification for the maximum likelihood estimate of the network Hawkes process.
arXiv Detail & Related papers (2020-06-12T23:08:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.