Interpretable factorization of clinical questionnaires to identify
latent factors of psychopathology
- URL: http://arxiv.org/abs/2312.07762v1
- Date: Tue, 12 Dec 2023 22:10:38 GMT
- Title: Interpretable factorization of clinical questionnaires to identify
latent factors of psychopathology
- Authors: Ka Chun Lam, Bridget W Mahony, Armin Raznahan, Francisco Pereira
- Abstract summary: We introduce interpretability constrained questionnaire factorization (ICQF), a non-negative matrix factorization method with regularization tailored for questionnaire data.
We show that ICQF improves interpretability, as defined by domain experts, while preserving diagnostic information across a range of disorders.
- Score: 1.9051761801489249
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Psychiatry research seeks to understand the manifestations of psychopathology
in behavior, as measured in questionnaire data, by identifying a small number
of latent factors that explain them. While factor analysis is the traditional
tool for this purpose, the resulting factors may not be interpretable, and may
also be subject to confounding variables. Moreover, missing data are common,
and explicit imputation is often required. To overcome these limitations, we
introduce interpretability constrained questionnaire factorization (ICQF), a
non-negative matrix factorization method with regularization tailored for
questionnaire data. Our method aims to promote factor interpretability and
solution stability. We provide an optimization procedure with theoretical
convergence guarantees, and an automated procedure to detect latent
dimensionality accurately. We validate these procedures using realistic
synthetic data. We demonstrate the effectiveness of our method in a widely used
general-purpose questionnaire, in two independent datasets (the Healthy Brain
Network and Adolescent Brain Cognitive Development studies). Specifically, we
show that ICQF improves interpretability, as defined by domain experts, while
preserving diagnostic information across a range of disorders, and outperforms
competing methods for smaller dataset sizes. This suggests that the
regularization in our method matches domain characteristics. The python
implementation for ICQF is available at
\url{https://github.com/jefferykclam/ICQF}.
Related papers
- Interpretability of Uncertainty: Exploring Cortical Lesion Segmentation in Multiple Sclerosis [33.91263917157504]
Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems.
This study addresses the interpretability of instance-wise uncertainty values in deep learning models for focal lesion segmentation in magnetic resonance imaging.
arXiv Detail & Related papers (2024-07-08T09:13:30Z) - Unified Uncertainty Estimation for Cognitive Diagnosis Models [70.46998436898205]
We propose a unified uncertainty estimation approach for a wide range of cognitive diagnosis models.
We decompose the uncertainty of diagnostic parameters into data aspect and model aspect.
Our method is effective and can provide useful insights into the uncertainty of cognitive diagnosis.
arXiv Detail & Related papers (2024-03-09T13:48:20Z) - PULASki: Learning inter-rater variability using statistical distances to
improve probabilistic segmentation [36.136619420474766]
We propose the PULASki for biomedical image segmentation that accurately captures variability in expert annotations.
Our approach makes use of an improved loss function based on statistical distances in a conditional variational autoencoder structure.
Our method can also be applied to a wide range of multi-label segmentation tasks and is useful for downstream tasks such as hemodynamic modelling.
arXiv Detail & Related papers (2023-12-25T10:31:22Z) - Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable.
Existing susceptibility studies heavily rely on self-reported beliefs.
We propose a computational approach to model users' latent susceptibility levels.
arXiv Detail & Related papers (2023-11-16T07:22:56Z) - Towards stable real-world equation discovery with assessing
differentiating quality influence [52.2980614912553]
We propose alternatives to the commonly used finite differences-based method.
We evaluate these methods in terms of applicability to problems, similar to the real ones, and their ability to ensure the convergence of equation discovery algorithms.
arXiv Detail & Related papers (2023-11-09T23:32:06Z) - Neuro-Causal Factor Analysis [18.176375611711396]
We introduce a framework for Neuro-Causal Factor Analysis (NCFA)
NCFA identifies factors via latent causal discovery methods and then uses a variational autoencoder (VAE)
We evaluate NCFA on real and synthetic data sets, finding that it performs comparably to standard VAEs on data reconstruction tasks.
arXiv Detail & Related papers (2023-05-31T12:41:20Z) - Validation Diagnostics for SBI algorithms based on Normalizing Flows [55.41644538483948]
This work proposes easy to interpret validation diagnostics for multi-dimensional conditional (posterior) density estimators based on NF.
It also offers theoretical guarantees based on results of local consistency.
This work should help the design of better specified models or drive the development of novel SBI-algorithms.
arXiv Detail & Related papers (2022-11-17T15:48:06Z) - Trying to Outrun Causality with Machine Learning: Limitations of Model
Explainability Techniques for Identifying Predictive Variables [7.106986689736828]
We show that machine learning algorithms are not as flexible as they might seem, and are instead incredibly sensitive to the underling causal structure in the data.
We provide some alternative recommendations for researchers wanting to explore the data for important variables.
arXiv Detail & Related papers (2022-02-20T17:48:54Z) - Probabilistic Bearing Fault Diagnosis Using Gaussian Process with
Tailored Feature Extraction [10.064000794573756]
Rolling bearings are subject to various faults due to its long-time operation under harsh environment.
Current deep learning methods perform the bearing fault diagnosis in the form of deterministic classification.
We develop a probabilistic fault diagnosis framework that can account for the uncertainty effect in prediction.
arXiv Detail & Related papers (2021-09-19T18:34:29Z) - Inheritance-guided Hierarchical Assignment for Clinical Automatic
Diagnosis [50.15205065710629]
Clinical diagnosis, which aims to assign diagnosis codes for a patient based on the clinical note, plays an essential role in clinical decision-making.
We propose a novel framework to combine the inheritance-guided hierarchical assignment and co-occurrence graph propagation for clinical automatic diagnosis.
arXiv Detail & Related papers (2021-01-27T13:16:51Z) - Estimating Structural Target Functions using Machine Learning and
Influence Functions [103.47897241856603]
We propose a new framework for statistical machine learning of target functions arising as identifiable functionals from statistical models.
This framework is problem- and model-agnostic and can be used to estimate a broad variety of target parameters of interest in applied statistics.
We put particular focus on so-called coarsening at random/doubly robust problems with partially unobserved information.
arXiv Detail & Related papers (2020-08-14T16:48:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.