Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing

• URL: http://arxiv.org/abs/2207.14349v1
• Date: Thu, 28 Jul 2022 19:01:09 GMT
• Title: Bridging the Gap between Deep Learning and Hypothesis-Driven Analysis via Permutation Testing
• Authors: Magdalini Paschali and Qingyu Zhao and Ehsan Adeli and Kilian M. Pohl
• Abstract summary: We propose a flexible and scalable approach based on the concept of permutation testing. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence. Our method successfully identifies categories of risk factors that further explain the symptom.
• Score: 16.397774179084607
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In recent years, deep learning has become a potential alternative approach for conducting such analyses by predicting an outcome from a collection of factors and identifying the most "informative" ones driving the prediction. However, this approach has had limited impact as its findings are not linked to statistical significance of factors supporting hypotheses. In this article, we proposed a flexible and scalable approach based on the concept of permutation testing that integrates hypothesis testing into the data-driven deep learning analysis. We apply our approach to the yearly self-reported assessments of 621 adolescent participants of the National Consortium of Alcohol and Neurodevelopment in Adolescence (NCANDA) to predict negative valence, a symptom of major depressive disorder according to the NIMH Research Domain Criteria (RDoC). Our method successfully identifies categories of risk factors that further explain the symptom.

Related papers

• Challenges and Considerations in the Evaluation of Bayesian Causal Discovery [49.0053848090947]
  Representing uncertainty in causal discovery is a crucial component for experimental design, and more broadly, for safe and reliable causal decision making. Unlike non-Bayesian causal discovery, which relies on a single estimated causal graph and model parameters for assessment, causal discovery presents challenges due to the nature of its quantity. No consensus on the most suitable metric for evaluation.
  arXiv  Detail & Related papers  (2024-06-05T12:45:23Z)
• Assessing ML Classification Algorithms and NLP Techniques for Depression Detection: An Experimental Case Study [0.6524460254566905]
  Depression has affected millions of people worldwide and has become one of the most common mental disorders. Recent research has evidenced that machine learning (ML) and Natural Language Processing (NLP) tools and techniques have significantly been used to diagnose depression. However, there are still several challenges in the assessment of depression detection approaches in which other conditions such as post-traumatic stress disorder (PTSD) are present.
  arXiv  Detail & Related papers  (2024-04-03T19:45:40Z)
• Seeing Unseen: Discover Novel Biomedical Concepts via Geometry-Constrained Probabilistic Modeling [53.7117640028211]
  We present a geometry-constrained probabilistic modeling treatment to resolve the identified issues. We incorporate a suite of critical geometric properties to impose proper constraints on the layout of constructed embedding space. A spectral graph-theoretic method is devised to estimate the number of potential novel classes.
  arXiv  Detail & Related papers  (2024-03-02T00:56:05Z)
• Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
  Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable. Existing susceptibility studies heavily rely on self-reported beliefs. We propose a computational approach to model users' latent susceptibility levels.
  arXiv  Detail & Related papers  (2023-11-16T07:22:56Z)
• Investigation of factors regarding the effects of COVID-19 pandemic on college students' depression by quantum annealer [4.64461905056841]
  The impact of the COVID-19 pandemic on mental health has been reported in previous studies. In this study, multivariable datasets were collected from 751 college students. Pandemic-related factors and psychological factors were more important in post-pandemic conditions.
  arXiv  Detail & Related papers  (2023-09-26T11:20:24Z)
• Analysis and Evaluation of Explainable Artificial Intelligence on Suicide Risk Assessment [32.04382293817763]
  This study investigates the effectiveness of Explainable Artificial Intelligence (XAI) techniques in predicting suicide risks. Data augmentation techniques and ML models are utilized to predict the associated risk. Patients with good incomes, respected occupations, and university education have the least risk.
  arXiv  Detail & Related papers  (2023-03-09T05:11:46Z)
• From Group-Differences to Single-Subject Probability: Conformal Prediction-based Uncertainty Estimation for Brain-Age Modeling [0.0]
  Brain-age gap is one of the most investigated risk markers for brain changes across disorders. We combine uncertainty-aware deep Neural Networks with conformal prediction theory. We show in a sample of N=16,794 participants that a lower or comparable error as state-of-the-art, large-scale brain-age models. The higher individual probabilities of accelerated brain-aging derived from our model are associated with Alzheimer's Disease, Bipolar Disorder and Major Depressive Disorder.
  arXiv  Detail & Related papers  (2023-02-10T15:05:09Z)
• Bias Reducing Multitask Learning on Mental Health Prediction [18.32551434711739]
  There has been an increase in research in developing machine learning models for mental health detection or prediction. In this work, we aim to perform a fairness analysis and implement a multi-task learning based bias mitigation method on anxiety prediction models. Our analysis showed that our anxiety prediction base model introduced some bias with regards to age, income, ethnicity, and whether a participant is born in the U.S. or not.
  arXiv  Detail & Related papers  (2022-08-07T02:28:32Z)
• SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data [83.50281440043241]
  We study the problem of inferring heterogeneous treatment effects from time-to-event data. We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
  arXiv  Detail & Related papers  (2021-10-26T20:13:17Z)
• Variance Minimization in the Wasserstein Space for Invariant Causal Prediction [72.13445677280792]
  In this work, we show that the approach taken in ICP may be reformulated as a series of nonparametric tests that scales linearly in the number of predictors. Each of these tests relies on the minimization of a novel loss function that is derived from tools in optimal transport theory. We prove under mild assumptions that our method is able to recover the set of identifiable direct causes, and we demonstrate in our experiments that it is competitive with other benchmark causal discovery algorithms.
  arXiv  Detail & Related papers  (2021-10-13T22:30:47Z)
• ACRE: Abstract Causal REasoning Beyond Covariation [90.99059920286484]
  We introduce the Abstract Causal REasoning dataset for systematic evaluation of current vision systems in causal induction. Motivated by the stream of research on causal discovery in Blicket experiments, we query a visual reasoning system with the following four types of questions in either an independent scenario or an interventional scenario. We notice that pure neural models tend towards an associative strategy under their chance-level performance, whereas neuro-symbolic combinations struggle in backward-blocking reasoning.
  arXiv  Detail & Related papers  (2021-03-26T02:42:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.