Delta-KNN: Improving Demonstration Selection in In-Context Learning for Alzheimer's Disease Detection

• URL: http://arxiv.org/abs/2506.03476v1
• Date: Wed, 04 Jun 2025 01:14:07 GMT
• Title: Delta-KNN: Improving Demonstration Selection in In-Context Learning for Alzheimer's Disease Detection
• Authors: Chuyuan Li, Raymond Li, Thalia S. Field, Giuseppe Carenini,
• Abstract summary: Alzheimer's Disease (AD) is a progressive neurodegenerative disorder that leads to dementia, and early intervention can greatly benefit from analyzing linguistic abnormalities.<n>In this work, we explore the potential of Large Language Models (LLMs) as health assistants for AD diagnosis from patient-generated text.<n>We introduce Delta-KNN, a novel demonstration selection strategy that enhances ICL performance.
• Score: 17.171269816416178
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Alzheimer's Disease (AD) is a progressive neurodegenerative disorder that leads to dementia, and early intervention can greatly benefit from analyzing linguistic abnormalities. In this work, we explore the potential of Large Language Models (LLMs) as health assistants for AD diagnosis from patient-generated text using in-context learning (ICL), where tasks are defined through a few input-output examples. Empirical results reveal that conventional ICL methods, such as similarity-based selection, perform poorly for AD diagnosis, likely due to the inherent complexity of this task. To address this, we introduce Delta-KNN, a novel demonstration selection strategy that enhances ICL performance. Our method leverages a delta score to assess the relative gains of each training example, coupled with a KNN-based retriever that dynamically selects optimal "representatives" for a given input. Experiments on two AD detection datasets across three open-source LLMs demonstrate that Delta-KNN consistently outperforms existing ICL baselines. Notably, when using the Llama-3.1 model, our approach achieves new state-of-the-art results, surpassing even supervised classifiers.

Related papers

• Cross-modal Causal Intervention for Alzheimer's Disease Prediction [12.485088483891843]
  We propose a visual-language causal intervention framework named Alzheimer's Disease Prediction with Cross-modal Causal Intervention.<n>Our framework implicitly eliminates confounders through causal intervention.<n> Experimental results demonstrate the outstanding performance of our method in distinguishing CN/MCI/AD cases.
  arXiv  Detail & Related papers  (2025-07-18T14:21:24Z)
• Alzheimer's Dementia Detection Using Perplexity from Paired Large Language Models [17.165862008319735]
  Alzheimer's dementia (AD) is a neurodegenerative disorder with cognitive decline that commonly impacts language ability.<n>This work extends the paired perplexity approach to detecting AD by using a recent large language model (LLM)<n>We improve accuracy by an average of 3.33% over the best current paired perplexity method and by 6.35% over the top-ranked method from the ADReSS 2020 challenge benchmark.
  arXiv  Detail & Related papers  (2025-06-11T01:15:13Z)
• PHGNN: A Novel Prompted Hypergraph Neural Network to Diagnose Alzheimer's Disease [2.1496312331703935]
  We propose a novel Prompted Hypergraph Neural Network (PHGNN) framework that integrates hypergraph based learning with prompt learning.<n>Our model is validated through extensive experiments on the ADNI dataset, outperforming SOTA methods in both AD diagnosis and the prediction of MCI conversion.
  arXiv  Detail & Related papers  (2025-03-18T16:10:43Z)
• Recognition of Dysarthria in Amyotrophic Lateral Sclerosis patients using Hypernetworks [7.182245711235296]
  We present the first study incorporating hypernetworks for recognizing dysarthria.<n> Specifically, we use audio files, convert them into log-Mel spectrogram, delta, and delta-delta, and pass the resulting image through a pretrained modified AlexNet model.<n>Results showed that the proposed approach reaches Accuracy up to 82.66% outperforming strong baselines.
  arXiv  Detail & Related papers  (2025-02-27T15:57:37Z)
• AD-LLM: Benchmarking Large Language Models for Anomaly Detection [50.57641458208208]
  This paper introduces AD-LLM, the first benchmark that evaluates how large language models can help with anomaly detection.<n>We examine three key tasks: zero-shot detection, using LLMs' pre-trained knowledge to perform AD without tasks-specific training; data augmentation, generating synthetic data and category descriptions to improve AD models; and model selection, using LLMs to suggest unsupervised AD models.
  arXiv  Detail & Related papers  (2024-12-15T10:22:14Z)
• On the Within-class Variation Issue in Alzheimer's Disease Detection [60.08015780474457]
  Alzheimer's Disease (AD) detection employs machine learning classification models to distinguish between individuals with AD and those without.<n>In this work, we found using a sample score estimator can generate sample-specific soft scores aligning with cognitive scores.<n>We propose two simple yet effective methods: Soft Target Distillation (SoTD) and Instance-level Re-balancing (InRe)
  arXiv  Detail & Related papers  (2024-09-22T02:06:05Z)
• An interpretable generative multimodal neuroimaging-genomics framework for decoding Alzheimer's disease [13.213387075528017]
  Alzheimer's disease (AD) is the most prevalent form of dementia worldwide, encompassing a prodromal stage known as Mild Cognitive Impairment (MCI)<n>The objective of the work was to capture structural and functional modulations of brain structure and function relying on multimodal MRI data and Single Nucleotide Polymorphisms.
  arXiv  Detail & Related papers  (2024-06-19T07:31:47Z)
• Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detection [69.53626024091076]
  Alzheimer's disease (AD) is particularly prominent in older adults. Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations. This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features.
  arXiv  Detail & Related papers  (2023-03-14T16:03:28Z)
• Normative Modeling via Conditional Variational Autoencoder and Adversarial Learning to Identify Brain Dysfunction in Alzheimer's Disease [10.302206705998563]
  We propose a novel normative modeling method by combining conditional variational autoencoder with adversarial learning (ACVAE) to identify brain dysfunction in Alzheimer's Disease (AD) Our experiments on OASIS-3 database show that the deviation maps generated by our model exhibit higher sensitivity to AD compared to other deep normative models.
  arXiv  Detail & Related papers  (2022-11-13T07:36:30Z)
• Exploring linguistic feature and model combination for speech recognition based automatic AD detection [61.91708957996086]
  Speech based automatic AD screening systems provide a non-intrusive and more scalable alternative to other clinical screening techniques. Scarcity of specialist data leads to uncertainty in both model selection and feature learning when developing such systems. This paper investigates the use of feature and model combination approaches to improve the robustness of domain fine-tuning of BERT and Roberta pre-trained text encoders.
  arXiv  Detail & Related papers  (2022-06-28T05:09:01Z)
• Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data [62.29031007761901]
  This paper proposes a novel contrastive regularized clinical classification model. We introduce two unique positive sampling strategies specifically tailored for EHR data. Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
  arXiv  Detail & Related papers  (2021-04-07T06:02:04Z)
• Uncovering the structure of clinical EEG signals with self-supervised learning [64.4754948595556]
  Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG) By extracting information from unlabeled data, it might be possible to reach competitive performance with deep neural networks.
  arXiv  Detail & Related papers  (2020-07-31T14:34:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.