Deep Learning-based Eye-Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimuli

• URL: http://arxiv.org/abs/2303.06868v1
• Date: Mon, 13 Mar 2023 05:33:28 GMT
• Title: Deep Learning-based Eye-Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimuli
• Authors: Fangyu Zuo, Peiguang Jing, Jinglin Sun, Jizhong, Duan, Yong Ji, Yu Liu
• Abstract summary: Alzheimer's Disease (AD) causes a continuous decline in memory, thinking, and judgment. In this paper, we focus on exploiting deep learning techniques to diagnose AD based on eye-tracking behaviors. Visual attention, as typical eye-tracking behavior, is of great clinical value to detect cognitive abnormalities in AD patients. We propose a multi-layered comparison convolution neural network (MC-CNN) to distinguish the visual attention differences between AD patients and normals.
• Score: 8.987083026829517
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Alzheimer's Disease (AD) causes a continuous decline in memory, thinking, and judgment. Traditional diagnoses are usually based on clinical experience, which is limited by some realistic factors. In this paper, we focus on exploiting deep learning techniques to diagnose AD based on eye-tracking behaviors. Visual attention, as typical eye-tracking behavior, is of great clinical value to detect cognitive abnormalities in AD patients. To better analyze the differences in visual attention between AD patients and normals, we first conduct a 3D comprehensive visual task on a non-invasive eye-tracking system to collect visual attention heatmaps. We then propose a multi-layered comparison convolution neural network (MC-CNN) to distinguish the visual attention differences between AD patients and normals. In MC-CNN, the multi-layered representations of heatmaps are obtained by hierarchical convolution to better encode eye-movement behaviors, which are further integrated into a distance vector to benefit the comprehensive visual task. Extensive experimental results on the collected dataset demonstrate that MC-CNN achieves consistent validity in classifying AD patients and normals with eye-tracking data.

Related papers

• Beyond the Eye: A Relational Model for Early Dementia Detection Using Retinal OCTA Images [42.75763279888966]
  We present a novel PolarNet+ that uses retinal optical coherence tomography angiography ( OCTA) to discriminate early-onset Alzheimer's disease (AD) and mild cognitive impairment (MCI) subjects from controls. Our method first maps OCTA images from Cartesian coordinates to polar coordinates, allowing approximate sub-region calculation. We then introduce a multi-view module to serialize and analyze the images along three dimensions for comprehensive, clinically useful information extraction.
  arXiv  Detail & Related papers  (2024-08-09T15:10:34Z)
• Unsupervised Analysis of Alzheimer's Disease Signatures using 3D Deformable Autoencoders [10.091922917520316]
  We present MORPHADE, a novel unsupervised learning approach which uses deformations to allow the analysis of 3D T1-weighted brain images. This is the first use of deformations with deep unsupervised learning to detect, but also localize and assess the severity of structural changes in the brain due to Alzheimer's Disease (AD) Our method achieves an AUROC of 0.80 in detecting AD, out-performing several supervised and unsupervised baselines.
  arXiv  Detail & Related papers  (2024-07-04T11:52:44Z)
• Depth-induced Saliency Comparison Network for Diagnosis of Alzheimer's Disease via Jointly Analysis of Visual Stimuli and Eye Movements [8.907381270308452]
  Eye movements under special visual stimuli may serve as a potential non-invasive biomarker for detecting cognitive abnormalities of Alzheimer's disease. We propose an Depth-induced saliency comparison network (DISCN) for eye movement analysis. According to our experiments, the DISCN achieves consistent validity in classifying the eye movements between the AD patients and normal controls.
  arXiv  Detail & Related papers  (2024-03-15T09:15:57Z)
• Involution Fused ConvNet for Classifying Eye-Tracking Patterns of Children with Autism Spectrum Disorder [1.225920962851304]
  Autism Spectrum Disorder (ASD) is a complicated neurological condition which is challenging to diagnose. Numerous studies demonstrate that children diagnosed with ASD struggle with maintaining attention spans and have less focused vision. Eye-tracking technology has drawn special attention in the context of ASD since anomalies in gaze have long been acknowledged as a defining feature of autism in general.
  arXiv  Detail & Related papers  (2024-01-07T20:08:17Z)
• Polar-Net: A Clinical-Friendly Model for Alzheimer's Disease Detection in OCTA Images [53.235117594102675]
  Optical Coherence Tomography Angiography is a promising tool for detecting Alzheimer's disease (AD) by imaging the retinal microvasculature. We propose a novel deep-learning framework called Polar-Net to provide interpretable results and leverage clinical prior knowledge. We show that Polar-Net outperforms existing state-of-the-art methods and provides more valuable pathological evidence for the association between retinal vascular changes and AD.
  arXiv  Detail & Related papers  (2023-11-10T11:49:49Z)
• Exploiting the Brain's Network Structure for Automatic Identification of ADHD Subjects [70.37277191524755]
  We show that the brain can be modeled as a functional network, and certain properties of the networks differ in ADHD subjects from control subjects. We train our classifier with 776 subjects and test on 171 subjects provided by The Neuro Bureau for the ADHD-200 challenge.
  arXiv  Detail & Related papers  (2023-06-15T16:22:57Z)
• Detection of ADHD based on Eye Movements during Natural Viewing [3.1890959219836574]
  ADHD is a neurodevelopmental disorder that is highly prevalent and requires clinical specialists to diagnose. We develop an end-to-end deep learning-based sequence model which we pre-train on a related task. We find that the method is in fact able to detect ADHD and outperforms relevant baselines.
  arXiv  Detail & Related papers  (2022-07-04T12:56:04Z)
• A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications [56.458448869572294]
  We introduce DETRtime, a novel framework for time-series segmentation of EEG data. Our end-to-end deep learning-based framework brings advances in Computer Vision to the forefront. Our model generalizes well in the task of EEG sleep stage segmentation.
  arXiv  Detail & Related papers  (2022-06-17T10:17:24Z)
• An Algorithm for the Labeling and Interactive Visualization of the Cerebrovascular System of Ischemic Strokes [59.116811751334225]
  VirtualDSA++ is an algorithm designed to segment and label the cerebrovascular tree on CTA scans. We extend the labeling mechanism for the cerebral arteries to identify occluded vessels. We present the generic concept of iterative systematic search for pathways on all nodes of said model, which enables new interactive features.
  arXiv  Detail & Related papers  (2022-04-26T14:20:26Z)
• MEDUSA: Multi-scale Encoder-Decoder Self-Attention Deep Neural Network Architecture for Medical Image Analysis [71.2022403915147]
  We introduce MEDUSA, a multi-scale encoder-decoder self-attention mechanism tailored for medical image analysis. We obtain state-of-the-art performance on challenging medical image analysis benchmarks including COVIDx, RSNA RICORD, and RSNA Pneumonia Challenge.
  arXiv  Detail & Related papers  (2021-10-12T15:05:15Z)
• Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks [68.96150598294072]
  Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights. It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness. In recent years, there has been a significant effort to automate the diagnosis using deep learning. This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN) Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
  arXiv  Detail & Related papers  (2020-04-03T14:07:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.