AOI-Net: Structural Face AOI-Guided Eye-Gaze Track Representation Learning for Autism Spectrum Disorder Detection
- URL: http://arxiv.org/abs/2608.29289v1
- Date: Sat, 29 Aug 2026 14:26:12 GMT
- Title: AOI-Net: Structural Face AOI-Guided Eye-Gaze Track Representation Learning for Autism Spectrum Disorder Detection
- Abstract summary: Eye-movement tracking has emerged as a promising non-invasive approach to Autism Spectrum Disorder (ASD) screening.<n>We propose a structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and structural organization.<n>The proposed framework also enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare.
- Score: 44.01653678589696
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Eye-movement tracking has emerged as a promising non-invasive approach to Autism Spectrum Disorder (ASD) screening, with systematic differences in attentional allocation and revisit behaviors observed during socially interactive tasks. Existing computational methods typically characterize eye-movements using discrete gaze trajectories and fixation events, yielding representations dominated by short-range temporal dynamics and limiting models that primarily emphasize long-range dependencies. Meanwhile, gaze behavior is naturally organized across semantically meaningful Areas of Interest (AOIs), whose attention allocation and transitions provide important structural cues, yet their relationships are rarely modeled explicitly. To address these limitations, we propose a structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and AOI-level structural organization. A network gating mechanism adaptively integrates the complementary temporal and structural representations according to their contributions to gaze-behavior characterization. To mitigate the pronounced class imbalance commonly encountered between individuals with ASD and Typically Developing (TD) participants in clinical datasets, class-distribution-aware learning is further employed to facilitate discriminative embedding learning under skewed class distributions. Experiments on a unique and large-scale clinical eye-tracking database comprising eight stimulus subsets and more than 1,300 participants show that AOI-Net consistently outperforms state-of-the-art methods. The proposed framework also enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare. The code is available at https://github.com/Zhanpei-ai/CIM-AOI-Net/tree/main/Code
Related papers
- Learning Structural Convergence: A Neuro-Symbolic Benchmark for Temporal Reasoning [2.7644691581661287]
This paper introduces TRACTA, a benchmark for temporal structural reasoning in high-complexity event-driven systems.<n>The benchmark includes three tasks: early_warning, pattern_detection, and run_classification.<n>Results show that raw event-level learning remains informative, but learned temporal modeling over semantic capability achieves the highest aggregate point estimates.
arXiv Detail & Related papers (2026-07-24T14:50:19Z) - Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wild [49.77540427384148]
We present AgentHOI, a training-free, agentic framework that transfers the generalist multimodal reasoning capabilities of foundation models to HOI detection in the wild.<n>To address the challenges of incomplete interaction discovery and ambiguous localization in complex scenes, we introduce two key mechanisms.<n>AgentHOI achieves superior performance over state-of-the-art supervised and weakly supervised methods in real-world settings.
arXiv Detail & Related papers (2026-07-15T14:30:20Z) - Hierarchical Scaffolding Enables Human-Like Cognitive Selectivity under Data Scarcity [1.5166105038254163]
We introduce SCALA (Scaffolded Cognitive Architecture for Learning under limited dAta), a hierarchical learning framework grounded in cognitive psychology.<n>Our model exhibits human-like cognitive selectivity by effectively prioritizing task-relevant features while suppressing background distractors.<n> Empirically, SCALA significant accuracy improvements under severe data scarcity.
arXiv Detail & Related papers (2026-07-06T06:24:32Z) - RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learning [3.249403472775399]
Affective and cognitive disorders manifest as distributed, time-varying brain network dynamics across regions, channels, and time.<n>We propose RECTOR, an end-to-end self-supervised framework that unifies joint region-channel-temporal representation learning.<n>Across diverse benchmarks, RECTOR sets a new state-of-the-art in EEG emotion recognition and sEEG task-engagement classification.
arXiv Detail & Related papers (2026-06-13T12:33:59Z) - ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both [55.182037225013836]
ATLAS is a framework in which a single discrete 'word', termed as a functional token, serves both as an agentic operation and a latent visual reasoning unit.<n> ATLAS achieves superior performance on challenging benchmarks while maintaining clear interpretability.
arXiv Detail & Related papers (2026-05-14T17:59:55Z) - Detecting Autism Spectrum Disorder with Deep Eye Movement Features [9.225838905985958]
Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder characterized by deficits in social communication and behavioral patterns.<n>Eye movement data offers a non-invasive diagnostic tool for ASD detection.<n>To efficiently capture subtle and complex eye movement patterns, a discrete short-term sequential (DSTS) modeling framework is designed.
arXiv Detail & Related papers (2026-01-09T14:35:24Z) - Self-Supervised Anatomical Consistency Learning for Vision-Grounded Medical Report Generation [61.350584471060756]
Vision-grounded medical report generation aims to produce clinically accurate descriptions of medical images.<n>We propose Self-Supervised Anatomical Consistency Learning (SS-ACL) to align generated reports with corresponding anatomical regions.<n>SS-ACL constructs a hierarchical anatomical graph inspired by the invariant top-down inclusion structure of human anatomy.
arXiv Detail & Related papers (2025-09-30T08:59:06Z) - Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives [83.15653194899126]
Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management.<n>Current VSN-based NCD detection methods primarily focus on linguistic microstructures closely tied to bottom-up, stimulus-driven cognitive processes.<n>We propose two novel macrostructural approaches: a Dynamic Topic Model (DTM) to track topic evolution over time, and a Text-Image Temporal Alignment Network (TITAN) to measure cross-modal consistency between narrative and visual stimuli.
arXiv Detail & Related papers (2025-01-07T12:16:26Z) - Locally temporal-spatial pattern learning with graph attention mechanism
for EEG-based emotion recognition [4.331986787747648]
Technique of emotion recognition enables computers to classify human affective states into discrete categories.
The emotion may fluctuate instead of maintaining a stable state even within a short time interval.
There is also a difficulty to take the full use of the EEG spatial distribution due to its 3-D topology structure.
arXiv Detail & Related papers (2022-08-19T12:15:10Z) - Entity-Conditioned Question Generation for Robust Attention Distribution
in Neural Information Retrieval [51.53892300802014]
We show that supervised neural information retrieval models are prone to learning sparse attention patterns over passage tokens.
Using a novel targeted synthetic data generation method, we teach neural IR to attend more uniformly and robustly to all entities in a given passage.
arXiv Detail & Related papers (2022-04-24T22:36:48Z) - Learning Neural Causal Models with Active Interventions [83.44636110899742]
We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process.
Our method significantly reduces the required number of interactions compared with random intervention targeting.
We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
arXiv Detail & Related papers (2021-09-06T13:10:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.