Temporal Persistence and Intercorrelation of Embeddings Learned by an End-to-End Deep Learning Eye Movement-driven Biometrics Pipeline
- URL: http://arxiv.org/abs/2402.16399v2
- Date: Sun, 21 Jul 2024 23:58:34 GMT
- Title: Temporal Persistence and Intercorrelation of Embeddings Learned by an End-to-End Deep Learning Eye Movement-driven Biometrics Pipeline
- Abstract summary: The present study aimed to determine whether the same relationships are found in a state-of-the-art DL-based eye movement biometric system.
We manipulate various aspects of eye-tracking signal quality, which produces variation in biometric performance, and relate that performance to the temporal persistence and intercorrelation of the resulting embeddings.
- Score: 4.199844472131922
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: What qualities make a feature useful for biometric performance? In prior research, pre-dating the advent of deep learning (DL) approaches to biometric analysis, a strong relationship between temporal persistence, as indexed by the intraclass correlation coefficient (ICC), and biometric performance (Equal Error Rate, EER) was noted. More generally, the claim was made that good biometric performance resulted from a relatively large set of weakly intercorrelated features with high ICC. The present study aimed to determine whether the same relationships are found in a state-of-the-art DL-based eye movement biometric system (``Eye-Know-You-Too''), as applied to two publicly available eye movement datasets. To this end, we manipulate various aspects of eye-tracking signal quality, which produces variation in biometric performance, and relate that performance to the temporal persistence and intercorrelation of the resulting embeddings. Data quality indices were related to EER with either linear or logarithmic fits, and the resulting model R^2 was noted. As a general matter, we found that temporal persistence was an important predictor of DL-based biometric performance, and also that DL-learned embeddings were generally weakly intercorrelated.
Related papers
- GARLIC: Graph Attention-based Relational Learning of Multivariate Time Series in Intensive Care [5.469342914844525]
We present Attention-based Graph Learning for Intensive Care (GARLIC) model.<n>GARLIC imputes missing data through exponential learnable neural network architecture.<n>On three ICU benchmarks, GARLIC sets the new state of the art in outcome prediction.
arXiv Detail & Related papers (2026-08-11T14:29:48Z) - BCI-Based Assessment of Ocular Response Time Using Dynamic Time Warping Leveraging an RDWT-Driven Deep Neural Framework [1.7883249184785495]
We present an initial framework that integrates electroencephalogram (EEG) with augmented-reality (AR)-based Vestibular/Ocular Motor Screening (VOMS) tasks.<n>EEG signals are analyzed using a Redundant Discrete Wavelet Transform (RDWT)-driven deep neural framework.<n> Sliding-window predictions were validated using Pearson correlation, and Dynamic Time Warping (DTW) was subsequently used to estimate ocular response times.
arXiv Detail & Related papers (2026-05-14T14:28:11Z) - Enhancing Eye Movement Biometrics for User Authentication via Continuous Gaze Offset Score Fusion [2.2557806157585834]
Eye movement biometrics (EMB) use subject-specific gaze dynamics for user authentication and identification.<n>Recent deep learning-based EMB systems achieve strong performance by modeling temporal eye movement behavior.<n>This work examines whether continuous gaze offset can improve biometric performance when combined with existing biometric features.
arXiv Detail & Related papers (2026-05-07T18:12:20Z) - Temporal Complexity and Self-Organization in an Exponential Dense Associative Memory Model [0.0]
Temporal Complexity (TC) is a framework that characterizes complex systems by intermittent transition events between order and disorder.<n>Our results reveal that the SEDAM model exhibits regimes of complex intermittency characterized by nontrivial temporal correlations and scale-free behavior.<n>This study highlights the relevance of TC as a complementary framework for understanding learning and information processing in artificial and biological neural systems.
arXiv Detail & Related papers (2026-01-16T18:01:14Z) - Structure-Aware Contrastive Learning with Fine-Grained Binding Representations for Drug Discovery [3.1716746406651457]
This work introduces a sequence-based drug-target interaction framework that integrates structural priors into protein representations.<n>The model achieves state-of-the-art performance on Human and BioSNAP datasets and remains competitive on BindingDB.
arXiv Detail & Related papers (2025-09-18T09:38:46Z) - MVICAD2: Multi-View Independent Component Analysis with Delays and Dilations [61.59658203704757]
We propose Multi-View Independent Component Analysis with Delays and Dilations (MVICAD2), which allows sources to differ across subjects in both temporal delays and dilations.
We present a model with identifiable sources, derive an approximation of its likelihood in closed form, and use regularization and optimization techniques to enhance performance.
arXiv Detail & Related papers (2025-01-13T15:47:02Z) - Reliability of deep learning models for anatomical landmark detection: The role of inter-rater variability [2.64700310378485]
We study different annotation-fusion strategies to preserve inter-rater variability in deep learning models for anatomical landmark detection.
Our research highlights the crucial connection between inter-rater variability, DL-models performances, and uncertainty.
arXiv Detail & Related papers (2024-11-26T20:07:16Z) - Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding [29.81572367536339]
A fundamental requirement for representation learning in Continuous-Time Dynamic Graphs (CTDGs) is the appropriate estimation and preservation of proximity.
We propose a novel Correlated Spatial-Temporal Positional representation (CorDGT) that efficiently retains the evolving spatial-temporal proximity for effective node learning in CTDGs.
arXiv Detail & Related papers (2024-07-24T02:56:22Z) - On the Identification of Temporally Causal Representation with Instantaneous Dependence [50.14432597910128]
Temporally causal representation learning aims to identify the latent causal process from time series observations.
Most methods require the assumption that the latent causal processes do not have instantaneous relations.
We propose an textbfIDentification framework for instantanetextbfOus textbfLatent dynamics.
arXiv Detail & Related papers (2024-05-24T08:08:05Z) - Temporal and Heterogeneous Graph Neural Network for Remaining Useful Life Prediction [27.521188262343596]
We introduce a novel model named Temporal and Heterogeneous Graph Neural Networks (THGNN)
THGNN aggregates historical data from neighboring nodes to accurately capture the temporal dynamics and spatial correlations within the stream of sensor data.
We have validated the effectiveness of our approach through comprehensive experiments.
arXiv Detail & Related papers (2024-05-07T14:08:57Z) - The Paradox of Motion: Evidence for Spurious Correlations in
Skeleton-based Gait Recognition Models [4.089889918897877]
This study challenges the prevailing assumption that vision-based gait recognition relies primarily on motion patterns.
We show through a comparative analysis that removing height information leads to notable performance degradation.
We propose a spatial transformer model processing individual poses, disregarding any temporal information, which achieves unreasonably good accuracy.
arXiv Detail & Related papers (2024-02-13T09:33:12Z) - Learning Beyond Similarities: Incorporating Dissimilarities between
Positive Pairs in Self-Supervised Time Series Learning [4.2807943283312095]
This paper pioneers an SSL approach that transcends mere similarities by integrating dissimilarities among positive pairs.
The framework is applied to electrocardiogram (ECG) signals, leading to a notable enhancement of +10% in the detection accuracy of Atrial Fibrillation (AFib) across diverse subjects.
arXiv Detail & Related papers (2023-09-14T08:49:35Z) - Multi-Channel Time-Series Person and Soft-Biometric Identification [65.83256210066787]
This work investigates person and soft-biometrics identification from recordings of humans performing different activities using deep architectures.
We evaluate the method on four datasets of multi-channel time-series human activity recognition (HAR)
Soft-biometric based attribute representation shows promising results and emphasis the necessity of larger datasets.
arXiv Detail & Related papers (2023-04-04T07:24:51Z) - Dataset Bias in Human Activity Recognition [57.91018542715725]
This contribution statistically curates the training data to assess to what degree the physical characteristics of humans influence HAR performance.
We evaluate the performance of a state-of-the-art convolutional neural network on two HAR datasets that vary in the sensors, activities, and recording for time-series HAR.
arXiv Detail & Related papers (2023-01-19T12:33:50Z) - Pain level and pain-related behaviour classification using GRU-based
sparsely-connected RNNs [61.080598804629375]
People with chronic pain unconsciously adapt specific body movements to protect themselves from injury or additional pain.
Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities.
We proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders.
We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
arXiv Detail & Related papers (2022-12-20T12:56:28Z) - Spatio-temporal Gait Feature with Adaptive Distance Alignment [90.5842782685509]
We try to increase the difference of gait features of different subjects from two aspects: the optimization of network structure and the refinement of extracted gait features.
Our method is proposed, it consists of Spatio-temporal Feature Extraction (SFE) and Adaptive Distance Alignment (ADA)
ADA uses a large number of unlabeled gait data in real life as a benchmark to refine the extracted-temporal features to make them have low inter-class similarity and high intra-class similarity.
arXiv Detail & Related papers (2022-03-07T13:34:00Z) - Real-time landmark detection for precise endoscopic submucosal
dissection via shape-aware relation network [51.44506007844284]
We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery.
We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks.
We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
arXiv Detail & Related papers (2021-11-08T07:57:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.