Individual Topology Structure of Eye Movement Trajectories

• URL: http://arxiv.org/abs/2205.10667v2
• Date: Tue, 24 May 2022 12:43:32 GMT
• Title: Individual Topology Structure of Eye Movement Trajectories
• Authors: Arsenii Onuchin, Oleg Kachan
• Abstract summary: We propose an application of a new class of features to the quantitative analysis of personal eye movement trajectories structure. We experimentally demonstrate the competitiveness of the new class of features with the traditional ones and their significant synergy.
• Score: 6.09170287691728
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Traditionally, extracting patterns from eye movement data relies on statistics of different macro-events such as fixations and saccades. This requires an additional preprocessing step to separate the eye movement subtypes, often with a number of parameters on which the classification results depend. Besides that, definitions of such macro events are formulated in different ways by different researchers. We propose an application of a new class of features to the quantitative analysis of personal eye movement trajectories structure. This new class of features based on algebraic topology allows extracting patterns from different modalities of gaze such as time series of coordinates and amplitudes, heatmaps, and point clouds in a unified way at all scales from micro to macro. We experimentally demonstrate the competitiveness of the new class of features with the traditional ones and their significant synergy while being used together for the person authentication task on the recently published eye movement trajectories dataset.

Related papers

• STARE: Predicting Decision Making Based on Spatio-Temporal Eye Movements [49.906485205551746]
  The present proposes a Deep Learning architecture for the prediction of various consumer choice behaviors from time series of raw gaze or eye fixations on images of the decision environment.<n>We compare STARE with several state-of-the art alternatives on multiple datasets with the purpose of predicting consumer choice behaviors from eye movements.
  arXiv  Detail & Related papers  (2025-08-06T07:20:31Z)
• Intra-view and Inter-view Correlation Guided Multi-view Novel Class Discovery [52.616615506638205]
  Novel class discovery (NCD) aims to cluster novel classes by leveraging knowledge from disjoint known classes.<n>We propose a novel framework named Intra-view and Inter-view Correlation Guided Multi-view Novel Class Discovery (IICMVNCD)<n>IICMVNCD is the first attempt to explore NCD in multi-view setting so far.
  arXiv  Detail & Related papers  (2025-07-16T08:42:52Z)
• Towards Cross-Subject EMG Pattern Recognition via Dual-Branch Adversarial Feature Disentanglement [2.209921757303168]
  Cross-subject electromyography (EMG) pattern recognition faces significant challenges due to inter-subject variability in muscle anatomy, electrode placement, and signal characteristics.<n>Traditional methods rely on subject-specific calibration data to adapt models to new users, an approach that is both time-consuming and impractical for large-scale, real-world deployment.<n>We propose an end-to-end dual-branch adversarial neural network that simultaneously performs pattern recognition and individual identification by disentangling EMG features into pattern-specific and subject-specific components.
  arXiv  Detail & Related papers  (2025-06-10T08:23:14Z)
• Heterogeneous Relationships of Subjects and Shapelets for Semi-supervised Multivariate Series Classification [4.4881185098082]
  We propose a heterogeneous relationships of subjects and shapelets method for semi-supervised MTS classification. We first utilize a contrast temporal self-attention module to obtain sparse MTS representations. Secondly, we learn the shapelets for different subject types, incorporating both the subject features and their shapelets as additional information. Finally, we use a dual level graph attention network to get prediction.
  arXiv  Detail & Related papers  (2024-11-27T04:25:13Z)
• Probing Fine-Grained Action Understanding and Cross-View Generalization of Foundation Models [13.972809192907931]
  Foundation models (FMs) are large neural networks trained on broad datasets. Human activity recognition in video has advanced with FMs, driven by competition among different architectures. This paper empirically evaluates how perspective changes affect different FMs in fine-grained human activity recognition.
  arXiv  Detail & Related papers  (2024-07-22T12:59:57Z)
• Eye Gaze Estimation Model Analysis [2.4366811507669124]
  We discuss various model types for eye gaze estimation and present the results from predicting gaze direction using eye landmarks in unconstrained settings. In unconstrained real-world settings, feature-based and model-based methods are outperformed by recent appearance-based methods due to factors like illumination changes and other visual artifacts.
  arXiv  Detail & Related papers  (2022-07-28T20:40:03Z)
• Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting [50.901984244738806]
  We show how to model the evolutionary and multi-scale interactions of time series. In particular, we first provide a hierarchical graph structure cooperated with the dilated convolution to capture the scale-specific correlations. A unified neural network is provided to integrate the components above to get the final prediction.
  arXiv  Detail & Related papers  (2022-06-28T08:11:12Z)
• Importance Weighted Structure Learning for Scene Graph Generation [40.46394569128303]
  We propose a novel importance weighted structure learning method for scene graph generation. A generic entropic mirror descent algorithm is applied to solve the resulting constrained variational inference task. The proposed method achieves the state-of-the-art performance on various popular scene graph generation benchmarks.
  arXiv  Detail & Related papers  (2022-05-14T09:25:14Z)
• Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations [73.14227103400964]
  We investigate the role of learning in the automated discovery of self-similarity and in its utilization for downstream tasks. We design a novel class of implicit operators, Neural Collages, which represent data as the parameters of a self-referential, structured transformation. We investigate how to leverage the representations produced by Neural Collages in various tasks, including data compression and generation.
  arXiv  Detail & Related papers  (2022-04-15T22:54:23Z)
• Novel Features for Time Series Analysis: A Complex Networks Approach [62.997667081978825]
  Time series data are ubiquitous in several domains as climate, economics and health care. Recent conceptual approach relies on time series mapping to complex networks. Network analysis can be used to characterize different types of time series.
  arXiv  Detail & Related papers  (2021-10-11T13:46:28Z)
• Efficient Modelling Across Time of Human Actions and Interactions [92.39082696657874]
  We argue that current fixed-sized-temporal kernels in 3 convolutional neural networks (CNNDs) can be improved to better deal with temporal variations in the input. We study how we can better handle between classes of actions, by enhancing their feature differences over different layers of the architecture. The proposed approaches are evaluated on several benchmark action recognition datasets and show competitive results.
  arXiv  Detail & Related papers  (2021-10-05T15:39:11Z)
• CLRGaze: Contrastive Learning of Representations for Eye Movement Signals [0.0]
  We learn feature vectors of eye movements in a self-supervised manner. We adopt a contrastive learning approach and propose a set of data transformations that encourage a deep neural network to discern salient and granular gaze patterns.
  arXiv  Detail & Related papers  (2020-10-25T06:12:06Z)
• Synthesizing the Unseen for Zero-shot Object Detection [72.38031440014463]
  We propose to synthesize visual features for unseen classes, so that the model learns both seen and unseen objects in the visual domain. We use a novel generative model that uses class-semantics to not only generate the features but also to discriminatively separate them.
  arXiv  Detail & Related papers  (2020-10-19T12:36:11Z)
• Hierarchical HMM for Eye Movement Classification [14.551782298808572]
  We tackle the problem of ternary eye movement classification, which aims to separate fixations, saccades and smooth pursuits from the raw eye positional data. We propose a hierarchical Hidden Markov Model (HMM) statistical algorithm for detecting fixations, saccades and smooth pursuits.
  arXiv  Detail & Related papers  (2020-08-18T14:47:23Z)
• A Trainable Optimal Transport Embedding for Feature Aggregation and its Relationship to Attention [96.77554122595578]
  We introduce a parametrized representation of fixed size, which embeds and then aggregates elements from a given input set according to the optimal transport plan between the set and a trainable reference. Our approach scales to large datasets and allows end-to-end training of the reference, while also providing a simple unsupervised learning mechanism with small computational cost.
  arXiv  Detail & Related papers  (2020-06-22T08:35:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.