Attention-Aware Transformer-Based Aggregation Network for Video Periocular Recognition

• URL: http://arxiv.org/abs/2605.16550v1
• Date: Fri, 15 May 2026 18:47:18 GMT
• Title: Attention-Aware Transformer-Based Aggregation Network for Video Periocular Recognition
• Abstract summary: This paper proposes an attention-aware approach for video-based periocular recognition in surveillance environments.<n>The framework consists of two main modules: feature embedding and aggregation.<n> Experiments on the publicly available COX Face dataset show the robustness of the proposed method.
• Score: 1.4942034077785833
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video periocular recognition is the task of recognizing an individual's identity based on the region around an individual's eyes. The periocular area is one of the most discriminative regions of the human face, making it suitable for recognition tasks. Its use as a biometric modality has emerged as an alternative, especially in surveillance scenarios where conventional biometric traits such as face or iris recognition become unfeasible due to unconstrained acquisition conditions. This paper proposes an attention-aware approach for video-based periocular recognition in surveillance environments. The framework consists of two main modules: feature embedding and aggregation. The feature embedding module is a deep convolutional neural network that maps periocular data to feature vectors. The aggregation module is an encoder-only transformer that adaptively learns to aggregate frame-level features into a single video representation and a feature vector for the still reference image. Experiments on the publicly available COX Face dataset show the robustness of the proposed method, consistently outperforming naive aggregation schemes. In the best scenario, the approach achieves $99.8\%$ of TPR@$1e^{-1}$ and $96.6\%$ of Rank-5.

Related papers

• Learning Unified Video and Image Representation for Video Face Forgery Detection [49.19035628283472]
  Existing methods for video face forgery detection assume that all frames in a forged video are manipulated.<n>We propose a novel framework, UVIF, that utilizes additional annotated images to provide fine-grained supervision for detecting partial forgeries in videos.<n>UVIF employs a unified encoder and a multi-task learning paradigm to jointly model facial videos and images for boosted video face forgery detection.
  arXiv  Detail & Related papers  (2026-08-13T10:25:59Z)
• A non-invasive video-based method for individual identification of wildlife using gait dynamics [21.468912995256698]
  This paper presents a fully automated video-based pipeline for wildlife gait analysis and individual identification.<n>The proposed pipeline uses Segment Anything Model 3 (SAM3) to generate high-quality RGB and binary silhouette masks.<n>Cosine is then used to compare gait signatures, enabling similarity-based clustering of individuals without reliance on physical or invasive markings.
  arXiv  Detail & Related papers  (2026-07-05T21:47:21Z)
• Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection [57.883265488038134]
  We propose a hierarchical graph interaction network termed HGINet for camouflaged object detection. The network is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Our experiments demonstrate the superior performance of HGINet compared to existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-08-27T12:53:25Z)
• Learning Expressive And Generalizable Motion Features For Face Forgery Detection [52.54404879581527]
  We propose an effective sequence-based forgery detection framework based on an existing video classification method. To make the motion features more expressive for manipulation detection, we propose an alternative motion consistency block. We make a general video classification network achieve promising results on three popular face forgery datasets.
  arXiv  Detail & Related papers  (2024-03-08T09:25:48Z)
• ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection [20.983998911754792]
  Two-stage Human-Object Interaction (HOI) detectors suffer from lower performance than one-stage methods. We propose Vision Transformer based Pose-Conditioned Self-Loop Graph (ViPLO) to resolve these problems. ViPLO achieves the state-of-the-art results on two public benchmarks.
  arXiv  Detail & Related papers  (2023-04-17T09:44:54Z)
• Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification [67.64124512185087]
  Soft biometrics such as gait are widely used with face in surveillance tasks like person recognition and re-identification. We propose a novel adaptive multi-biometric fusion strategy for the dynamic incorporation of gait and face biometric cues by leveraging keyless attention deep neural networks.
  arXiv  Detail & Related papers  (2023-03-24T05:28:35Z)
• Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition [56.91538445510214]
  We present a learning algorithm for human activity recognition in videos. Our approach is designed for UAV videos, which are mainly acquired from obliquely placed dynamic cameras. We conduct extensive experiments on the UAV Human dataset and the NEC Drone dataset.
  arXiv  Detail & Related papers  (2022-09-15T22:16:52Z)
• Multimodal Graph Learning for Deepfake Detection [10.077496841634135]
  Existing deepfake detectors face several challenges in achieving robustness and generalization. We propose a novel framework, namely Multimodal Graph Learning (MGL), that leverages information from multiple modalities. Our proposed method aims to effectively identify and utilize distinguishing features for deepfake detection.
  arXiv  Detail & Related papers  (2022-09-12T17:17:49Z)
• An Efficient Method for Face Quality Assessment on the Edge [1.7188280334580197]
  A practical approach on edge devices should prioritize these detection of identities according to their conformity to recognition. We propose a face quality score regression by just appending a single layer to a face landmark detection network. With almost no additional cost, face quality scores are obtained by training this single layer to regress recognition scores with surveillance like augmentations.
  arXiv  Detail & Related papers  (2022-07-19T18:29:43Z)
• Dynamic Prototype Mask for Occluded Person Re-Identification [88.7782299372656]
  Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part. We propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge. Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously.
  arXiv  Detail & Related papers  (2022-07-19T03:31:13Z)
• Attribute-Based Deep Periocular Recognition: Leveraging Soft Biometrics to Improve Periocular Recognition [24.267703297385413]
  This paper presents a new deep periocular recognition framework called attribute-based deep periocular recognition (ADPR) ADPR predicts soft biometrics and incorporates the prediction into a periocular recognition algorithm to determine identity from periocular images with high accuracy. Experimental results indicate that our soft biometric based periocular recognition approach outperforms other state-of-the-art methods for periocular recognition in wild environments.
  arXiv  Detail & Related papers  (2021-11-02T01:51:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.