mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimation

• URL: http://arxiv.org/abs/2006.05327v2
• Date: Thu, 22 Oct 2020 11:11:33 GMT
• Title: mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimation
• Authors: Roberto Daza, Aythami Morales, Julian Fierrez, Ruben Tolosana
• Abstract summary: mEBAL is a multimodal database for eye blink detection and attention level estimation. It comprises 6,000 samples and the corresponding attention level from 38 different students.
• Score: 17.279661852408335
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This work presents mEBAL, a multimodal database for eye blink detection and attention level estimation. The eye blink frequency is related to the cognitive activity and automatic detectors of eye blinks have been proposed for many tasks including attention level estimation, analysis of neuro-degenerative diseases, deception recognition, drive fatigue detection, or face anti-spoofing. However, most existing databases and algorithms in this area are limited to experiments involving only a few hundred samples and individual sensors like face cameras. The proposed mEBAL improves previous databases in terms of acquisition sensors and samples. In particular, three different sensors are simultaneously considered: Near Infrared (NIR) and RGB cameras to capture the face gestures and an Electroencephalography (EEG) band to capture the cognitive activity of the user and blinking events. Regarding the size of mEBAL, it comprises 6,000 samples and the corresponding attention level from 38 different students while conducting a number of e-learning tasks of varying difficulty. In addition to presenting mEBAL, we also include preliminary experiments on: i) eye blink detection using Convolutional Neural Networks (CNN) with the facial images, and ii) attention level estimation of the students based on their eye blink frequency.

Related papers

• mEBAL2 Database and Benchmark: Image-based Multispectral Eyeblink Detection [14.052943954940758]
  This work introduces a new multispectral database and novel approaches for eyeblink detection in RGB and Near-Infrared (NIR) individual images. mEBAL2 is the largest existing eyeblink database. mEBAL2 includes 21,100 image sequences from 180 different students.
  arXiv  Detail & Related papers  (2023-09-14T17:25:25Z)
• MATT: Multimodal Attention Level Estimation for e-learning Platforms [16.407885871027887]
  This work presents a new multimodal system for remote attention level estimation based on multimodal face analysis. Our multimodal approach uses different parameters and signals obtained from the behavior and physiological processes that have been related to modeling cognitive load. The mEBAL database is used in the experimental framework, a public multi-modal database for attention level estimation obtained in an e-learning environment.
  arXiv  Detail & Related papers  (2023-01-22T18:18:20Z)
• BI AVAN: Brain inspired Adversarial Visual Attention Network [67.05560966998559]
  We propose a brain-inspired adversarial visual attention network (BI-AVAN) to characterize human visual attention directly from functional brain activity. Our model imitates the biased competition process between attention-related/neglected objects to identify and locate the visual objects in a movie frame the human brain focuses on in an unsupervised manner.
  arXiv  Detail & Related papers  (2022-10-27T22:20:36Z)
• Active Gaze Control for Foveal Scene Exploration [124.11737060344052]
  We propose a methodology to emulate how humans and robots with foveal cameras would explore a scene. The proposed method achieves an increase in detection F1-score of 2-3 percentage points for the same number of gaze shifts.
  arXiv  Detail & Related papers  (2022-08-24T14:59:28Z)
• A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications [56.458448869572294]
  We introduce DETRtime, a novel framework for time-series segmentation of EEG data. Our end-to-end deep learning-based framework brings advances in Computer Vision to the forefront. Our model generalizes well in the task of EEG sleep stage segmentation.
  arXiv  Detail & Related papers  (2022-06-17T10:17:24Z)
• Saccade Mechanisms for Image Classification, Object Detection and Tracking [12.751552698602744]
  We examine how the saccade mechanism from biological vision can be used to make deep neural networks more efficient for classification and object detection problems. Our proposed approach is based on the ideas of attention-driven visual processing and saccades, miniature eye movements influenced by attention.
  arXiv  Detail & Related papers  (2022-06-10T13:50:34Z)
• ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learning [6.325464216802613]
  We experimentally evaluate the relationship between the eye blink rate and the attention level of students captured during online sessions. Results suggest an inverse correlation between the eye blink frequency and the attention level. Our results open a new research line to introduce this technology for attention level estimation on future e-learning platforms.
  arXiv  Detail & Related papers  (2021-12-16T19:23:56Z)
• MTCD: Cataract Detection via Near Infrared Eye Images [69.62768493464053]
  cataract is a common eye disease and one of the leading causes of blindness and vision impairment. We present a novel algorithm for cataract detection using near-infrared eye images. Deep learning-based eye segmentation and multitask network classification networks are presented.
  arXiv  Detail & Related papers  (2021-10-06T08:10:28Z)
• Onfocus Detection: Identifying Individual-Camera Eye Contact from Unconstrained Images [81.64699115587167]
  Onfocus detection aims at identifying whether the focus of the individual captured by a camera is on the camera or not. We build a large-scale onfocus detection dataset, named as the OnFocus Detection In the Wild (OFDIW) We propose a novel end-to-end deep model, i.e., the eye-context interaction inferring network (ECIIN) for onfocus detection.
  arXiv  Detail & Related papers  (2021-03-29T03:29:09Z)
• Generalized Iris Presentation Attack Detection Algorithm under Cross-Database Settings [63.90855798947425]
  Presentation attacks pose major challenges to most of the biometric modalities. We propose a generalized deep learning-based presentation attack detection network, MVANet. It is inspired by the simplicity and success of hybrid algorithm or fusion of multiple detection networks.
  arXiv  Detail & Related papers  (2020-10-25T22:42:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.