EyeDentify: A Dataset for Pupil Diameter Estimation based on Webcam Images

• URL: http://arxiv.org/abs/2407.11204v1
• Date: Mon, 15 Jul 2024 19:39:28 GMT
• Title: EyeDentify: A Dataset for Pupil Diameter Estimation based on Webcam Images
• Authors: Vijul Shah, Ko Watanabe, Brian B. Moser, Andreas Dengel,
• Abstract summary: EyeDentify is a dataset specifically designed for pupil diameter estimation based on webcam images. Deep learning models that can estimate pupil diameters using standard webcam data are scarce. EyeDentify enables the development and refinement of models designed specifically for less-equipped environments.
• Score: 6.298516754485939
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, we introduce EyeDentify, a dataset specifically designed for pupil diameter estimation based on webcam images. EyeDentify addresses the lack of available datasets for pupil diameter estimation, a crucial domain for understanding physiological and psychological states traditionally dominated by highly specialized sensor systems such as Tobii. Unlike these advanced sensor systems and associated costs, webcam images are more commonly found in practice. Yet, deep learning models that can estimate pupil diameters using standard webcam data are scarce. By providing a dataset of cropped eye images alongside corresponding pupil diameter information, EyeDentify enables the development and refinement of models designed specifically for less-equipped environments, democratizing pupil diameter estimation by making it more accessible and broadly applicable, which in turn contributes to multiple domains of understanding human activity and supporting healthcare. Our dataset is available at https://vijulshah.github.io/eyedentify/.

Related papers

• Early Detection of Visual Impairments at Home Using a Smartphone Red-Eye Reflex Test [41.99844472131922]
  The so-called Bruckner test is traditionally performed by ophthalmologists in clinical settings.<n>Thanks to the recent technological advances in smartphones and artificial intelligence, it is now possible to recreate the Bruckner test using a mobile device.<n>We present a first study conducted during the development of KidsVisionCheck, a free application that can perform vision screening with a mobile device.
  arXiv  Detail & Related papers  (2025-09-11T19:27:57Z)
• A System for Accurate Tracking and Video Recordings of Rodent Eye Movements using Convolutional Neural Networks for Biomedical Image Segmentation [1.961086321336988]
  We present a flexible, robust, and highly accurate model for pupil and corneal reflection identification in rodent gaze determination.<n>This is the first paper that demonstrates a highly accurate and practical biomedical image segmentation based convolutional neural network architecture.
  arXiv  Detail & Related papers  (2025-06-09T19:48:32Z)
• Webcam-based Pupil Diameter Prediction Benefits from Upscaling [6.298516754485939]
  This study evaluates the impact of various upscaling methods, ranging from bicubic to advanced super-resolution, on pupil diameter predictions. Our findings suggest that pupil diameter prediction models trained on upscaled datasets are highly sensitive to the selected upscaling method and scale.
  arXiv  Detail & Related papers  (2024-08-19T20:28:39Z)
• Using artificial intelligence methods for the studyed visual analyzer [0.0]
  The paper describes how various techniques for applying artificial intelligence to the study of human eyes are utilized. The first dataset was collected using computerized perimetry to investigate the visualization of the human visual field and the diagnosis of glaucoma. The second dataset was obtained, as part of the implementation of a Russian-Swiss experiment to collect and analyze eye movement data using the Tobii Pro Glasses 3 device on VR video.
  arXiv  Detail & Related papers  (2024-04-25T20:12:51Z)
• Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems [80.62854148838359]
  Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. We use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data. Our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
  arXiv  Detail & Related papers  (2024-03-23T22:32:06Z)
• DeepMetricEye: Metric Depth Estimation in Periocular VR Imagery [4.940128337433944]
  We propose a lightweight framework derived from the U-Net 3+ deep learning backbone to estimate measurable periocular depth maps. Our method reconstructs three-dimensional periocular regions, providing a metric basis for related light stimulus calculation protocols and medical guidelines. Evaluated on a sample of 36 participants, our method exhibited notable efficacy in the periocular global precision evaluation experiment, and the pupil diameter measurement.
  arXiv  Detail & Related papers  (2023-11-13T10:55:05Z)
• Periocular biometrics: databases, algorithms and directions [69.35569554213679]
  Periocular biometrics has been established as an independent modality due to concerns on the performance of iris or face systems in uncontrolled conditions. This paper presents a review of the state of the art in periocular biometric research.
  arXiv  Detail & Related papers  (2023-07-26T11:14:36Z)
• Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose Estimation of Surgical Instruments [64.59698930334012]
  We present a multi-camera capture setup consisting of static and head-mounted cameras. Second, we publish a multi-view RGB-D video dataset of ex-vivo spine surgeries, captured in a surgical wet lab and a real operating theatre. Third, we evaluate three state-of-the-art single-view and multi-view methods for the task of 6DoF pose estimation of surgical instruments.
  arXiv  Detail & Related papers  (2023-05-05T13:42:19Z)
• A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications [56.458448869572294]
  We introduce DETRtime, a novel framework for time-series segmentation of EEG data. Our end-to-end deep learning-based framework brings advances in Computer Vision to the forefront. Our model generalizes well in the task of EEG sleep stage segmentation.
  arXiv  Detail & Related papers  (2022-06-17T10:17:24Z)
• Monocular Depth Estimation Using Cues Inspired by Biological Vision Systems [22.539300644593936]
  Monocular depth estimation (MDE) aims to transform an RGB image of a scene into a pixelwise depth map from the same camera view. Part of the MDE task is to learn which visual cues in the image can be used for depth estimation, and how. We demonstrate that explicitly injecting visual cue information into the model is beneficial for depth estimation.
  arXiv  Detail & Related papers  (2022-04-21T19:42:36Z)
• Analyzing General-Purpose Deep-Learning Detection and Segmentation Models with Images from a Lidar as a Camera Sensor [0.06554326244334865]
  This work explores the potential of general-purpose DL perception algorithms for processing image-like outputs of advanced lidar sensors. Rather than processing the three-dimensional point cloud data, this is, to the best of our knowledge, the first work to focus on low-resolution images with 360text field of view. We show that with adequate preprocessing, general-purpose DL models can process these images, opening the door to their usage in environmental conditions.
  arXiv  Detail & Related papers  (2022-03-08T13:14:43Z)
• Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze [12.314175125417098]
  In offline mode, our software extracts multiple features from the eye including, the pupil and iris ellipse, eye aperture, pupil vector, iris vector, eye movement types from pupil and iris velocities, marker detection, marker distance, 2D gaze estimation for the pupil center, iris center, pupil vector, and iris vector. The gaze signal is computed in 2D for each eye and each feature separately and for both eyes in 3D also for each feature separately.
  arXiv  Detail & Related papers  (2022-01-18T07:54:55Z)
• MTCD: Cataract Detection via Near Infrared Eye Images [69.62768493464053]
  cataract is a common eye disease and one of the leading causes of blindness and vision impairment. We present a novel algorithm for cataract detection using near-infrared eye images. Deep learning-based eye segmentation and multitask network classification networks are presented.
  arXiv  Detail & Related papers  (2021-10-06T08:10:28Z)
• An Interpretable Multiple-Instance Approach for the Detection of referable Diabetic Retinopathy from Fundus Images [72.94446225783697]
  We propose a machine learning system for the detection of referable Diabetic Retinopathy in fundus images. By extracting local information from image patches and combining it efficiently through an attention mechanism, our system is able to achieve high classification accuracy. We evaluate our approach on publicly available retinal image datasets, in which it exhibits near state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-03-02T13:14:15Z)
• Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition [131.6328804788164]
  We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos) The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
  arXiv  Detail & Related papers  (2020-09-01T03:38:31Z)
• Neural Ray Surfaces for Self-Supervised Learning of Depth and Ego-motion [51.19260542887099]
  We show that self-supervision can be used to learn accurate depth and ego-motion estimation without prior knowledge of the camera model. Inspired by the geometric model of Grossberg and Nayar, we introduce Neural Ray Surfaces (NRS), convolutional networks that represent pixel-wise projection rays. We demonstrate the use of NRS for self-supervised learning of visual odometry and depth estimation from raw videos obtained using a wide variety of camera systems.
  arXiv  Detail & Related papers  (2020-08-15T02:29:13Z)
• Optimal Transfer Learning Model for Binary Classification of Funduscopic Images through Simple Heuristics [0.8370915747360484]
  We attempt to use deep learning neural networks to diagnose funduscopic images, visual representations of the interior of the eye. We propose a unifying model for disease classification: low-cost inference of a fundus image to determine whether it is healthy or diseased.
  arXiv  Detail & Related papers  (2020-02-11T03:49:14Z)
• 1-D Convlutional Neural Networks for the Analysis of Pupil Size Variations in Scotopic Conditions [79.71065005161566]
  1-D convolutional neural network models are trained for classification of short-range sequences. Model provides prediction with high average accuracy on a hold out test set.
  arXiv  Detail & Related papers  (2020-02-06T17:25:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.