An Embedded and Real-Time Pupil Detection Pipeline

• URL: http://arxiv.org/abs/2302.14098v1
• Date: Mon, 27 Feb 2023 19:16:42 GMT
• Title: An Embedded and Real-Time Pupil Detection Pipeline
• Authors: Ankur Raj, Diwas Bhattarai, Kristof Van Laerhoven
• Abstract summary: We introduce an open-source embedded system for wearable, non-invasive pupil detection in real-time. Our system consists of a head-mounted eye tracker prototype, which combines two miniature camera systems with Raspberry Pi-based embedded system.
• Score: 2.23017937341178
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Wearable pupil detection systems often separate the analysis of the captured wearer's eye images for wirelessly-tethered back-end systems. We argue in this paper that investigating hardware-software co-designs would bring along opportunities to make such systems smaller and more efficient. We introduce an open-source embedded system for wearable, non-invasive pupil detection in real-time, on the wearable, embedded platform itself. Our system consists of a head-mounted eye tracker prototype, which combines two miniature camera systems with Raspberry Pi-based embedded system. Apart from the hardware design, we also contribute a pupil detection pipeline that operates using edge analysis, natively on the embedded system at 30fps and run-time of 54ms at 480x640 and 23ms at 240x320. Average cumulative error of 5.3368px is found on the LPW dataset for a detection rate of 51.9\% with our detection pipeline. For evaluation on our hardware-specific camera frames, we also contribute a dataset of 35000 images, from 20 participants.

Related papers

• DIOR: Dataset for Indoor-Outdoor Reidentification -- Long Range 3D/2D Skeleton Gait Collection Pipeline, Semi-Automated Gait Keypoint Labeling and Baseline Evaluation Methods [8.265408202637857]
  This paper introduces DIOR -- a framework for data collection, semi-automated annotation, and provides a dataset with 14 subjects and 1.649 million RGB frames with 3D/2D skeleton gait labels. We successfully achieve precise skeleton labeling on far-away subjects, even when their height is limited to a mere 20-25 pixels within an RGB frame.
  arXiv  Detail & Related papers  (2023-09-21T18:51:00Z)
• Agile gesture recognition for capacitive sensing devices: adapting on-the-job [55.40855017016652]
  We demonstrate a hand gesture recognition system that uses signals from capacitive sensors embedded into the etee hand controller. The controller generates real-time signals from each of the wearer five fingers. We use a machine learning technique to analyse the time series signals and identify three features that can represent 5 fingers within 500 ms.
  arXiv  Detail & Related papers  (2023-05-12T17:24:02Z)
• FastPillars: A Deployment-friendly Pillar-based 3D Detector [63.0697065653061]
  Existing BEV-based (i.e., Bird Eye View) detectors favor sparse convolutions (known as SPConv) to speed up training and inference. FastPillars delivers state-of-the-art accuracy on Open dataset with 1.8X speed up and 3.8 mAPH/L2 improvement over CenterPoint (SPConv-based)
  arXiv  Detail & Related papers  (2023-02-05T12:13:27Z)
• Near-infrared and visible-light periocular recognition with Gabor features using frequency-adaptive automatic eye detection [69.35569554213679]
  Periocular recognition has gained attention recently due to demands of increased robustness of face or iris in less controlled scenarios. We present a new system for eye detection based on complex symmetry filters, which has the advantage of not needing training. This system is used as input to a periocular algorithm based on retinotopic sampling grids and Gabor spectrum decomposition.
  arXiv  Detail & Related papers  (2022-11-10T13:04:03Z)
• Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities [66.4525391417921]
  We design and evaluate a multi-sensor drone detection system. Our solution integrates a fish-eye camera as well to monitor a wider part of the sky and steer the other cameras towards objects of interest. The thermal camera is shown to be a feasible solution as good as the video camera, even if the camera employed here has a lower resolution.
  arXiv  Detail & Related papers  (2022-07-05T10:00:58Z)
• Real-time HOG+SVM based object detection using SoC FPGA for a UHD video stream [0.0]
  We present a real-time implementation of the well-known pedestrian detector with HOG (Histogram of Oriented Gradients) feature extraction and SVM (Support Vector Machine) classification. The system is capable of detecting a pedestrian in a single scale.
  arXiv  Detail & Related papers  (2022-04-22T10:29:21Z)
• Lightweight Multi-Drone Detection and 3D-Localization via YOLO [1.284647943889634]
  We present and evaluate a method to perform real-time multiple drone detection and three-dimensional localization. We use state-of-the-art tiny-YOLOv4 object detection algorithm and stereo triangulation. Our computer vision approach eliminates the need for computationally expensive stereo matching algorithms.
  arXiv  Detail & Related papers  (2022-02-18T09:41:23Z)
• PiFeNet: Pillar-Feature Network for Real-Time 3D Pedestrian Detection from Point Cloud [64.12626752721766]
  We present PiFeNet, an efficient real-time 3D detector for pedestrian detection from point clouds. We address two challenges that 3D object detection frameworks encounter when detecting pedestrians: low of pillar features and small occupation areas of pedestrians in point clouds. Our approach is ranked 1st in KITTI pedestrian BEV and 3D leaderboards while running at 26 frames per second (FPS), and achieves state-of-the-art performance on Nuscenes detection benchmark.
  arXiv  Detail & Related papers  (2021-12-31T13:41:37Z)
• A Learned Stereo Depth System for Robotic Manipulation in Homes [2.06216858680643]
  We present a passive stereo depth system that produces dense and accurate point clouds optimized for human environments. The system consists of an algorithm combining learned stereo matching with engineered filtering, a training and data-mixing methodology, and a sensor hardware design.
  arXiv  Detail & Related papers  (2021-09-23T20:53:55Z)
• Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection [99.94079901071163]
  This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs) We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm. Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83%.
  arXiv  Detail & Related papers  (2020-04-03T17:36:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.