CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation

• URL: http://arxiv.org/abs/2408.17231v1
• Date: Fri, 30 Aug 2024 12:17:49 GMT
• Title: CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation
• Authors: Zhuang Jia, Jiangfan Deng, Liying Chi, Xiang Long, Daniel K. Du,
• Abstract summary: Parsing eye components (i.e. pupil, iris and sclera) is fundamental for eye tracking and gaze estimation for AR/VR products. In this paper, we consider two priors: projected full pupil/iris circle can be modelled with ellipses (ellipse prior), and the visibility of pupil/iris is controlled by openness of eye-region. We propose CondSeg to estimate elliptical parameters of pupil/iris directly from segmentation labels, without explicitly annotating full ellipses.
• Score: 9.680930476240674
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Parsing of eye components (i.e. pupil, iris and sclera) is fundamental for eye tracking and gaze estimation for AR/VR products. Mainstream approaches tackle this problem as a multi-class segmentation task, providing only visible part of pupil/iris, other methods regress elliptical parameters using human-annotated full pupil/iris parameters. In this paper, we consider two priors: projected full pupil/iris circle can be modelled with ellipses (ellipse prior), and the visibility of pupil/iris is controlled by openness of eye-region (condition prior), and design a novel method CondSeg to estimate elliptical parameters of pupil/iris directly from segmentation labels, without explicitly annotating full ellipses, and use eye-region mask to control the visibility of estimated pupil/iris ellipses. Conditioned segmentation loss is used to optimize the parameters by transforming parameterized ellipses into pixel-wise soft masks in a differentiable way. Our method is tested on public datasets (OpenEDS-2019/-2020) and shows competitive results on segmentation metrics, and provides accurate elliptical parameters for further applications of eye tracking simultaneously.

Related papers

• Towards Unsupervised Eye-Region Segmentation for Eye Tracking [9.051786094550293]
  We use priors of human eye and extract signals from the image to establish rough clues indicating the eye-region structure. A segmentation network is trained to gradually identify the precise area for each part. Experiments show that our unsupervised approach can easily achieve 90% (the pupil and iris) and 85% (the whole eye-region) of the performances under supervised learning.
  arXiv  Detail & Related papers  (2024-10-08T15:33:23Z)
• LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion [79.22197702626542]
  This paper introduces a framework that explores amodal segmentation for robotic grasping in cluttered scenes. We propose a Linear-fusion Attention-guided Convolutional Network (LAC-Net) The results on different datasets show that our method achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-08-06T14:50:48Z)
• EyePreserve: Identity-Preserving Iris Synthesis [8.973296574093506]
  This paper presents the first method of fully data-driven, identity-preserving, pupil size-varying synthesis of iris images. Two immediate applications of the proposed approach are: (a) synthesis of, or enhancement of the existing biometric datasets for iris recognition, and (b) helping forensic human experts in examining iris image pairs with significant differences in pupil dilation.
  arXiv  Detail & Related papers  (2023-12-19T10:29:29Z)
• Periocular biometrics: databases, algorithms and directions [69.35569554213679]
  Periocular biometrics has been established as an independent modality due to concerns on the performance of iris or face systems in uncontrolled conditions. This paper presents a review of the state of the art in periocular biometric research.
  arXiv  Detail & Related papers  (2023-07-26T11:14:36Z)
• Artificial Pupil Dilation for Data Augmentation in Iris Semantic Segmentation [0.0]
  Modern approaches to iris recognition utilize deep learning to segment the valid portion of the iris from the rest of the eye. This paper aims to improve the accuracy of iris semantic segmentation systems by introducing a novel data augmentation technique.
  arXiv  Detail & Related papers  (2022-12-24T13:31:56Z)
• Experimental analysis regarding the influence of iris segmentation on the recognition rate [64.02126624793775]
  The authors will examine whether the segmentation accuracy, based on a ground truth, can serve as a predictor for the overall performance of the iris-biometric tool chain.
  arXiv  Detail & Related papers  (2022-11-10T11:59:51Z)
• Segmentation-free Direct Iris Localization Networks [0.0]
  This paper proposes an efficient iris localization method without using iris segmentation and circle fitting. We propose an iris localization network (ILN) that can directly localize pupil and iris circles with eyelid points from a low-resolution iris image. We also introduce a pupil refinement network (PRN) to improve the accuracy of pupil localization.
  arXiv  Detail & Related papers  (2022-10-19T09:13:39Z)
• Compact multi-scale periocular recognition using SAFE features [63.48764893706088]
  We present a new approach for periocular recognition based on the Symmetry Assessment by Feature Expansion (SAFE) descriptor. We use the sclera center as single key point for feature extraction, highlighting the object-like identity properties that concentrates to this point unique of the eye.
  arXiv  Detail & Related papers  (2022-10-18T11:46:38Z)
• Toward Accurate and Reliable Iris Segmentation Using Uncertainty Learning [96.72850130126294]
  We propose an Iris U-transformer (IrisUsformer) for accurate and reliable iris segmentation. For better accuracy, we elaborately design IrisUsformer by adopting position-sensitive operation and re-packaging transformer block. We show that IrisUsformer achieves better segmentation accuracy using 35% MACs of the SOTA IrisParseNet.
  arXiv  Detail & Related papers  (2021-10-20T01:37:19Z)
• Towards End-to-end Video-based Eye-Tracking [50.0630362419371]
  Estimating eye-gaze from images alone is a challenging task due to un-observable person-specific factors. We propose a novel dataset and accompanying method which aims to explicitly learn these semantic and temporal relationships. We demonstrate that the fusion of information from visual stimuli as well as eye images can lead towards achieving performance similar to literature-reported figures.
  arXiv  Detail & Related papers  (2020-07-26T12:39:15Z)
• EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking [3.0448872422956432]
  Ellipse fitting is an essential component in pupil or iris tracking based video oculography. We propose training a convolutional neural network to directly segment entire elliptical structures.
  arXiv  Detail & Related papers  (2020-07-19T06:13:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.