Polarization-resolved imaging improves eye tracking

• URL: http://arxiv.org/abs/2511.04652v1
• Date: Thu, 06 Nov 2025 18:42:09 GMT
• Title: Polarization-resolved imaging improves eye tracking
• Authors: Mantas Žurauskas, Tom Bu, Sanaz Alali, Beyza Kalkanli, Derek Shi, Fernando Alamos, Gauresh Pandit, Christopher Mei, Ali Behrooz, Ramin Mirjalili, Dave Stronks, Alexander Fix, Dmitri Model,
• Abstract summary: We show how a polarization-enabled eye tracking system can reveal trackable features across the sclera and gaze-informative patterns on the cornea.<n>Results link light--tissue polarization effects to practical gains in human--computer interaction and position PET as a simple, robust sensing modality for future wearable devices.
• Score: 54.79296119759393
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Polarization-resolved near-infrared imaging adds a useful optical contrast mechanism to eye tracking by measuring the polarization state of light reflected by ocular tissues in addition to its intensity. In this paper we demonstrate how this contrast can be used to enable eye tracking. Specifically, we demonstrate that a polarization-enabled eye tracking (PET) system composed of a polarization--filter--array camera paired with a linearly polarized near-infrared illuminator can reveal trackable features across the sclera and gaze-informative patterns on the cornea, largely absent in intensity-only images. Across a cohort of 346 participants, convolutional neural network based machine learning models trained on data from PET reduced the median 95th-percentile absolute gaze error by 10--16\% relative to capacity-matched intensity baselines under nominal conditions and in the presence of eyelid occlusions, eye-relief changes, and pupil-size variation. These results link light--tissue polarization effects to practical gains in human--computer interaction and position PET as a simple, robust sensing modality for future wearable devices.

Related papers

• Classification of Microplastic Particles in Water using Polarized Light Scattering and Machine Learning Methods [0.46950229019783496]
  This paper introduces and validates a novel, reflection-based approach for the in-situ classification and identification of microplastics directly in water bodies.<n>We classify colorless microplastic particles (50-300 $mu$m) by illuminating them with linearly polarized laser light and capturing their reflected signals.<n>Using a deep convolutional neural network (CNN) for image-based classification, we successfully identified three common polymer types, high-density polyethylene, low-density polyethylene, and polypropylene.
  arXiv  Detail & Related papers  (2025-11-10T09:51:15Z)
• PolarAnything: Diffusion-based Polarimetric Image Synthesis [59.14294818211059]
  We propose PolarAnything, capable of synthesizing polarization images from a single RGB input with both photorealism and physical accuracy.<n>Experiments show that our model generates high-quality polarization images and supports downstream tasks like shape from polarization.
  arXiv  Detail & Related papers  (2025-07-23T07:09:10Z)
• Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
  Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer. Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
  arXiv  Detail & Related papers  (2024-06-17T09:48:54Z)
• Learning to Deblur Polarized Images [59.33932533761383]
  A polarization camera can capture four linear polarized images with different polarizer angles in a single shot.<n>Since the on-chip micro-polarizers block part of the light so that the sensor often requires a longer exposure time, the captured polarized images are prone to motion blur.<n>We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• Classification robustness to common optical aberrations [64.08840063305313]
  This paper proposes OpticsBench, a benchmark for investigating robustness to realistic, practically relevant optical blur effects. Experiments on ImageNet show that for a variety of different pre-trained DNNs, the performance varies strongly compared to disk-shaped kernels. We show on ImageNet-100 with OpticsAugment that can be increased by using optical kernels as data augmentation.
  arXiv  Detail & Related papers  (2023-08-29T08:36:00Z)
• Fooling Polarization-based Vision using Locally Controllable Polarizing Projection [55.40484331029597]
  We warn the community of the vulnerability of polarization-based vision, which can be more serious than RGB-based vision. By adapting a commercial LCD projector, we achieve locally controllable polarizing projection, which is successfully utilized to fool state-of-the-art polarization-based vision algorithms.
  arXiv  Detail & Related papers  (2023-03-31T08:48:57Z)
• Near-infrared and visible-light periocular recognition with Gabor features using frequency-adaptive automatic eye detection [69.35569554213679]
  Periocular recognition has gained attention recently due to demands of increased robustness of face or iris in less controlled scenarios. We present a new system for eye detection based on complex symmetry filters, which has the advantage of not needing training. This system is used as input to a periocular algorithm based on retinotopic sampling grids and Gabor spectrum decomposition.
  arXiv  Detail & Related papers  (2022-11-10T13:04:03Z)
• Polarized Color Image Denoising using Pocoformer [42.171036556122644]
  Polarized color photography provides both visual textures and object surficial information in one snapshot. The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
  arXiv  Detail & Related papers  (2022-07-01T05:52:14Z)
• Adaptive optics with reflected light and deep neural networks [0.0]
  We develop a method for adaptive optics with reflected light and deep neural networks compatible with an epi-detection configuration. Large datasets of sample aberrations which consist of excitation and detection path aberrations as well as the corresponding reflected focus images are generated. Deep neural networks can disentangle and independently correct excitation and detection aberrations based on reflected light images recorded from scattering samples.
  arXiv  Detail & Related papers  (2020-04-09T15:39:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.