Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering

• URL: http://arxiv.org/abs/2607.07099v1
• Date: Wed, 08 Jul 2026 07:33:40 GMT
• Title: Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering
• Abstract summary: This paper proposes a real-time video-based automated detection system for squint and cataract detection.<n>The proposed system uses a media-pipe face-mesh to extract geometric ocular features for multi-class squint classification.<n>The experimental performance has shown great accuracy in the detection of squint (98.39%) and classification of cataract (96.90%)
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Squint and cataract are major ocular disorders that majorly affect visual perception and interaction capability. This paper proposes a real-time video-based automated detection system for squint and cataract detection based on computer vision and image processing methods. The proposed system uses a media-pipe face-mesh (a 478-point facial landmark detection model) to extract geometric ocular features for multi-class squint classification. Simultaneously, The presence and severity cataract is estimated through grayscale intensity and histogram-based lens opacity analysis. The system records short video sequences with standard laptop or mobile cameras, which can be deployed at low costs and on a large scale. The experimental performance has shown great accuracy in the detection of squint (98.39%) and classification of cataract (96.90%). Besides automatic ocular analysis, the proposed framework is also made accessible for visual impairment inference which will be integrated with future adaptive user interface and Web accessibility systems for people with visual impairment.

Related papers

• Examining the Impact of Optical Aberrations to Image Classification and Object Detection Models [58.98742597810023]
  Vision models have to behave in a robust way to disturbances such as noise or blur.<n>This paper studies two datasets of blur corruptions, which we denote OpticsBench and LensCorruptions.<n> Evaluations for image classification and object detection on ImageNet and MSCOCO show that for a variety of different pre-trained models, the performance on OpticsBench and LensCorruptions varies significantly.
  arXiv  Detail & Related papers  (2025-04-25T17:23:47Z)
• Visual Fixation-Based Retinal Prosthetic Simulation [1.0075717342698087]
  The fixation-based framework achieves a classification accuracy of 87.72%, using computational parameters based on a real subject's physiological data. Our approach shows promising potential for producing more semantically understandable percepts with the limited resolution available in retinal prosthetics.
  arXiv  Detail & Related papers  (2024-10-15T15:24:08Z)
• LDMRes-Net: Enabling Efficient Medical Image Segmentation on IoT and Edge Platforms [9.626726110488386]
  We propose a lightweight dual-multiscale residual block-based computational neural network tailored for medical image segmentation on IoT and edge platforms. LDMRes-Net overcomes limitations with its remarkably low number of learnable parameters (0.072M), making it highly suitable for resource-constrained devices.
  arXiv  Detail & Related papers  (2023-06-09T10:34:18Z)
• Near-infrared and visible-light periocular recognition with Gabor features using frequency-adaptive automatic eye detection [69.35569554213679]
  Periocular recognition has gained attention recently due to demands of increased robustness of face or iris in less controlled scenarios. We present a new system for eye detection based on complex symmetry filters, which has the advantage of not needing training. This system is used as input to a periocular algorithm based on retinotopic sampling grids and Gabor spectrum decomposition.
  arXiv  Detail & Related papers  (2022-11-10T13:04:03Z)
• FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks [77.34726150561087]
  We show how to explore high-dimensional landscape characteristics of neural networks. We generalize observations on small neural networks to more complex systems. An interactive dashboard opens up a number of possible application networks.
  arXiv  Detail & Related papers  (2022-04-09T16:41:53Z)
• A Temporal Learning Approach to Inpainting Endoscopic Specularities and Its effect on Image Correspondence [13.25903945009516]
  We propose using a temporal generative adversarial network (GAN) to inpaint the hidden anatomy under specularities. This is achieved using in-vivo data of gastric endoscopy (Hyper-Kvasir) in a fully unsupervised manner. We also assess the effect of our method in computer vision tasks that underpin 3D reconstruction and camera motion estimation.
  arXiv  Detail & Related papers  (2022-03-31T13:14:00Z)
• MTCD: Cataract Detection via Near Infrared Eye Images [69.62768493464053]
  cataract is a common eye disease and one of the leading causes of blindness and vision impairment. We present a novel algorithm for cataract detection using near-infrared eye images. Deep learning-based eye segmentation and multitask network classification networks are presented.
  arXiv  Detail & Related papers  (2021-10-06T08:10:28Z)
• Assessing glaucoma in retinal fundus photographs using Deep Feature Consistent Variational Autoencoders [63.391402501241195]
  glaucoma is challenging to detect since it remains asymptomatic until the symptoms are severe. Early identification of glaucoma is generally made based on functional, structural, and clinical assessments. Deep learning methods have partially solved this dilemma by bypassing the marker identification stage and analyzing high-level information directly to classify the data.
  arXiv  Detail & Related papers  (2021-10-04T16:06:49Z)
• An Interpretable Multiple-Instance Approach for the Detection of referable Diabetic Retinopathy from Fundus Images [72.94446225783697]
  We propose a machine learning system for the detection of referable Diabetic Retinopathy in fundus images. By extracting local information from image patches and combining it efficiently through an attention mechanism, our system is able to achieve high classification accuracy. We evaluate our approach on publicly available retinal image datasets, in which it exhibits near state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-03-02T13:14:15Z)
• Optimal Transfer Learning Model for Binary Classification of Funduscopic Images through Simple Heuristics [0.8370915747360484]
  We attempt to use deep learning neural networks to diagnose funduscopic images, visual representations of the interior of the eye. We propose a unifying model for disease classification: low-cost inference of a fundus image to determine whether it is healthy or diseased.
  arXiv  Detail & Related papers  (2020-02-11T03:49:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.