Towards Energy Efficient Mobile Eye Tracking for AR Glasses through Optical Sensor Technology

• URL: http://arxiv.org/abs/2212.03189v1
• Date: Tue, 6 Dec 2022 18:09:25 GMT
• Title: Towards Energy Efficient Mobile Eye Tracking for AR Glasses through Optical Sensor Technology
• Authors: Johannes Meyer
• Abstract summary: Eye-tracking is a crucial technology to help AR glasses achieve a breakthrough through optimized display technology and gaze-based interaction concepts. This thesis contributes to a significant scientific advancement towards energy-efficient mobile eye-tracking for AR glasses.
• Score: 1.52292571922932
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: After the introduction of smartphones and smartwatches, AR glasses are considered the next breakthrough in the field of wearables. While the transition from smartphones to smartwatches was based mainly on established display technologies, the display technology of AR glasses presents a technological challenge. Many display technologies, such as retina projectors, are based on continuous adaptive control of the display based on the user's pupil position. Furthermore, head-mounted systems require an adaptation and extension of established interaction concepts to provide the user with an immersive experience. Eye-tracking is a crucial technology to help AR glasses achieve a breakthrough through optimized display technology and gaze-based interaction concepts. Available eye-tracking technologies, such as VOG, do not meet the requirements of AR glasses, especially regarding power consumption, robustness, and integrability. To further overcome these limitations and push mobile eye-tracking for AR glasses forward, novel laser-based eye-tracking sensor technologies are researched in this thesis. The thesis contributes to a significant scientific advancement towards energy-efficient mobile eye-tracking for AR glasses.

Related papers

• Technique Report of CVPR 2024 PBDL Challenges [211.79824163599872]
  Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. Deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop.
  arXiv  Detail & Related papers  (2024-06-15T21:44:17Z)
• Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/s [53.91923493664551]
  This work introduces a hardware-accelerated integrated optoelectronic platform for multidimensional video understanding in real-time. The technology platform combines artificial intelligence hardware, processing information optically, with state-of-the-art machine vision networks. Such performance surpasses the speed of the closest technologies with similar spectral resolution by three to four orders of magnitude.
  arXiv  Detail & Related papers  (2023-12-17T07:51:38Z)
• Random resistive memory-based deep extreme point learning machine for unified visual processing [67.51600474104171]
  We propose a novel hardware-software co-design, random resistive memory-based deep extreme point learning machine (DEPLM) Our co-design system achieves huge energy efficiency improvements and training cost reduction when compared to conventional systems.
  arXiv  Detail & Related papers  (2023-12-14T09:46:16Z)
• A Consumer-tier based Visual-Brain Machine Interface for Augmented Reality Glasses Interactions [7.608396231537724]
  We develop a consumer-tier Visual-Brain Machine Inteface(V-BMI) system specialized for Augmented Reality(AR) glasses interactions. The developed system consists of a wearable hardware which takes advantages of fast set-up, reliable recording and comfortable wearable experience.
  arXiv  Detail & Related papers  (2023-08-29T06:33:13Z)
• Open Gaze: Open Source eye tracker for smartphone devices using Deep Learning [0.0]
  We present an open-source implementation of a smartphone-based gaze tracker that emulates the methodology proposed by a GooglePaper. Through the integration of machine learning techniques, we unveil an accurate eye tracking solution that is native to smartphones. Our findings exhibit the inherent potential to amplify eye movement research by significant proportions.
  arXiv  Detail & Related papers  (2023-08-25T17:10:22Z)
• Task Offloading for Smart Glasses in Healthcare: Enhancing Detection of Elevated Body Temperature [3.6525326603691504]
  This paper focuses on analyzing task-offloading scenarios for a healthcare monitoring application performed on smart wearable glasses. The study evaluates performance metrics including task completion time, computing capabilities, and energy consumption under realistic conditions. The findings highlight the potential benefits of task offloading for wearable devices in healthcare settings.
  arXiv  Detail & Related papers  (2023-08-14T14:57:19Z)
• Towards Everyday Virtual Reality through Eye Tracking [1.2691047660244335]
  Eye tracking is an emerging technology that helps to assess human behaviors in a real time and non-intrusive way. A significant scientific push towards everyday virtual reality has been completed with three main research contributions.
  arXiv  Detail & Related papers  (2022-03-29T16:09:37Z)
• Modern Augmented Reality: Applications, Trends, and Future Directions [160.03363259015072]
  Augmented reality (AR) is one of the relatively old, yet trending areas in the intersection of computer vision and computer graphics. This work tries to provide an overview of modern augmented reality, from both application-level and technical perspective.
  arXiv  Detail & Related papers  (2022-02-18T22:12:37Z)
• Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs [62.91362897985057]
  An Intelligent IoT Environment (iIoTe) is comprised of heterogeneous devices that can collaboratively execute semi-autonomous IoT applications. This paper provides a state-of-the-art overview of these technologies and illustrates their functionality and performance, with special attention to the tradeoff among resources, latency, privacy and energy consumption.
  arXiv  Detail & Related papers  (2021-10-04T19:41:42Z)
• Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision [42.986246806259764]
  Computational Imaging (CI) systems are designed to capture high-dimensional data in an encoded manner to provide more information for mobile vision systems. This work first introduces the advances of CI in diverse applications and then conducts a comprehensive review of current research topics combining CI and AI. We propose a framework to deeply integrate CI and AI by using the example of self-driving vehicles with high-speed communication, edge computing and traffic planning.
  arXiv  Detail & Related papers  (2021-09-18T08:47:08Z)
• Photonics for artificial intelligence and neuromorphic computing [52.77024349608834]
  Photonic integrated circuits have enabled ultrafast artificial neural networks. Photonic neuromorphic systems offer sub-nanosecond latencies. These systems could address the growing demand for machine learning and artificial intelligence.
  arXiv  Detail & Related papers  (2020-10-30T21:41:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.