From Vision to Assistance: Gaze and Vision-Enabled Adaptive Control for a Back-Support Exoskeleton

• URL: http://arxiv.org/abs/2602.04648v1
• Date: Wed, 04 Feb 2026 15:23:42 GMT
• Title: From Vision to Assistance: Gaze and Vision-Enabled Adaptive Control for a Back-Support Exoskeleton
• Abstract summary: We present a vision-gated control framework for an active lumbar occupational exoskeleton.<n>The proposed system integrates real-time grasp detection from a first-person YOLO-based perception system.<n>A user study shows that vision-gated assistance significantly reduces perceived physical demand.
• Score: 42.24099624713759
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Back-support exoskeletons have been proposed to mitigate spinal loading in industrial handling, yet their effectiveness critically depends on timely and context-aware assistance. Most existing approaches rely either on load-estimation techniques (e.g., EMG, IMU) or on vision systems that do not directly inform control. In this work, we present a vision-gated control framework for an active lumbar occupational exoskeleton that leverages egocentric vision with wearable gaze tracking. The proposed system integrates real-time grasp detection from a first-person YOLO-based perception system, a finite-state machine (FSM) for task progression, and a variable admittance controller to adapt torque delivery to both posture and object state. A user study with 15 participants performing stooping load lifting trials under three conditions (no exoskeleton, exoskeleton without vision, exoskeleton with vision) shows that vision-gated assistance significantly reduces perceived physical demand and improves fluency, trust, and comfort. Quantitative analysis reveals earlier and stronger assistance when vision is enabled, while questionnaire results confirm user preference for the vision-gated mode. These findings highlight the potential of egocentric vision to enhance the responsiveness, ergonomics, safety, and acceptance of back-support exoskeletons.

Related papers

• BiliVLA: Scene-Aware Vision-Language-Action Model with Reinforcement Learning for Autonomous Biliary Endoscopic Navigation [6.2182538853159]
  Endoscopic retrograde cholangiopancreatography (ERCP) demands precise endoscopic navigation and stable biliary cannulation.<n>Recent robotic systems and vision-based assistance techniques improve operator ergonomics and provide perceptual cues.<n>We present BiliVLA, a scene-aware Vision-Language-Action framework that formulates biliary endoscopic navigation as an instruction-conditioned visuomotor learning problem.
  arXiv  Detail & Related papers  (2026-06-22T16:11:15Z)
• Visually-Guided Policy Optimization for Multimodal Reasoning [60.035908460318126]
  We propose Visually-Guided Policy Optimization (VGPO) to reinforce visual focus during policy optimization.<n> VGPO initially introduces a Visual Attention Compensation mechanism that leverages visual similarity to localize and amplify visual cues.<n>We show that VGPO achieves better visual activation and superior performance in mathematical multimodal reasoning and visual-dependent tasks.
  arXiv  Detail & Related papers  (2026-04-10T14:22:38Z)
• Characterizing the onset and offset of motor imagery during passive arm movements induced by an upper-body exoskeleton [2.940700063130023]
  This study aims to characterize the onset and offset of motor imagery during passive arm movements induced by an exoskeleton.<n>Ten participants were recruited to perform kinesthetic motor imagery (MI) of the right arm while attached to the robot, simultaneously cued with LEDs indicating the initiation and termination of a goal-oriented reaching task.<n>Our approach showed that participants could produce quality and reliable sensorimotor rhythms regardless of noise or passive arm movements induced by wearing the exoskeleton.
  arXiv  Detail & Related papers  (2026-03-21T17:21:15Z)
• Gym-V: A Unified Vision Environment System for Agentic Vision Research [51.62136909074774]
  Gym-V is a unified platform of 179 procedurally generated visual environments across 10 domains with controllable difficulty.<n>We find that observation scaffolding is more decisive for training success than the choice of RL algorithm.<n>Cross-domain transfer experiments show that training on diverse task generalizes broadly while narrow training can cause negative transfer.
  arXiv  Detail & Related papers  (2026-03-16T15:37:07Z)
• A Multi-Layer Sim-to-Real Framework for Gaze-Driven Assistive Neck Exoskeletons [9.701251021373885]
  Dropped head syndrome, caused by neck muscle weakness from neurological diseases, severely impairs an individual's ability to support and move their head.<n>Our long-term goal is to develop an assistive powered neck exoskeleton that restores natural movement.<n>We leverage virtual reality (VR) to collect coupled eye and head movement data from healthy individuals.
  arXiv  Detail & Related papers  (2026-03-06T18:22:21Z)
• When would Vision-Proprioception Policies Fail in Robotic Manipulation? [24.653339846980376]
  Proprioceptive information is critical for precise servo control by providing real-time robotic states.<n>Recent studies have reported inconsistent observations on the generalization of vision-proprioception policies.<n>We propose the Gradient Adjustment with Phase-guidance (GAP) algorithm that adaptively modulates the optimization of proprioception.
  arXiv  Detail & Related papers  (2026-02-12T15:00:48Z)
• ReViP: Reducing False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalance [50.05984919728878]
  We present ReViP, a novel VLA framework with Vision-Proprioception Rebalance to enhance visual grounding and robustness under perturbations.<n>Specifically, we use an external VLM as a task-stage observer to extract real-time task-centric visual cues from visual observations.<n>To evaluate false completion, we propose the first False-Completion Benchmark Suite built on LIBERO with controlled settings such as Object-Drop.
  arXiv  Detail & Related papers  (2026-01-23T11:31:07Z)
• Point Cloud-based Grasping for Soft Hand Exoskeleton [6.473578652011161]
  This study presents a vision-based predictive control framework that leverages contextual awareness to predict the grasping target and determine the next control state for activation.<n>The Grasping Ability Score (GAS) was used to evaluate performance, with our system achieving a state-of-the-art GAS of 91% across 15 objects and healthy participants.
  arXiv  Detail & Related papers  (2025-04-04T11:40:04Z)
• Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence [69.86946427928511]
  We investigate the internal mechanisms driving hallucination in large vision-language models (LVLMs)<n>We introduce Vision-aware Head Divergence (VHD), a metric that quantifies the sensitivity of attention head outputs to visual context.<n>We propose Vision-aware Head Reinforcement (VHR), a training-free approach to mitigate hallucination by enhancing the role of vision-aware attention heads.
  arXiv  Detail & Related papers  (2024-12-18T15:29:30Z)
• Deep-Learning Control of Lower-Limb Exoskeletons via simplified Therapist Input [0.0]
  Partial-assistance exoskeletons hold significant potential for gait rehabilitation.<n>The control of interaction torques in exoskeletons relies on a hierarchical control structure.<n>This work proposes a three-step, data-driven approach to address the limitations of hierarchical control in exoskeletons.
  arXiv  Detail & Related papers  (2024-12-10T22:52:44Z)
• Towards Understanding the Adversarial Vulnerability of Skeleton-based Action Recognition [133.35968094967626]
  Skeleton-based action recognition has attracted increasing attention due to its strong adaptability to dynamic circumstances. With the help of deep learning techniques, it has also witnessed substantial progress and currently achieved around 90% accuracy in benign environment. Research on the vulnerability of skeleton-based action recognition under different adversarial settings remains scant.
  arXiv  Detail & Related papers  (2020-05-14T17:12:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.