Towards Real-World Applications with an Autonomous Powered Wheelchair

• URL: http://arxiv.org/abs/2607.06383v1
• Date: Tue, 07 Jul 2026 15:21:33 GMT
• Title: Towards Real-World Applications with an Autonomous Powered Wheelchair
• Abstract summary: We introduce a proof-of-concept prototype that integrates autonomous perception, gesture-based interaction, and navigation on a commercially available self-balancing powered wheelchair.<n>The proposed system builds upon Genny Zero, a commercial self-balancing wheelchair that enables hands-free and intuitive operation through body-weight shifting.<n>We demonstrate the integrated system in two assistive applications: hailing, allowing users to call the wheelchair from a distance; and (ii) people-following, where the wheelchair follows a person using leader-follower strategies.
• Score: 41.49524260295959
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Wheelchair users call for assistive mobility systems that provide active support, adapt to dynamic environments, and are intuitive and user-friendly. However, powered wheelchairs typically still provide limited autonomy and lack effective integration with advanced perception and navigation capabilities, particularly in complex real-world environments. This paper presents a preliminary study toward autonomous powered wheelchairs for real-world assistive mobility. We introduce a proof-of-concept prototype that integrates autonomous perception, gesture-based interaction, and navigation on a commercially available self-balancing powered wheelchair. The proposed system builds upon Genny Zero, a commercial self-balancing wheelchair that enables hands-free and intuitive operation through body-weight shifting. To extend its capabilities toward autonomous operation, we integrate an RGB-D camera for human-aware perception and interaction, together with a LiDAR sensor for localization and navigation. We demonstrate the integrated system in two assistive applications: (i) hailing, allowing users to call the wheelchair from a distance; and (ii) people-following, where the wheelchair follows a person using leader-follower strategies, including a constrained indoor navigation example. The results highlight the potential of combining autonomous robotics with assistive mobility platforms, while also showing the feasibility of the proposed integration and identifying the main technical challenges that must be addressed before moving toward user-ready, accessible, and intelligent mobility solutions. A video demonstrating the experimental setup and results is available at: https://youtu.be/LVAix_Qx7bM.

Related papers

• ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration [51.69384671495837]
  ActiveGlasses is a system for learning robot manipulation from ego-centric human demonstrations with active vision.<n>A stereo camera mounted on smart glasses serves as the sole perception device for both data collection and policy inference.<n>To enable zero-transfer, we extract object trajectories from demonstrations and use an object-centric point-cloud policy to jointly predict manipulation and head movement.
  arXiv  Detail & Related papers  (2026-04-09T17:59:08Z)
• AURA: Multimodal Shared Autonomy for Real-World Urban Navigation [49.419374037785815]
  Long-horizon navigation in complex urban environments relies heavily on continuous human operation.<n>We present Assistive Urban Robot Autonomy (AURA), a new multi-modal framework that decomposes urban navigation into high-level human instruction and low-level AI control.<n>AURA effectively follows human instructions, reduces manual operation effort, and improves navigation stability, while enabling online adaptation.
  arXiv  Detail & Related papers  (2026-04-02T05:59:31Z)
• Beyond Cybathlon: On-demand Quadrupedal Assistance for People with Limited Mobility [16.344422378924175]
  We present an on-demand quadrupedal assistance robot system controlled via a shared autonomy approach.<n>We automate pick-and-place tasks, as well as robot movement through the environment with semantic, collision-aware navigation.<n>We find our system capable of assisting in a broad variety of tasks, including those that require dexterous manipulation.
  arXiv  Detail & Related papers  (2026-03-17T16:48:36Z)
• SAATT Nav: a Socially Aware Autonomous Transparent Transportation Navigation Framework for Wheelchairs [4.525998912981213]
  This work proposes Socially Aware Autonomous Transparent Transportation (SAATT) Navigation framework for wheelchairs as a potential solution.<n>It implements a Large Language Model (LLM) informed of user intent and capable of predicting other peoples' intent as a decision-maker for its local controller.<n>Overall, SAATT Nav outperforms in most social situations and equivalently or only slightly worse in the remaining metrics.
  arXiv  Detail & Related papers  (2026-03-14T02:13:58Z)
• OmniTrack: General Motion Tracking via Physics-Consistent Reference [54.256312586493415]
  We introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking.<n>Experiments show that OmniTrack improves tracking accuracy and demonstrates strong generalization to unseen motions.<n>In real-world tests, OmniTrack achieves hour-long, consistent, and stable tracking, including complex acrobatic motions such as flips and cartwheels.
  arXiv  Detail & Related papers  (2026-02-27T09:12:15Z)
• HUSKY: Humanoid Skateboarding System via Physics-Aware Whole-Body Control [67.58927286226925]
  We propose a learning-based framework that integrates humanoid-skateboard system modeling and physics-aware whole-body control.<n>Experiments on the Unitree G1 humanoid platform demonstrate that our framework enables stable and agile maneuvering on skateboards in real-world scenarios.
  arXiv  Detail & Related papers  (2026-02-03T07:18:01Z)
• Shared Control of Holonomic Wheelchairs through Reinforcement Learning [1.4970676989901233]
  State-of-the-art work showed the potential of shared control in improving safety in navigation for non-holonomic robots.<n>We propose a reinforcement learning-based method, which takes a 2D user input and outputs a 3D motion.<n>We show that our method ensures collision-free navigation while smartly orienting the wheelchair and showing better or competitive smoothness.
  arXiv  Detail & Related papers  (2025-07-22T22:31:11Z)
• Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models [50.19518681574399]
  A central challenge in real-world assistive teleoperation is for the robot to infer a wide range of human intentions from user control inputs.<n>We introduce Casper, an assistive teleoperation system that leverages commonsense knowledge embedded in pre-trained visual language models.<n>We show that Casper improves task performance, reduces human cognitive load, and achieves higher user satisfaction than direct teleoperation and assistive teleoperation baselines.
  arXiv  Detail & Related papers  (2025-06-17T17:06:43Z)
• Socially-Aware Shared Control Navigation for Assistive Mobile Robots in the Built Environment [7.5624164942442045]
  This work introduces a novel socially-aware shared autonomy-based navigation system for assistive mobile robotic platforms. Our navigation framework comprises a Global Planner and a Local Planner. For the Local Planner, we propose a Socially-aware Shared Control-based Model Predictive Control with Dynamic Control Barrier Function.
  arXiv  Detail & Related papers  (2024-05-27T15:40:34Z)
• Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots [50.02055068660255]
  Navigating urban environments poses unique challenges for robots, necessitating innovative solutions for locomotion and navigation. This work introduces a fully integrated system comprising adaptive locomotion control, mobility-aware local navigation planning, and large-scale path planning within the city. Using model-free reinforcement learning (RL) techniques and privileged learning, we develop a versatile locomotion controller. Our controllers are integrated into a large-scale urban navigation system and validated by autonomous, kilometer-scale navigation missions conducted in Zurich, Switzerland, and Seville, Spain.
  arXiv  Detail & Related papers  (2024-05-03T00:29:20Z)
• Wheelchair Behavior Recognition for Visualizing Sidewalk Accessibility by Deep Neural Networks [19.671946716832203]
  This paper introduces our methodology to estimate sidewalk accessibilities from wheelchair behavior via a triaxial accelerometer in a smartphone installed under a wheelchair seat. Our method recognizes sidewalk accessibilities from environmental factors, e.g. gradient, curbs, and gaps. This paper developed and evaluated a prototype system that visualizes sidewalk accessibility information by extracting knowledge from wheelchair acceleration.
  arXiv  Detail & Related papers  (2021-01-11T06:41:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.