Proximal State Nudging: Reducing Skill Atrophy from AI Assistance

• URL: http://arxiv.org/abs/2605.20355v1
• Date: Tue, 19 May 2026 18:10:46 GMT
• Title: Proximal State Nudging: Reducing Skill Atrophy from AI Assistance
• Abstract summary: Skill atrophy, the gradual decline of human capability under AI assistance, poses a safety risk in shared-control of semi-autonomous systems.<n>We propose Proximal State Nudging (PSN), a shared autonomy algorithm that jointly optimize for skill development and task performance by nudging users toward states estimated to be most learnable.<n>PSN produces up to 7x larger gains in unassisted skill than standard blended shared autonomy, while incurring 50% fewer collisions than unassisted self-practice.
• Score: 30.739971556876128
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Skill atrophy, the gradual decline of human capability under AI assistance, poses a safety risk in shared-control of semi-autonomous systems, where operators may be unable to distinguish their own inputs from autonomous corrections. We propose Proximal State Nudging (PSN), a shared autonomy algorithm that jointly optimizes for skill development and task performance by nudging users toward states estimated to be most learnable. We first show that PSN outperforms existing shared autonomy baselines in balancing student improvement in unassisted reward with overall shared performance, using simulated students in the classic LunarLander environment. We then present, to the best of our knowledge, the first human subject studies of a planner incorporating learning-compatible shared autonomy: across two driving tasks in the CARLA simulator (High Performance Racing and Parallel Parking, n = 60), PSN produces up to 7x larger gains in unassisted skill than standard blended shared autonomy, while incurring 50% fewer collisions than unassisted self-practice.

Related papers

• AI Coaching for Accelerating Human Skill Development with Reinforcement Learning [13.06179791485747]
  AI copilots can substantially boost human performance through shared control, but excessive assistance can induce over-reliance and skill atrophy.<n>This paper studies how an embodied AI agent can act as a coach that accelerates human motor-skill development.
  arXiv  Detail & Related papers  (2026-06-24T03:05:22Z)
• ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving [63.980630608984605]
  This paper presents ADV-0, a closed-loop min-max optimization framework that treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game.<n>To make this tractable, we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum and offering an algorithm-agnostic solution to the game.<n> Experiments indicate that it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.
  arXiv  Detail & Related papers  (2026-03-16T12:58:31Z)
• CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving [8.578450183245037]
  CoIRL-AD introduces a competition-based mechanism that facilitates knowledge exchange while preventing conflicts.<n> Experiments on the nuScenes dataset show an 18% reduction in collision rate to baselines, along with stronger generalization and improved performance on long-tail scenarios.
  arXiv  Detail & Related papers  (2025-10-14T14:21:52Z)
• Shared Autonomy for Proximal Teaching [31.70561682131625]
  Motor skill learning often requires experienced professionals who can provide personalized instruction.<n>Z-COACH is a method for using shared autonomy to provide personalized instruction targeting interpretable task sub-skills.<n>In a user study we show that Z-COACH helps identify which skills each student should first practice, leading to an overall improvement in driving time, behavior, and smoothness.
  arXiv  Detail & Related papers  (2025-02-27T09:14:17Z)
• Generative Diffusion-based Contract Design for Efficient AI Twins Migration in Vehicular Embodied AI Networks [55.15079732226397]
  Embodied AI is a rapidly advancing field that bridges the gap between cyberspace and physical space. In VEANET, embodied AI twins act as in-vehicle AI assistants to perform diverse tasks supporting autonomous driving.
  arXiv  Detail & Related papers  (2024-10-02T02:20:42Z)
• Work-in-Progress: Crash Course: Can (Under Attack) Autonomous Driving Beat Human Drivers? [60.51287814584477]
  This paper evaluates the inherent risks in autonomous driving by examining the current landscape of AVs. We develop specific claims highlighting the delicate balance between the advantages of AVs and potential security challenges in real-world scenarios.
  arXiv  Detail & Related papers  (2024-05-14T09:42:21Z)
• LOQA: Learning with Opponent Q-Learning Awareness [1.1666234644810896]
  We introduce Learning with Opponent Q-Learning Awareness (LOQA), a decentralized reinforcement learning algorithm tailored to optimize an agent's individual utility. LOQA achieves state-of-the-art performance in benchmark scenarios such as the Iterated Prisoner's Dilemma and the Coin Game.
  arXiv  Detail & Related papers  (2024-05-02T06:33:01Z)
• SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation [54.97931304488993]
  Self-improving robots that interact and improve with experience are key to the real-world deployment of robotic systems. We propose an online learning method, SELFI, that leverages online robot experience to rapidly fine-tune pre-trained control policies. We report improvements in terms of collision avoidance, as well as more socially compliant behavior, measured by a human user study.
  arXiv  Detail & Related papers  (2024-03-01T21:27:03Z)
• Model-Based Reinforcement Learning with Isolated Imaginations [61.67183143982074]
  We propose Iso-Dream++, a model-based reinforcement learning approach. We perform policy optimization based on the decoupled latent imaginations. This enables long-horizon visuomotor control tasks to benefit from isolating mixed dynamics sources in the wild.
  arXiv  Detail & Related papers  (2023-03-27T02:55:56Z)
• Persistent Reinforcement Learning via Subgoal Curricula [114.83989499740193]
  Value-accelerated Persistent Reinforcement Learning (VaPRL) generates a curriculum of initial states. VaPRL reduces the interventions required by three orders of magnitude compared to episodic reinforcement learning.
  arXiv  Detail & Related papers  (2021-07-27T16:39:45Z)
• Learning to Optimize Autonomy in Competence-Aware Systems [32.3596917475882]
  We propose an introspective model of autonomy that is learned and updated online through experience. We define a competence-aware system (CAS) that explicitly models its own proficiency at different levels of autonomy and the available human feedback. We analyze the convergence properties of CAS and provide experimental results for robot delivery and autonomous driving domains.
  arXiv  Detail & Related papers  (2020-03-17T14:31:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.