Cognitive offloading and the speedup illusion in human-AI interaction
- URL: http://arxiv.org/abs/2605.23177v1
- Date: Fri, 22 May 2026 02:53:12 GMT
- Title: Cognitive offloading and the speedup illusion in human-AI interaction
- Abstract summary: Large language models (LLMs) have the potential to boost human productivity by speeding up task completion.<n>We conducted a large-scale behavioral study to characterize mismatches between expectations and reality.<n>We identify a speedup illusion where people have accurate forecasts of independent completion times but significantly underestimate AI-assisted times.
- Score: 39.088619511248986
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Large language models (LLMs) have the potential to boost human productivity by speeding up task completion -- provided users know when to offload cognitive work to them. But we do not know if users are well-calibrated in estimating these potential time savings. We conducted a preregistered large-scale behavioral study (N = 1237) to characterize mismatches between expectations and reality, with a focus on simple cognitive tasks. While actual completion times between independent completion and AI-assisted completion did not differ, participants predicted AI to be significantly faster. The same bias was not observed when imagining help from another human participant. We identify a speedup illusion where people have accurate forecasts of independent completion times but significantly underestimate AI-assisted times. Additionally, time and effort dissociate: participants reported lower subjective effort with AI despite equivalent completion times. This suggests that completion time itself is not sufficient to characterize efficiency gains.
Related papers
- The Boundaries of Automation: A Theory of Persistent Human Participation [107.84677954791773]
We argue that human participation may persist even with highly capable AI systems.<n>In some activities, the target is not fully specified in advance but instead emerges through the interaction itself.<n>This perspective has important implications for the limits of automation.
arXiv Detail & Related papers (2026-07-23T17:33:43Z) - Characterizing initial human-AI proof formalization workflows [66.06866890889131]
Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
arXiv Detail & Related papers (2026-06-02T22:58:19Z) - Offloading Score: Measuring AI Reliance Through Counterfactual Workflows [70.84727355516559]
We introduce offloading score, a measure of reliance that quantifies the fraction of cognitive effort offloaded to an AI tool.<n>We validate offloading score through intrinsic evaluations of metric validity, and a controlled user study.<n>We show that offloading score detects significantly higher reliance in time-constrained settings.
arXiv Detail & Related papers (2026-05-28T05:44:31Z) - The efficiency-gain illusion: People underestimate the rate of AI use and overestimate its benefits on simple tasks [39.088619511248986]
We investigate people's propensity to use AI for cognitively simple tasks and assess whether their reliance is well-calibrated.<n>We find that people frequently choose to use AI even when doing so is inefficient.<n>Our results shed light on the mechanisms and biases underlying people's choice of whether to use AI as well as the risk of an overreliance feedback loop.
arXiv Detail & Related papers (2026-05-21T16:28:20Z) - AI Assistance Reduces Persistence and Hurts Independent Performance [1.3667120179358196]
We provide evidence for two key consequences of AI assistance: reduced persistence and impairment of unassisted performance.<n>We find that although AI assistance improves performance in the short-term, people perform significantly worse without AI and are more likely to give up.<n>These results suggest the need for AI model development to prioritize long-term competence alongside immediate task completion.
arXiv Detail & Related papers (2026-04-06T14:43:48Z) - Efficiency Without Cognitive Change: Evidence from Human Interaction with Narrow AI Systems [0.0]
Short-term exposure to narrow AI tools enhances core cognitive abilities.<n>No significant pre-post differences emerged in standardized measures of problem solving or verbal comprehension.
arXiv Detail & Related papers (2025-10-28T18:55:44Z) - AI Agents as Universal Task Solvers [94.49762121230042]
We show that the optimal speed-up that a universal solver can achieve using past data is tightly related to their algorithmic information.<n>We argue that the key quantity to optimize when scaling reasoning models is time, whose critical role in learning has so far only been indirectly considered.
arXiv Detail & Related papers (2025-10-14T02:17:54Z) - How Performance Pressure Influences AI-Assisted Decision Making [52.997197698288936]
We show how pressure and explainable AI (XAI) techniques interact with AI advice-taking behavior.<n>Our results show complex interaction effects, with different combinations of pressure and XAI techniques either improving or worsening AI advice taking behavior.
arXiv Detail & Related papers (2024-10-21T22:39:52Z) - Comparing Zealous and Restrained AI Recommendations in a Real-World Human-AI Collaboration Task [11.040918613968854]
We argue that careful exploitation of the tradeoff between precision and recall can significantly improve team performance.
We analyze the performance of 78 professional annotators working with a) no AI assistance, b) a high-precision "restrained" AI, and c) a high-recall "zealous" AI in over 3,466 person-hours of annotation work.
arXiv Detail & Related papers (2024-10-06T23:19:19Z) - Can AI Mitigate Human Perceptual Biases? A Pilot Study [3.2997705040068253]
We present results from a pilot experiment to measure if machine recommendations can debias human biases in visualization tasks.
We specifically studied the pull-down'' effect, for the task of estimating the ensemble average of data points in line charts.
Our pilot study showed that participants were faster with AI assistance in ensemble tasks, compared to the baseline without AI assistance.
arXiv Detail & Related papers (2023-10-10T21:35:15Z) - Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement
Learning [54.636562516974884]
In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on.
In this work, we propose MEDAL++, a novel design for self-improving robotic systems.
The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
arXiv Detail & Related papers (2023-03-02T18:51:38Z) - Human Decision Makings on Curriculum Reinforcement Learning with
Difficulty Adjustment [52.07473934146584]
We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process.
Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications.
It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
arXiv Detail & Related papers (2022-08-04T23:53:51Z) - Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted
Decision-making [46.625616262738404]
We use knowledge from the field of cognitive science to account for cognitive biases in the human-AI collaborative decision-making setting.
We focus specifically on anchoring bias, a bias commonly encountered in human-AI collaboration.
arXiv Detail & Related papers (2020-10-15T22:25:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.