Turing Test on Screen: A Benchmark for Mobile GUI Agent Humanization
- URL: http://arxiv.org/abs/2604.09574v1
- Date: Tue, 24 Feb 2026 04:29:42 GMT
- Title: Turing Test on Screen: A Benchmark for Mobile GUI Agent Humanization
- Abstract summary: We argue that for agents to survive in human-centric ecosystems, they must evolve Humanization capabilities.<n>This work shifts the paradigm from whether an agent can perform a task to how it performs it within a human-centric ecosystem.
- Score: 40.016387553294685
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The rise of autonomous GUI agents has triggered adversarial countermeasures from digital platforms, yet existing research prioritizes utility and robustness over the critical dimension of anti-detection. We argue that for agents to survive in human-centric ecosystems, they must evolve Humanization capabilities. We introduce the ``Turing Test on Screen,'' formally modeling the interaction as a MinMax optimization problem between a detector and an agent aiming to minimize behavioral divergence. We then collect a new high-fidelity dataset of mobile touch dynamics, and conduct our analysis that vanilla LMM-based agents are easily detectable due to unnatural kinematics. Consequently, we establish the Agent Humanization Benchmark (AHB) and detection metrics to quantify the trade-off between imitability and utility. Finally, we propose methods ranging from heuristic noise to data-driven behavioral matching, demonstrating that agents can achieve high imitability theoretically and empirically without sacrificing performance. This work shifts the paradigm from whether an agent can perform a task to how it performs it within a human-centric ecosystem, laying the groundwork for seamless coexistence in adversarial digital environments.
Related papers
- The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development? [80.24951682268332]
We introduce the Meta-Agent Challenge (MAC), an evaluation framework designed to test the capacity of frontier models for autonomous agent development.<n>To ensure evaluation integrity, this framework is secured by multi-layer defenses against reward hacking.<n>We demonstrate that meta-agents rarely match human-engineered baseline policies, and the few that do are dominated by proprietary frontier models.
arXiv Detail & Related papers (2026-06-03T04:58:17Z) - Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents [12.703661629160571]
We present Agentic CLEAR, an automatic, dynamic, and easy-to-use evaluation framework.<n>It produces textual insights into the agent behavior on three levels of granularity: system, trace, and node.<n>Agentic CLEAR operates above the observability layer, enabling seamless integration and featuring an intuitive UI.
arXiv Detail & Related papers (2026-05-21T15:26:02Z) - Towards a Virtual Neuroscientist: Autonomous Neuroimaging Analysis via Multi-Agent Collaboration [53.772014300855375]
We introduce NIAgent, a multi-agent system for autonomous end-to-end neuroimaging analysis.<n>Unlike conventional flat tool-calling agents, NIAgent adopts a code-centric execution paradigm.<n>We propose a hierarchical verification framework for autonomous quality control, integrating cohort-level metric screening with agentic visual inspection.
arXiv Detail & Related papers (2026-05-10T06:30:19Z) - SensingAgents: A Multi-Agent Collaborative Framework for Robust IMU Activity Recognition [14.031124312439784]
We propose SensingAgents, a novel multi-agent system for robust IMU activity recognition.<n>Our work highlights the potential of multi-agent collaborative reasoning for advancing the robustness and interpretability of ubiquitous sensing systems.
arXiv Detail & Related papers (2026-05-06T07:55:46Z) - Learning to Retrieve from Agent Trajectories [72.8923565916533]
We argue that retrieval models for agentic search should be trained directly from agent interaction data.<n>We introduce learning to retrieve from agent trajectories as a new training paradigm, where supervision is derived from multi-step agent interactions.<n>Our results highlight agent trajectories as a practical and scalable supervision source, pointing to a promising direction for retrieval in the era of agentic search.
arXiv Detail & Related papers (2026-03-30T17:59:02Z) - Human-AI Collaborative Autonomous Experimentation With Proxy Modeling for Comparative Observation [1.05460929917527]
We present a proxy-modelled Bayesian optimization (px-BO) via on-the-fly teaming between human and AI agents.<n>We find that our approach provided better control of the domain experts for improved search over traditional data-driven exploration.
arXiv Detail & Related papers (2026-03-13T03:45:24Z) - Detecting Perspective Shifts in Multi-agent Systems [0.9095465010382021]
This paper introduces the Temporal Data Kernel Perspective Space (TDKPS), which jointly embeds agents across time.<n>We propose several novel hypothesis tests for detecting behavioral change at the agent- and group-level in black-box multi-agent systems.<n>As far as we are aware, TDKPS is the first principled framework for monitoring behavioral dynamics in black-box multi-agent systems.
arXiv Detail & Related papers (2025-12-04T17:24:56Z) - SelfAI: Building a Self-Training AI System with LLM Agents [79.10991818561907]
SelfAI is a general multi-agent platform that combines a User Agent for translating high-level research objectives into standardized experimental configurations.<n>An Experiment Manager orchestrates parallel, fault-tolerant training across heterogeneous hardware while maintaining a structured knowledge base for continuous feedback.<n>Across regression, computer vision, scientific computing, medical imaging, and drug discovery benchmarks, SelfAI consistently achieves strong performance and reduces redundant trials.
arXiv Detail & Related papers (2025-11-29T09:18:39Z) - An Active Inference Model of Mouse Point-and-Click Behaviour [6.861919837733669]
We present an AIF agent with continuous state, action, and observation spaces, performing one-dimensional mouse pointing and clicking.<n>We use a simple underlying dynamic system to model the mouse cursor dynamics with realistic delay.<n>Results show that the agent creates plausible pointing movements and clicks when the cursor is over the target, with similar end-point variance to human users.
arXiv Detail & Related papers (2025-10-16T12:19:38Z) - The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation [0.16921396880325779]
We introduce a novel evaluation framework that uses multi-agent debate as a controlled "social laboratory"<n>We show that assigned personas induce stable, measurable psychometric profiles, particularly in cognitive effort.<n>This work provides a blueprint for a new class of dynamic, psychometrically grounded evaluation protocols.
arXiv Detail & Related papers (2025-10-01T07:10:28Z) - Agent4FaceForgery: Multi-Agent LLM Framework for Realistic Face Forgery Detection [108.5042835056188]
This work introduces Agent4FaceForgery to address two fundamental problems.<n>How to capture the diverse intents and iterative processes of human forgery creation.<n>How to model the complex, often adversarial, text-image interactions that accompany forgeries in social media.
arXiv Detail & Related papers (2025-09-16T01:05:01Z) - RoHOI: Robustness Benchmark for Human-Object Interaction Detection [84.78366452133514]
Human-Object Interaction (HOI) detection is crucial for robot-human assistance, enabling context-aware support.<n>We introduce the first benchmark for HOI detection, evaluating model resilience under diverse challenges.<n>Our benchmark, RoHOI, includes 20 corruption types based on the HICO-DET and V-COCO datasets and a new robustness-focused metric.
arXiv Detail & Related papers (2025-07-12T01:58:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.