PersonaTrail: Benchmarking Personalized Web Agents through Browsing Trails

• URL: http://arxiv.org/abs/2607.20482v1
• Date: Sat, 30 May 2026 13:27:55 GMT
• Title: PersonaTrail: Benchmarking Personalized Web Agents through Browsing Trails
• Abstract summary: PersonaTrail is a benchmark for personalized web agents operating in a managed open web environment.<n>PACMem is a framework that decomposes raw browsing histories into two types of structured memory.<n>Experiments show that PACMem consistently outperforms existing memory-based baselines on both tasks.
• Score: 42.825314356642956
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in large language models have enabled web agents to autonomously execute complex tasks. In practice, users frequently provide underspecified instructions, requiring agents to infer the missing context from their raw browsing histories. Existing benchmarks fail to capture this form of personalization, as they either restrict tasks to fully explicit prompts or abstract web interaction history into simplified forms. To bridge this gap, we introduce PersonaTrail, a benchmark for personalized web agents operating in a managed open web environment. By leveraging realistic browsing trajectories as user history, PersonaTrail evaluates an agent's ability to infer user preferences and recall information from past browsing sessions. We further propose Preference-Aware Contextual Memory (PACMem), a framework that decomposes raw browsing histories into two types of structured memory: factual memories that summarize individual sessions and preference memories that distill recurring behavioral patterns. At inference time, the agent retrieves the most relevant entries from these memories to guide personalized navigation. Extensive experiments show that PACMem consistently outperforms existing memory-based baselines on both tasks.

Related papers

• APeB: Benchmarking Personalization Ability of Large Language Model Agents [17.77241512443464]
  LLM-powered agents struggle with personalization when users issue raw, underspecified queries.<n>Existing benchmarks rarely test this capability, as they often rely on user-refined queries or simplified histories.<n>We introduce personalized product search (PPS), a testbed for agentic personalization under raw queries and diverse histories.
  arXiv  Detail & Related papers  (2026-07-03T10:03:35Z)
• DocOS: Towards Proactive Document-Guided Actions in GUI Agents [54.27655693145045]
  textbfDocOS is a benchmark designed to assess document-guided problem solving in fully interactive environments.<n>Experiments reveal that agents struggle to reliably locate relevant information during proactive search and frequently fail to faithfully ground retrieved instructions into precise actions.
  arXiv  Detail & Related papers  (2026-05-18T08:36:04Z)
• PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments [72.02445514666428]
  We introduce PERMA, a benchmark designed to evaluate persona consistency over time beyond static preference recall.<n>PerMA consists of temporally ordered interaction events spanning multiple sessions and domains, with preference-related queries inserted over time.<n> Experiments demonstrate that by linking related interactions, advanced memory systems can extract more precise preferences and reduce token consumption.
  arXiv  Detail & Related papers  (2026-03-24T14:04:11Z)
• Persona2Web: Benchmarking Personalized Web Agents for Contextual Reasoning with User History [8.085230376705887]
  Persona2Web is the first benchmark for evaluating personalized web agents on the real open web.<n>It consists of: (1) user histories that reveal preferences implicitly over long time spans, (2) ambiguous queries that require agents to infer implicit user preferences, and (3) a reasoning-aware evaluation framework that enables fine-grained assessment of personalization.
  arXiv  Detail & Related papers  (2026-02-19T01:54:26Z)
• Learning Personalized Agents from Human Feedback [36.47803872623135]
  We introduce Personalized Agents from Human Feedback (PAHF), a framework for continual personalization.<n>PAHF learns online from live interaction using explicit per-user memory.<n> benchmarks quantify an agent's ability to learn initial preferences from scratch and subsequently adapt to persona shifts.
  arXiv  Detail & Related papers  (2026-02-18T04:18:47Z)
• OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents [55.27061195244624]
  We formalize over-personalization into three types: Irrelevance, Repetition, and Sycophancy.<n>Agents tend to retrieve and over-attend to user memories even when unnecessary.<n>Our work takes an initial step toward more controllable and appropriate personalization in memory-augmented dialogue systems.
  arXiv  Detail & Related papers  (2026-01-20T08:27:13Z)
• MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation [12.075641773020152]
  We propose a framework that weaves the user's entire textual history into a hierarchical memory to power deeply personalized generation.<n>MemWeaver builds two complementary memory components that both integrate temporal and semantic information.
  arXiv  Detail & Related papers  (2025-10-09T02:47:21Z)
• PersonaAgent: When Large Language Model Agents Meet Personalization at Test Time [87.99027488664282]
  PersonaAgent is a framework designed to address versatile personalization tasks.<n>It integrates a personalized memory module and a personalized action module.<n>Test-time user-preference alignment strategy ensures real-time user preference alignment.
  arXiv  Detail & Related papers  (2025-06-06T17:29:49Z)
• Large Language Models Empowered Personalized Web Agents [54.944908837494374]
  Web agents have evolved from traditional agents to Large Language Models (LLMs)-based Web agents.<n>We first formulate the task of LLM-empowered personalized Web agents, which integrate personalized data and user instructions.<n>We propose a Personalized User Memory-enhanced Alignment (PUMA) framework to adapt LLMs to the personalized Web agent task.
  arXiv  Detail & Related papers  (2024-10-22T17:54:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.