From SERPs to Agents: A Platform for Comparative Studies of Information Interaction

• URL: http://arxiv.org/abs/2601.09937v1
• Date: Wed, 14 Jan 2026 23:47:57 GMT
• Title: From SERPs to Agents: A Platform for Comparative Studies of Information Interaction
• Abstract summary: We present UXLab, an open-source system for web-based user studies.<n>Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs.<n>We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent.
• Score: 2.50369129460887
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.

Related papers

• Understanding Usage and Engagement in AI-Powered Scientific Research Tools: The Asta Interaction Dataset [47.98539809308384]
  We analyze the Asta Interaction dataset, a large-scale resource comprising over 200,000 user queries and interaction logs.<n>We characterize query patterns, engagement behaviors, and how usage evolves with experience.<n>We release the anonymized dataset and analysis with a new query taxonomy to inform future designs of real-world AI research assistants.
  arXiv  Detail & Related papers  (2026-02-26T18:40:28Z)
• From Agent-Only Social Networks to Autonomous Scientific Research: Lessons from OpenClaw and Moltbook, and the Architecture of ClawdLab and Beach.Science [0.0]
  OpenClaw and Moltbook produced a large-scale dataset of autonomous AI-to-AI interaction in January 2026.<n>This study conducts a multivocal literature review of that ecosystem and presents two complementary platforms for autonomous scientific research.
  arXiv  Detail & Related papers  (2026-02-23T13:10:01Z)
• FROAV: A Framework for RAG Observation and Agent Verification - Lowering the Barrier to LLM Agent Research [0.5729426778193398]
  We present FROAV, an open-source research platform that democratizes Large Language Models (LLMs) agent research.<n>FROAV implements a multi-stage Retrieval-Augmented Generation (RAG) pipeline and a rigorous "LLM-as-a-Judge" evaluation system.<n>Our framework integrates n8n for no-code workflow design, FastAPI for flexible backend logic, and Streamlit for human-in-the-loop interaction.
  arXiv  Detail & Related papers  (2026-01-12T13:02:32Z)
• Let the Barbarians In: How AI Can Accelerate Systems Performance Research [80.43506848683633]
  We term this iterative cycle of generation, evaluation, and refinement AI-Driven Research for Systems.<n>We demonstrate that ADRS-generated solutions can match or even outperform human state-of-the-art designs.
  arXiv  Detail & Related papers  (2025-12-16T18:51:23Z)
• SelfAI: Building a Self-Training AI System with LLM Agents [79.10991818561907]
  SelfAI is a general multi-agent platform that combines a User Agent for translating high-level research objectives into standardized experimental configurations.<n>An Experiment Manager orchestrates parallel, fault-tolerant training across heterogeneous hardware while maintaining a structured knowledge base for continuous feedback.<n>Across regression, computer vision, scientific computing, medical imaging, and drug discovery benchmarks, SelfAI consistently achieves strong performance and reduces redundant trials.
  arXiv  Detail & Related papers  (2025-11-29T09:18:39Z)
• LLM-based Multi-Agent Blackboard System for Information Discovery in Data Science [69.1690891731311]
  We propose a novel multi-agent communication paradigm inspired by the blackboard architecture for traditional AI models.<n>In this framework, a central agent posts requests to a shared blackboard, and autonomous subordinate agents respond based on their capabilities.<n>We evaluate our method on three benchmarks that require explicit data discovery.
  arXiv  Detail & Related papers  (2025-09-30T22:34:23Z)
• Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Training [67.895981259683]
  General AI Agents are increasingly recognized as foundational frameworks for the next generation of artificial intelligence.<n>Current agent systems are either closed-source or heavily reliant on a variety of paid APIs and proprietary tools.<n>We present Cognitive Kernel-Pro, a fully open-source and (to the maximum extent) free multi-module agent framework.
  arXiv  Detail & Related papers  (2025-08-01T08:11:31Z)
• UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents [40.22609543755458]
  Recent advances in Large Language Model-simulated Agent (LLM Agent) research inspired us to design UXAgent.<n>Our system features a Persona Generator module, an LLM Agent module, and a Universal Browser Connector module to automatically generate thousands of simulated users.
  arXiv  Detail & Related papers  (2025-04-13T02:34:22Z)
• UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design [33.901185088456614]
  Recent advances in Large Language Model-simulated Agent (LLM-Agent) research inspired us to design UXAgent.<n>Our system features an LLM-Agent module and a universal browser connector module so that UX researchers can automatically generate thousands of simulated users to test the target website.
  arXiv  Detail & Related papers  (2025-02-18T05:55:18Z)
• Integrated Benchmarking and Design for Reproducible and Accessible Evaluation of Robotic Agents [61.36681529571202]
  We describe a new concept for reproducible robotics research that integrates development and benchmarking. One of the central components of this setup is the Duckietown Autolab, a standardized setup that is itself relatively low-cost and reproducible. We validate the system by analyzing the repeatability of experiments conducted using the infrastructure and show that there is low variance across different robot hardware and across different remote labs.
  arXiv  Detail & Related papers  (2020-09-09T15:31:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.