I-WebGenBench : Evaluating Interactivity in LLM-Generated Scientific Web Applications

• URL: http://arxiv.org/abs/2606.00750v1
• Date: Sat, 30 May 2026 14:34:02 GMT
• Title: I-WebGenBench : Evaluating Interactivity in LLM-Generated Scientific Web Applications
• Abstract summary: We propose a Paper-to-Interactive-System Agent that converts research papers into executable interactive web systems.<n>Given a PDF paper, the agent performs end-to-end processing without human intervention.<n>Experiments show that PaperVoyager significantly improves the quality of generated interactive systems.
• Score: 33.31056974240273
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in visual language models have enabled autonomous agents for complex reasoning, tool use, and document understanding. However, existing document agents mainly transform papers into static artifacts such as summaries, webpages, or slides, which are insufficient for technical papers involving dynamic mechanisms and state transitions. In this work, we propose a Paper-to-Interactive-System Agent that converts research papers into executable interactive web systems. Given a PDF paper, the agent performs end-to-end processing without human intervention, including paper understanding, system modeling, and interactive webpage synthesis, enabling users to manipulate inputs and observe dynamic behaviors. To evaluate this task, we introduce a benchmark of 19 research papers paired with expert-built interactive systems as ground truth. We further propose PaperVoyager, a structured generation framework that explicitly models mechanisms and interaction logic during synthesis. Experiments show that PaperVoyager significantly improves the quality of generated interactive systems, offering a new paradigm for interactive scientific paper understanding.

Related papers

• DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations [106.74348504930124]
  We introduce DocOps, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy.<n>Based on DocOps, we systematically evaluate representative closed- and open-source models across various agentic harnesses.<n>Our work exposes the capability boundaries of agents in maintaining global document consistency, shedding light on the future design of robust, non-destructive agents.
  arXiv  Detail & Related papers  (2026-07-22T07:52:59Z)
• DocOS: Towards Proactive Document-Guided Actions in GUI Agents [54.27655693145045]
  textbfDocOS is a benchmark designed to assess document-guided problem solving in fully interactive environments.<n>Experiments reveal that agents struggle to reliably locate relevant information during proactive search and frequently fail to faithfully ground retrieved instructions into precise actions.
  arXiv  Detail & Related papers  (2026-05-18T08:36:04Z)
• ViviDoc: Generating Interactive Documents through Human-Agent Collaboration [6.761074932523358]
  Interactive documents help readers engage with complex ideas through dynamic visualization, interactive animations, and exploratory interfaces.<n>Recent Large Language Model (LLM)-based agents can automate content creation, but directly applying them to interactive document generation often produces outputs that are difficult to control.<n>We present ViviDoc, to the best of our knowledge the first work to systematically address interactive document generation.
  arXiv  Detail & Related papers  (2026-03-30T03:29:32Z)
• PaperVoyager : Building Interactive Web with Visual Language Models [35.73710997735284]
  We propose a Paper-to-Interactive-System Agent that converts research papers into executable interactive web systems.<n>Given a PDF paper, the agent performs end-to-end processing without human intervention.<n>Experiments show that PaperVoyager significantly improves the quality of generated interactive systems.
  arXiv  Detail & Related papers  (2026-03-24T09:42:27Z)
• Paper2Web: Let's Make Your Paper Alive! [51.75896846964824]
  We introduce Paper2Web, a benchmark dataset and framework for assessing academic webpage generation.<n>We present PWAgent, an autonomous pipeline that converts scientific papers into interactive and multimedia-rich academic homepages.
  arXiv  Detail & Related papers  (2025-10-17T17:35:58Z)
• Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents [24.762629506054125]
  We introduce Paper2Agent, an automated framework that converts research papers into AI agents.<n>Paper2Agent transforms research output from passive artifacts into active systems that can accelerate downstream use, adoption, and discovery.
  arXiv  Detail & Related papers  (2025-09-08T17:28:42Z)
• Agentic Web: Weaving the Next Web with AI Agents [109.13815627467514]
  The emergence of AI agents powered by large language models (LLMs) marks a pivotal shift toward the Agentic Web.<n>In this paradigm, agents interact directly with one another to plan, coordinate, and execute complex tasks on behalf of users.<n>We present a structured framework for understanding and building the Agentic Web.
  arXiv  Detail & Related papers  (2025-07-28T17:58:12Z)
• Signifiers as a First-class Abstraction in Hypermedia Multi-Agent Systems [0.6595290783361959]
  We build on concepts and methods from Affordance Theory and Human-Computer Interaction to introduce signifiers as a first-class abstraction in Web-based Multi-Agent Systems. We define a formal model for the contextual exposure of signifiers in hypermedia environments that aims to drive affordance exploitation.
  arXiv  Detail & Related papers  (2023-02-14T10:54:46Z)
• VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction [50.986371459817256]
  We propose a novel textitVirtual InteRacTion mechanism, termed as VIRT, to enable full and deep interaction modeling in representation-based models. VIRT asks representation-based encoders to conduct virtual interactions to mimic the behaviors as interaction-based models do.
  arXiv  Detail & Related papers  (2021-12-08T09:49:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.