Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

• URL: http://arxiv.org/abs/2607.04727v1
• Date: Mon, 06 Jul 2026 06:58:43 GMT
• Title: Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards
• Abstract summary: We introduce Dashboard2Code, a novel task that requires a model to proactively explore an interactive dashboard, acquire and integrate feedback from its own interactions, and generate code that reproduces the target dashboard.<n>We present DashboardMimic, the first Plotly+Dash benchmark for Dashboard2Code, comprising 180 carefully designed and manually verified dashboard-code pairs spanning three difficulty levels and covering eight common real-world interaction patterns.<n>We propose an automated evaluation framework tailored to dashboards that combines code semantic analysis with dynamic interaction-based testing to assess visual and interaction consistency.
• Score: 50.38481199112112
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automatic data visualization generation has advanced rapidly with multi-modal large language models, yet existing efforts largely focus on static charts and overlook the interactive dashboards commonly used for real-world data exploration. We introduce Dashboard2Code, a novel task that requires a model to proactively explore an interactive dashboard, acquire and integrate feedback from its own interactions (e.g., clicking and filtering), and generate code that reproduces the target dashboard. To support comprehensive evaluation, we present DashboardMimic, the first Plotly+Dash benchmark for Dashboard2Code, comprising 180 carefully designed and manually verified dashboard-code pairs spanning three difficulty levels and covering eight common real-world interaction patterns. We further propose an automated evaluation framework tailored to dashboards that combines code semantic analysis with dynamic interaction-based testing to assess visual and interaction consistency, showing strong agreement with human judgments. Experiments across a range of open- and closed-source multi-modal models reveal that even the strongest systems struggle on high-complexity dashboards and that a substantial performance gap remains between open-source and closed-source models on the Dashboard2Code task.

Related papers

• DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generation [8.452268647068166]
  We introduce DashArena, to our knowledge the first benchmark for open-ended, task-grounded generation of interactive analytic dashboards.<n>DashArena requires each system to generate both a dashboard and a replayable interaction trajectory.<n>A browser replays the trajectory and turns the system's intended analytical workflow into reproducible visual and execution evidence.
  arXiv  Detail & Related papers  (2026-08-11T06:54:37Z)
• MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs [40.317798580235]
  Recent benchmarks for VLMs largely assess single- or limited-view perception, leaving untested the core cognitive ability to integrate observations across viewpoints into a coherent, world-centric (allocentric) 3D mental model.<n>We introduce MultiView-Bench, a diagnostic benchmark expressly designed to evaluate multi-view integration for holistic 3D scene comprehension.<n>We propose ViewNavigator, a multi-agent framework that actively selects informative viewpoints, perceives, and fuses multi-view evidence, improving diverse base models on MultiView-Bench even under a strict budget-matched comparison.
  arXiv  Detail & Related papers  (2026-07-09T22:22:42Z)
• WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation [56.5415838759151]
  WBench is a comprehensive benchmark for evaluation of interactive world models.<n>It covers video quality, setting adherence, interaction adherence, consistency, and physics compliance.<n>It contains 289 test cases and 1,058 interaction turns, covering diverse scenes, styles, subjects, and both first- and third-person perspectives.
  arXiv  Detail & Related papers  (2026-05-25T14:01:31Z)
• NL2Dashboard: A Lightweight and Controllable Framework for Generating Dashboards with LLMs [38.148675833251325]
  We propose NL2Dashboard, a lightweight framework for dashboard generation.<n>We introduce a structured intermediate representation (IR) that encapsulates the dashboard's content, layout, and visual elements.<n>Building upon this framework, we develop a multi-agent system in which the IR-driven algorithm is instantiated as a suite of tools.
  arXiv  Detail & Related papers  (2026-01-04T13:26:04Z)
• Disentanglement Beyond Static vs. Dynamic: A Benchmark and Evaluation Framework for Multi-Factor Sequential Representations [14.972702558607557]
  We introduce the first standardized benchmark for evaluating multi-factor sequential disentanglement across six diverse datasets.<n>We propose a post-hoc Latent Exploration Stage to automatically align latent dimensions with semantic factors, and introduce a Koopman-inspired model that achieves state-of-the-art results.<n>Our code is available on GitHub, and the datasets and trained models are available on Hugging Face.
  arXiv  Detail & Related papers  (2025-10-20T08:58:23Z)
• DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboards [44.69783955774917]
  DashboardQA is a benchmark designed to assess how vision-language GUI agents comprehend and interact with real-world dashboards.<n>It includes 112 interactive dashboards from Tableau Public and 405 question-answer pairs with interactive dashboards spanning five categories: multiple-choice, factoid, hypothetical, multi-dashboard, and conversational.<n>Our findings indicate that interactive dashboard reasoning is a challenging task overall for all the VLMs evaluated.
  arXiv  Detail & Related papers  (2025-08-24T15:11:44Z)
• ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation [51.297873393639456]
  ArtifactsBench is a framework for automated visual code generation evaluation.<n>Our framework renders each generated artifact and captures its dynamic behavior through temporal screenshots.<n>We construct a new benchmark of 1,825 diverse tasks and evaluate over 30 leading Large Language Models.
  arXiv  Detail & Related papers  (2025-07-07T12:53:00Z)
• DeepInteraction++: Multi-Modality Interaction for Autonomous Driving [80.8837864849534]
  We introduce a novel modality interaction strategy that allows individual per-modality representations to be learned and maintained throughout.<n>DeepInteraction++ is a multi-modal interaction framework characterized by a multi-modal representational interaction encoder and a multi-modal predictive interaction decoder.<n>Experiments demonstrate the superior performance of the proposed framework on both 3D object detection and end-to-end autonomous driving tasks.
  arXiv  Detail & Related papers  (2024-08-09T14:04:21Z)
• Towards Model-Driven Dashboard Generation for Systems-of-Systems [52.251635013691256]
  This paper describes a model-driven technology-agnostic approach that can automatically transform a simple list of dashboard models into a dashboard model. Dashboard customization can be efficiently obtained by solely modifying the abstract model representation.
  arXiv  Detail & Related papers  (2024-02-23T10:55:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.