SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualization

• URL: http://arxiv.org/abs/2606.05525v1
• Date: Thu, 04 Jun 2026 00:14:25 GMT
• Title: SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualization
• Abstract summary: We present SciVisAgentSkills, a collection of reusable agent skills that augment coding agents for scientific data analysis and visualization.<n>We evaluate these skills on Codex and Claude Code using SciVisAgentBench, a benchmark of 108 expert-designed multi-step tasks.
• Score: 8.855427243372116
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in agentic visualization have enabled the translation of natural language into executable scientific visualization (SciVis) workflows. While general-purpose coding agents show strong capabilities, they often lack the tool-specific expertise required for SciVis tasks. In this work, we present SciVisAgentSkills, a collection of reusable agent skills that augment coding agents for scientific data analysis and visualization by encoding environment assumptions, tool usage patterns, and domain heuristics across scientific tools such as ParaView, napari, VMD, and TTK. We evaluate these skills on Codex and Claude Code using SciVisAgentBench, a benchmark of 108 expert-designed multi-step tasks. Results show that agent skills improve mean task scores across the evaluated suites, with token-efficiency benefits that depend on the agent harness and tool setting. These findings highlight the importance of structured procedural knowledge for enabling reliable, long-horizon SciVis workflows, while also showing that skills should be studied alongside the execution harness that loads and applies them. The skills are available at https://github.com/KuangshiAi/SciVisAgentSkills.

Related papers

• SciToolAgent-Evo: An Ontology-Aware Self-Evolving Agent for Open-World Scientific Tool Acquisition [53.36281538053445]
  We propose SciToolAgent-Evo, an ontology-aware self-evolving agent for open-world scientific tool acquisition.<n> Driven by an evolving memory of skills, experiences, and an ontologized tool graph, it distills generalizable knowledge from contrastive trajectories during accumulation.<n>Once a novel tool is acquired, its scientific knowledge is completed online for seamless integration into the known graph.
  arXiv  Detail & Related papers  (2026-07-30T08:47:11Z)
• ToFu: A White-Box, Token-Efficient Agent Harness for Researchers [73.72929185946842]
  ToFu is an agentic harness for researchers that reads your files, edits files, runs commands, and integrates with your development tools.<n>As a research assistant, it supports practical research with superior token efficiency, lower cost, and multilingual capability.<n>As a research object, ToFu provides a white-box agentic harness that allows researchers to inspect, modify, and evaluate its orchestration logic, tool-use behavior, and harness design.
  arXiv  Detail & Related papers  (2026-07-13T11:26:06Z)
• A Framework for Evaluating Agentic Skills at Scale [0.4509560087514856]
  Agent skills are structured, reusable knowledge artifacts that augment agent capabilities.<n>No reusable methodology exists for evaluating an individual skill.<n>We present an evaluation framework that lets a skill author construct realistic tasks.
  arXiv  Detail & Related papers  (2026-06-16T11:46:56Z)
• SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs [70.1970574147839]
  We propose SKILLGRAPH, a framework that represents reusable skills as nodes in a directed graph.<n>SKILLGRAPH retrieves not just individual skills, but an ordered skill subgraph that can guide multi-step decision making.<n> Experiments show that SKILLGRAPH achieves state-of-the-art performance against memory-augmented RL methods.
  arXiv  Detail & Related papers  (2026-05-12T12:21:49Z)
• Exploring Interaction Paradigms for LLM Agents in Scientific Visualization [7.22431217973039]
  This paper examines how different types of large language model (LLM) agents perform on scientific visualization (SciVis) tasks.<n>We compare three primary interaction paradigms, including domain-specific agents with structured tool use, computer-use agents, and general-purpose coding agents.
  arXiv  Detail & Related papers  (2026-04-30T15:22:28Z)
• SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources [5.7282243774488295]
  We present SkillFoundry, a self-evolving framework that converts resources into validated agent skills.<n>We show that SkillFoundry produces a substantially novel and internally valid skill library.<n>We also show that SkillFoundry can design new task-specific skills on demand for concrete scientific objectives.
  arXiv  Detail & Related papers  (2026-04-05T05:02:18Z)
• SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents [12.966844873205048]
  We present SciVisAgentBench, a principled benchmark for evaluating scientific data analysis and visualization agents.<n>Our benchmark is grounded in a structured taxonomy spanning four dimensions: application domain, data type, complexity level, and visualization operation.<n>It currently comprises 108 expert-crafted cases covering diverse SciVis scenarios.
  arXiv  Detail & Related papers  (2026-03-31T01:41:28Z)
• OSExpert: Computer-Use Agents Learning Professional Skills via Exploration [55.660669638732024]
  General-purpose computer-use agents are far less helpful than human experts.<n>We introduce a depth-first search algorithm to explore and verify an environment's unit functions.<n>The agent then exploits compositionality between unit skills to self-construct a curriculum for composite tasks.
  arXiv  Detail & Related papers  (2026-03-09T05:27:56Z)
• SkillCraft: Can LLM Agents Learn to Use Tools Skillfully? [67.69996753743129]
  We introduce SkillCraft, a benchmark explicitly stress-test agent ability to form and reuse higher-level tool compositions.<n> SkillCraft features realistic, highly compositional tool-use scenarios with difficulty scaled along both quantitative and structural dimensions.<n>We propose a lightweight evaluation protocol that enables agents to auto-compose atomic tools into executable Skills, cache and reuse them inside and across tasks.
  arXiv  Detail & Related papers  (2026-02-28T15:44:31Z)
• SoK: Agentic Skills -- Beyond Tool Use in LLM Agents [6.356997609995175]
  Agentic systems increasingly rely on reusable procedural capabilities, textita.k.a., agentic skills, to execute long-horizon reliably.<n>This paper maps the skill layer across the full lifecycle (discovery, practice, distillation, storage, composition, evaluation, and update)<n>We analyze the security and governance implications of skill-based agents, covering supply-chain risks, prompt injection via skill payloads, and trust-tiered execution.
  arXiv  Detail & Related papers  (2026-02-24T13:11:38Z)
• SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integration [39.43814195462455]
  SciToolAgent automates hundreds of scientific tools across biology, chemistry, and materials science.<n>The agent also incorporates a comprehensive safety-checking module to ensure responsible and ethical tool usage.
  arXiv  Detail & Related papers  (2025-07-27T13:55:35Z)
• Symbolic Learning Enables Self-Evolving Agents [55.625275970720374]
  We introduce agent symbolic learning, a systematic framework that enables language agents to optimize themselves on their own. Agent symbolic learning is designed to optimize the symbolic network within language agents by mimicking two fundamental algorithms in connectionist learning. We conduct proof-of-concept experiments on both standard benchmarks and complex real-world tasks.
  arXiv  Detail & Related papers  (2024-06-26T17:59:18Z)
• Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding [52.723297744257536]
  Pre-trained language models (LMs) have shown effectiveness in scientific literature understanding tasks. We propose a multi-task contrastive learning framework, SciMult, to facilitate common knowledge sharing across different literature understanding tasks.
  arXiv  Detail & Related papers  (2023-05-23T16:47:22Z)
• Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge [59.87823082513752]
  This paper investigates the injection of knowledge from general-purpose knowledge bases (KBs) into vision-and-language transformers. We empirically study the relevance of various KBs to multiple tasks and benchmarks. The technique is model-agnostic and can expand the applicability of any vision-and-language transformer with minimal computational overhead.
  arXiv  Detail & Related papers  (2021-01-15T08:37:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.