Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
- URL: http://arxiv.org/abs/2608.14667v1
- Date: Sun, 02 Aug 2026 05:27:36 GMT
- Title: Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
- Abstract summary: We argue that studying AI Scientists as human-agent systems (HAS) is both underexplored and undervalued.<n>We show that scientists and agents can augment each other's capabilities.
- Score: 14.373499943057668
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Large language model-based agents are increasingly deployed as collaborators in scientific discovery yet most current work focuses on the autonomous capabilities of "AI Scientists". We argue that this overlooks the social aspects of scientific teamwork, and that studying AI Scientists as human-agent systems (HAS)--where the unit of analysis is the human-agent pair--is both underexplored and undervalued. We establish these points through literature and empirical analysis, and highlight recent incidences and studies which show that deploying agents in science without accounting for human-agent dynamics introduces near-term risks, including reduced diversity of scientific inquiry. Through analysis of real-world case studies, we show that scientists and agents can augment each other's capabilities. We call for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scientific discovery.
Related papers
- AI Scientist Mission Control (AIMC): Visual Analytics for Human Oversight of Autonomous Scientific Discovery [12.1714185601677]
We present AIMC, a visual analytics framework for human oversight of autonomous scientific discovery.<n>We demonstrate the framework through a case study of the papers generated by an autonomous AI Scientist (FARS)<n>Our analysis reveals recurring methodological weaknesses, evolving research themes, domain-specific differences in quality, and a small set of highly novel papers.
arXiv Detail & Related papers (2026-08-10T15:46:03Z) - Benchmarking AI Agents for Addressing Scientific Challenges Across Scales [118.2204632627895]
SciAgentArena is a systematic benchmark for evaluating AI agents in real-world scientific research scenarios.<n>It comprises approximately 200 tasks with stepwise verification and an interactive, agent-agnostic environment for assessing diverse AI agents.<n>We find that current agents can contribute effectively to well-specified data-analysis, particularly when the task structure and evaluation criteria are clear.
arXiv Detail & Related papers (2026-06-10T22:55:30Z) - OmniScientist: Toward a Co-evolving Ecosystem of Human and AI Scientists [47.41269933143946]
We introduce OmniScientist, a framework that encodes the underlying mechanisms of human research into the AI scientific workflow.<n> OmniScientist achieves end-to-end automation across data foundation, literature review, research ideation, experiment automation, scientific writing, and peer review.<n>This infrastructure empowers agents to not only comprehend and leverage human knowledge systems but also to collaborate and co-evolve.
arXiv Detail & Related papers (2025-11-21T03:55:19Z) - Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics [82.55776608452017]
Large language models (LLMs) provide a flexible and versatile framework that orchestrates interactions with human scientists, natural language, computer language and code, and physics.<n>This paper presents our view and vision of LLM-based scientific agents and their growing role in transforming the scientific discovery lifecycle.<n>We identify open research challenges and outline promising directions for building more robust, generalizable, and adaptive scientific agents.
arXiv Detail & Related papers (2025-10-10T22:26:26Z) - From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery [108.1082357960201]
Agentic AI shows capabilities in hypothesis generation, experimental design, execution, analysis, and iterative refinement.<n>This survey provides a domain-oriented review of autonomous scientific discovery across life sciences, chemistry, materials science, and physics.
arXiv Detail & Related papers (2025-08-18T05:25:54Z) - SciSciGPT: Advancing Human-AI Collaboration in the Science of Science [8.596023415358433]
Recent advances in large language models (LLMs) and AI agents have opened new possibilities for human-AI collaboration.<n>We introduce SciSciGPT, an open-source, prototype AI collaborator that uses the science of science as a testbed to explore the potential of LLM-powered research tools.
arXiv Detail & Related papers (2025-04-07T23:19:39Z) - Scaling Laws in Scientific Discovery with AI and Robot Scientists [72.3420699173245]
An autonomous generalist scientist (AGS) concept combines agentic AI and embodied robotics to automate the entire research lifecycle.<n>AGS aims to significantly reduce the time and resources needed for scientific discovery.<n>As these autonomous systems become increasingly integrated into the research process, we hypothesize that scientific discovery might adhere to new scaling laws.
arXiv Detail & Related papers (2025-03-28T14:00:27Z) - AIGS: Generating Science from AI-Powered Automated Falsification [17.50867181053229]
We propose Baby-AIGS as a baby-step demonstration of a full-process AIGS system, which is a multi-agent system with agents in roles representing key research process.
Experiments on three tasks preliminarily show that Baby-AIGS could produce meaningful scientific discoveries, though not on par with experienced human researchers.
arXiv Detail & Related papers (2024-11-17T13:40:35Z) - Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System [62.832818186789545]
Virtual Scientists (VirSci) is a multi-agent system designed to mimic the teamwork inherent in scientific research.<n>VirSci organizes a team of agents to collaboratively generate, evaluate, and refine research ideas.<n>We show that this multi-agent approach outperforms the state-of-the-art method in producing novel scientific ideas.
arXiv Detail & Related papers (2024-10-12T07:16:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.