Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science

• URL: http://arxiv.org/abs/2603.28361v1
• Date: Mon, 30 Mar 2026 12:29:47 GMT
• Title: Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science
• Abstract summary: We articulate a clear and precise definition of deep research and unify perspectives from industry's deep research and academia's AI for Science.<n>We position LLMs and Stable Diffusion as the twin pillars of generative AI, and lay out a roadmap evolving from the Transformer to agents.
• Score: 2.316539232916599
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the advancement of large language models (LLMs) in their knowledge base and reasoning capabilities, their interactive modalities have evolved from pure text to multimodality and further to agentic tool use. Consequently, their applications have broadened from question answering to AI assistants and now to general-purpose agents. Deep research (DR) represents a prototypical vertical application for general-purpose agents, which represents an ideal approach for intelligent information processing and assisting humans in discovering and solving problems, with the goal of reaching or even surpassing the level of top human scientists. This paper provides a deep research of deep research. We articulate a clear and precise definition of deep research and unify perspectives from industry's deep research and academia's AI for Science (AI4S) within a developmental framework. We position LLMs and Stable Diffusion as the twin pillars of generative AI, and lay out a roadmap evolving from the Transformer to agents. We examine the progress of AI4S across various disciplines. We identify the predominant paradigms of human-AI interaction and prevailing system architectures, and discuss the major challenges and fundamental research issues that remain. AI supports scientific innovation, and science also can contribute to AI growth (Science for AI, S4AI). We hope this paper can help bridge the gap between the AI and AI4S communities.

Related papers

• AI Research Agents Narrow Scientific Exploration [12.949322198287417]
  We generate 37,802 scientific ideas from shared seed literature across citation-defined research areas in AI and machine learning.<n>We compare the resulting AI ideas against human-authored papers from the same research areas, follow-on human research emerging from the same seed literature, and the seed literature itself.<n>Overall, current AI research agents appear better suited to local elaboration than to broadening scientific exploration.
  arXiv  Detail & Related papers  (2026-05-27T03:26:43Z)
• Research Paradigm of Materials Science Tetrahedra with Artificial Intelligence [7.779425241736052]
  We propose two new research paradigms to stimulate data-driven and AI-augmented research.<n>One focuses on AI for materials science by considering the Matter-Data-PotentialAgent diagram.<n>The other demonstrates AI research by discussing Data-Architecture-Inference-Inference relationships.
  arXiv  Detail & Related papers  (2026-03-14T04:30:03Z)
• From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery [108.1082357960201]
  Agentic AI shows capabilities in hypothesis generation, experimental design, execution, analysis, and iterative refinement.<n>This survey provides a domain-oriented review of autonomous scientific discovery across life sciences, chemistry, materials science, and physics.
  arXiv  Detail & Related papers  (2025-08-18T05:25:54Z)
• AI4Research: A Survey of Artificial Intelligence for Scientific Research [55.5452803680643]
  We present a comprehensive survey on AI for Research (AI4Research)<n>We first introduce a systematic taxonomy to classify five mainstream tasks in AI4Research.<n>We identify key research gaps and highlight promising future directions.
  arXiv  Detail & Related papers  (2025-07-02T17:19:20Z)
• The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search [16.93028430619359]
  The AI Scientist-v2 is an end-to-end agentic system capable of producing the first entirely AI generated peer-review-accepted workshop paper.<n>It iteratively formulates scientific hypotheses, designs and executes experiments, analyzes and visualizes data, and autonomously authors scientific manuscripts.<n>One manuscript achieved high enough scores to exceed the average human acceptance threshold, marking the first instance of a fully AI-generated paper successfully navigating a peer review.
  arXiv  Detail & Related papers  (2025-04-10T18:44:41Z)
• Unlocking the Potential of AI Researchers in Scientific Discovery: What Is Missing? [17.606243765807964]
  We project AI4Science's share of total publications to rise from 2.72% in 2024 to approximately 20% by 2050.<n>Nearly 95% of AI-driven research in these journals is led by experimental scientists.<n>We propose structured and strategic interventions to position AI researchers at the forefront of scientific discovery.
  arXiv  Detail & Related papers  (2025-03-05T09:29:05Z)
• Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI [116.8199519880327]
  Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General Intelligence (AGI)<n>In this survey, we give a comprehensive exploration of the latest advancements in Embodied AI.
  arXiv  Detail & Related papers  (2024-07-09T14:14:47Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• AI for social science and social science of AI: A Survey [47.5235291525383]
  Recent advancements in artificial intelligence have sparked a rethinking of artificial general intelligence possibilities. The increasing human-like capabilities of AI are also attracting attention in social science research.
  arXiv  Detail & Related papers  (2024-01-22T10:57:09Z)
• Trustworthy AI: A Computational Perspective [54.80482955088197]
  We focus on six of the most crucial dimensions in achieving trustworthy AI: (i) Safety & Robustness, (ii) Non-discrimination & Fairness, (iii) Explainability, (iv) Privacy, (v) Accountability & Auditability, and (vi) Environmental Well-Being. For each dimension, we review the recent related technologies according to a taxonomy and summarize their applications in real-world systems.
  arXiv  Detail & Related papers  (2021-07-12T14:21:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.