From Toil to Thought: Designing for Strategic Exploration and Responsible AI in Systematic Literature Reviews

• URL: http://arxiv.org/abs/2603.05514v2
• Date: Thu, 12 Mar 2026 16:25:08 GMT
• Title: From Toil to Thought: Designing for Strategic Exploration and Responsible AI in Systematic Literature Reviews
• Abstract summary: This study identified key friction points: 1) the high cognitive load of managing iterative query refinement across multiple databases, 2) the overwhelming scale and pace of publication of modern literature, and 3) the tension between automation and scholarly agency.<n>We developed ARC, a design probe that operationalizes solutions for multi- database integration, transparent iterative search, and verifiable AI-assisted screening.
• Score: 12.088520576810247
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Systematic Literature Reviews (SLRs) are fundamental to scientific progress, yet the process is hindered by a fragmented tool ecosystem that imposes a high cognitive load. This friction suppresses the iterative, exploratory nature of scholarly work. To investigate these challenges, we conducted an exploratory design study with 20 experienced researchers. This study identified key friction points: 1) the high cognitive load of managing iterative query refinement across multiple databases, 2) the overwhelming scale and pace of publication of modern literature, and 3) the tension between automation and scholarly agency. Informed by these findings, we developed ARC, a design probe that operationalizes solutions for multi-database integration, transparent iterative search, and verifiable AI-assisted screening. A comparative user study with 8 researchers suggests that an integrated environment facilitates a transition in scholarly work, moving researchers from managing administrative overhead to engaging in strategic exploration. By utilizing external representations to scaffold strategic exploration and transparent AI reasoning, our system supports verifiable judgment, aiming to augment expert contributions from initial creation through long-term maintenance of knowledge synthesis.

Related papers

• Personalized Auto-Research: Towards a True AI Co-Scientist [90.01790420664169]
  Given a research goal, state-of-the-art systems remain researcher-agnostic.<n>What counts as novel, valuable, or feasible depends on the researcher.<n>We propose a framework that threads a graph-grounded researcher context through retrieval, hypothesis search, experimentation, writing, and review.
  arXiv  Detail & Related papers  (2026-08-14T20:43:27Z)
• WisPaper: Your AI Scholar Search Engine [55.07907253175705]
  textscWisPaper is an intelligent academic retrieval and literature management platform.<n>It provides a closed-loop workflow that seamlessly connects literature discovery, management, and continuous tracking of research frontiers.<n>The platform is publicly accessible and serves researchers across academia and industry.
  arXiv  Detail & Related papers  (2025-12-07T15:10:20Z)
• Deep Research: A Systematic Survey [118.82795024422722]
  Deep Research (DR) aims to combine the reasoning capabilities of large language models with external tools, such as search engines.<n>This survey presents a comprehensive and systematic overview of deep research systems.
  arXiv  Detail & Related papers  (2025-11-24T15:28:28Z)
• Cross-Disciplinary Knowledge Retrieval and Synthesis: A Compound AI Architecture for Scientific Discovery [1.5143261755366868]
  BioSage is a novel compound AI architecture that integrates LLMs with RAG, orchestrated specialized agents and tools to enable discoveries across AI, data science, biomedical, and biosecurity domains.<n>Our system features several specialized agents including the retrieval agent with query planning and response synthesis that enable knowledge retrieval across domains with citation-backed responses.<n>Our ongoing work focuses on multimodal retrieval and reasoning over charts, tables, and structured scientific data, along with developing comprehensive multimodal benchmarks for cross-disciplinary discovery.
  arXiv  Detail & Related papers  (2025-11-23T05:33:11Z)
• WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agents [72.28593628378991]
  WebResearcher is an iterative deep-research paradigm that reformulates deep research as a Markov Decision Process.<n>WebResearcher achieves state-of-the-art performance, even surpassing frontier proprietary systems.
  arXiv  Detail & Related papers  (2025-09-16T17:57:17Z)
• Deep Research: A Survey of Autonomous Research Agents [33.96146020332329]
  The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks.<n>To overcome these limitations, the paradigm of deep research has been proposed, wherein agents actively engage in planning, retrieval, and synthesis to generate comprehensive and faithful analytical reports grounded in web-based evidence.<n>We provide a systematic overview of the deep research pipeline, which comprises four core stages: planning, question developing, web exploration, and report generation.
  arXiv  Detail & Related papers  (2025-08-18T09:26:14Z)
• A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications [3.002468101812191]
  We analyze more than 80 commercial and non-commercial implementations that have emerged since 2023.<n>We propose a novel hierarchical taxonomy that categorizes systems according to four fundamental technical dimensions.<n>Our analysis reveals both the significant capabilities of current implementations and the technical and ethical challenges they present.
  arXiv  Detail & Related papers  (2025-06-14T18:19:05Z)
• The Budget AI Researcher and the Power of RAG Chains [4.797627592793464]
  Current approaches to supporting research idea generation often rely on generic large language models (LLMs)<n>Our framework, The Budget AI Researcher, uses retrieval-augmented generation chains, vector databases, and topic-guided pairing to recombine concepts from hundreds of machine learning papers.<n>The system ingests papers from nine major AI conferences, which collectively span the vast subfields of machine learning, and organizes them into a hierarchical topic tree.
  arXiv  Detail & Related papers  (2025-06-14T02:40:35Z)
• O1 Replication Journey: A Strategic Progress Report -- Part 1 [52.062216849476776]
  This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey. Our methodology addresses critical challenges in modern AI research, including the insularity of prolonged team-based projects. We propose the journey learning paradigm, which encourages models to learn not just shortcuts, but the complete exploration process.
  arXiv  Detail & Related papers  (2024-10-08T15:13:01Z)
• DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents [49.74065769505137]
  We introduce DISCOVERYWORLD, the first virtual environment for developing and benchmarking an agent's ability to perform complete cycles of novel scientific discovery. It includes 120 different challenge tasks spanning eight topics each with three levels of difficulty and several parametric variations. We find that strong baseline agents, that perform well in prior published environments, struggle on most DISCOVERYWORLD tasks.
  arXiv  Detail & Related papers  (2024-06-10T20:08:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.