From Papers to Progress: Rethinking Knowledge Accumulation in Software Engineering

• URL: http://arxiv.org/abs/2604.16208v1
• Date: Fri, 17 Apr 2026 16:19:54 GMT
• Title: From Papers to Progress: Rethinking Knowledge Accumulation in Software Engineering
• Abstract summary: We analyze responses from the ICSE 2026 Future of Software Engineering pre-survey.<n>Our analysis reveals a tension between increasing research productivity and the limited mechanisms available for synthesizing results.<n>We argue that addressing these barriers requires rethinking the fundamental properties of research artifacts.
• Score: 0.8680081568962996
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Software engineering research has experienced rapid growth in both output and participation over the past decades. Yet concerns persist about the field's ability to accumulate, integrate, and reuse knowledge in ways that support long-term progress. To better understand how the community itself perceives these challenges, we analyze responses from the ICSE 2026 Future of Software Engineering pre-survey, which captures perspectives from 280 globally distributed and highly experienced researchers. Our analysis reveals a tension between increasing research productivity and the limited mechanisms available for synthesizing results, tracking evolving claims, and supporting cumulative understanding over time. Building on these observations, we diagnose four interrelated structural breakdowns: papers function as isolated knowledge units with claims embedded in prose; context and provenance are lost as knowledge moves through the publication pipeline; claims evolve without systematic tracking; and incentive structures favor novelty over consolidation. We argue that addressing these barriers requires rethinking the fundamental properties of research artifacts. We articulate four technology-agnostic principles for future research artifacts: structured and interpretable representations of claims and evidence; inspectable and provenance-aware documentation of methodological decisions; long-lived and reusable substrates that evolve beyond publication; and governance mechanisms that align individual incentives with collective knowledge-building goals. We discuss implications for research practice, publication norms, and community infrastructure, positioning FOSE as a venue for experimenting with alternative artifact designs that support cumulative scientific progress.

Related papers

• AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery [184.2309450554096]
  AutoResearch is defined as the developmental spectrum of AI-powered scientific workflow automation.<n>We analyze how research systems redistribute control, evidence, execution, validation, and accountability across and organize the field.<n>We propose five evaluation dimensions--novelty, impact, reliability, and provenance--and show that AutoResearch autonomy is domain-conditioned.
  arXiv  Detail & Related papers  (2026-05-22T03:40:30Z)
• A Data-Driven Analysis for Engineering Conferences: The Institute of Industrial and Systems Engineering (IISE) Annual Conference Proceedings (2002-2025) [0.0]
  This paper presents a computational analysis of IISE proceedings from 2002 to 2025.<n>We map thematic evolution to identify dominant, emerging, and receding research topics.<n>The findings illuminate the field's intellectual assets and provide a data-informed map to guide the future of ISE.
  arXiv  Detail & Related papers  (2026-02-28T01:10:46Z)
• GenAI for Systems: Recurring Challenges and Design Principles from Software to Silicon [62.2138479061386]
  Generative AI is reshaping how computing systems are designed, optimized, and built, yet research remains fragmented across software, architecture, and chip design communities.<n>This paper takes a cross-stack perspective, examining how generative models are being applied from code generation and distributed runtimes through hardware design space exploration to RTL synthesis, physical layout, and verification.
  arXiv  Detail & Related papers  (2026-02-16T22:45:33Z)
• From Toil to Thought: Designing for Strategic Exploration and Responsible AI in Systematic Literature Reviews [12.088520576810247]
  This study identified key friction points: 1) the high cognitive load of managing iterative query refinement across multiple databases, 2) the overwhelming scale and pace of publication of modern literature, and 3) the tension between automation and scholarly agency.<n>We developed ARC, a design probe that operationalizes solutions for multi- database integration, transparent iterative search, and verifiable AI-assisted screening.
  arXiv  Detail & Related papers  (2026-01-21T00:28:27Z)
• Deep Research: A Systematic Survey [118.82795024422722]
  Deep Research (DR) aims to combine the reasoning capabilities of large language models with external tools, such as search engines.<n>This survey presents a comprehensive and systematic overview of deep research systems.
  arXiv  Detail & Related papers  (2025-11-24T15:28:28Z)
• WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agents [72.28593628378991]
  WebResearcher is an iterative deep-research paradigm that reformulates deep research as a Markov Decision Process.<n>WebResearcher achieves state-of-the-art performance, even surpassing frontier proprietary systems.
  arXiv  Detail & Related papers  (2025-09-16T17:57:17Z)
• Domain Knowledge in Requirements Engineering: A Systematic Mapping Study [1.0396117988046165]
  Domain knowledge is recognized as a key component for the success of Requirements Engineering (RE)<n>Despite its relevance, the scientific literature still lacks a systematic consolidation of how domain knowledge can be effectively used and operationalized in RE.
  arXiv  Detail & Related papers  (2025-06-25T18:27:51Z)
• A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications [3.002468101812191]
  We analyze more than 80 commercial and non-commercial implementations that have emerged since 2023.<n>We propose a novel hierarchical taxonomy that categorizes systems according to four fundamental technical dimensions.<n>Our analysis reveals both the significant capabilities of current implementations and the technical and ethical challenges they present.
  arXiv  Detail & Related papers  (2025-06-14T18:19:05Z)
• A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [51.26815896167173]
  We present a comprehensive tertiary analysis of PAMI reviews along three complementary dimensions.<n>Our analyses reveal distinctive organizational patterns as well as persistent gaps in current review practices.<n>Finally, our evaluation of state-of-the-art AI-generated reviews indicates encouraging advances in coherence and organization.
  arXiv  Detail & Related papers  (2024-02-20T11:28:50Z)
• Artificial Intelligence in Concrete Materials: A Scientometric View [77.34726150561087]
  This chapter aims to uncover the main research interests and knowledge structure of the existing literature on AI for concrete materials. To begin with, a total of 389 journal articles published from 1990 to 2020 were retrieved from the Web of Science. Scientometric tools such as keyword co-occurrence analysis and documentation co-citation analysis were adopted to quantify features and characteristics of the research field.
  arXiv  Detail & Related papers  (2022-09-17T18:24:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.