Beyond the YAML File: Understanding Real-World GitHub Actions Workflow Adoption

• URL: http://arxiv.org/abs/2604.17662v1
• Date: Sun, 19 Apr 2026 23:23:59 GMT
• Title: Beyond the YAML File: Understanding Real-World GitHub Actions Workflow Adoption
• Abstract summary: GitHub Actions (GHA) are emerging as a dominant automation platform.<n>We quantitatively analyze 258,300 workflow run records from 952 repositories to understand how maintainers and contributors interact with workflow results.<n>We identify three distinct failure response patterns, observe that higher usage of GHA correlates with lower failure rates, and uncover a configuration-usage gap.
• Score: 3.1994648513393873
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Continuous Integration and Continuous Deployment (CI/CD) have become fundamental to modern software development, with GitHub Actions (GHA) emerging as a dominant automation platform. In this study, we analyze real-world execution records of GHA, examining how developers react to workflow failures, how these workflows are utilized by projects, and how these aspects relate to project characteristics. We quantitatively analyze 258,300 workflow run records from 952 repositories and perform an in-depth qualitative analysis of 21 selected, diverse GitHub repositories to understand how maintainers and contributors interact with workflow results. We identify three distinct failure response patterns, observe that higher usage intensity of GHA workflows correlates with lower failure rates, and uncover a configuration-usage gap where the presence of configuration files masks disabled or unused workflows. Moreover, our qualitative analysis of relationships between project characteristics and utilization patterns yields five hypotheses for future validation.

Related papers

• Recovering Software Architecture Intent from Historical Work Items using Generative AI: A Mixed-Methods Industry Case Study [2.5501791028999583]
  This work investigates the recovery of C4 architecture diagrams from historical agile work items using an LLM-based pipeline.<n>The semi-automatic five-step workflow employs a prompt chain, bidirectional traceability, and Chain-of-Thought reasoning.<n>The proposed workflow demonstrates the practical viability of LLM-assisted architectural recovery based on development process artifacts.
  arXiv  Detail & Related papers  (2026-08-28T14:56:00Z)
• From Question Answering to Task Completion: A Survey on Agent System and Harness Design [67.8241530947325]
  This survey examines LLM-based agents through a model-harness lens.<n>We first clarify the functional definition of agents and the implementation view of an LLM-based agent as a foundation model and an execution harness.<n>We then analyze the limits of model-centric scaling, trace four paradigms of agent engineering, and decompose the execution harness into six coupled runtime responsibilities.
  arXiv  Detail & Related papers  (2026-06-14T05:40:16Z)
• On the GitHub Actions Language: Usage, Evolution, and Workflow Reliability [44.257027748554606]
  This paper empirically explores how the adoption and evolution of GitHub Actions language constructs impacts workflow reliability and maintainability.<n>We quantitatively analyse 260K from 49K GitHub repositories to understand how they are used in practice and how their usage has evolved from July 2019 to August 2025.
  arXiv  Detail & Related papers  (2026-05-26T10:43:14Z)
• An Empirical Study of the Evolution of GitHub Actions Workflows [41.25198736954168]
  CI/CD practices play a significant role during collaborative software development.<n> GitHub Actions, the CI/CD tool integrated into GitHub, allows repository maintainers to automate development.<n>We conducted a mixed methods analysis of GitHub Actions workflow changes over time.
  arXiv  Detail & Related papers  (2026-02-16T09:05:42Z)
• Learning to Compose for Cross-domain Agentic Workflow Generation [56.630382886594184]
  We create an open-source LLM for cross-domain workflow generation.<n>We learn a compact set of reusable workflow capabilities across diverse domains.<n>Our 1-pass generator surpasses SOTA refinement baselines that consume 20 iterations.
  arXiv  Detail & Related papers  (2026-02-11T18:27:22Z)
• WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Models [105.46456444315693]
  We presentLLM, a data-centric framework to enhance the capability of large language models in workflow orchestration. It first constructs a large-scale fine-tuningBench with 106,763 samples, covering 1,503 APIs from 83 applications across 28 categories. LlamaLlama demonstrates a strong capacity to orchestrate complex APIs, while also achieving notable generalization performance.
  arXiv  Detail & Related papers  (2024-11-08T09:58:02Z)
• Benchmarking Agentic Workflow Generation [80.74757493266057]
  We introduce WorfBench, a unified workflow generation benchmark with multi-faceted scenarios and intricate graph workflow structures.<n>We also present WorfEval, a systemic evaluation protocol utilizing subsequence and subgraph matching algorithms.<n>We observe that the generated can enhance downstream tasks, enabling them to achieve superior performance with less time during inference.
  arXiv  Detail & Related papers  (2024-10-10T12:41:19Z)
• The Hidden Costs of Automation: An Empirical Study on GitHub Actions Workflow Maintenance [45.53834452021771]
  GitHub Actions (GA) is an orchestration platform that streamlines the automatic execution of engineering tasks. Human intervention is necessary to correct defects, update dependencies, or existing workflow files.
  arXiv  Detail & Related papers  (2024-09-04T01:33:16Z)
• FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents [64.1759086221016]
  We present FlowBench, the first benchmark for workflow-guided planning. FlowBench covers 51 different scenarios from 6 domains, with knowledge presented in diverse formats. Results indicate that current LLM agents need considerable improvements for satisfactory planning.
  arXiv  Detail & Related papers  (2024-06-21T06:13:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.