On the GitHub Actions Language: Usage, Evolution, and Workflow Reliability

• URL: http://arxiv.org/abs/2605.26825v1
• Date: Tue, 26 May 2026 10:43:14 GMT
• Title: On the GitHub Actions Language: Usage, Evolution, and Workflow Reliability
• Abstract summary: This paper empirically explores how the adoption and evolution of GitHub Actions language constructs impacts workflow reliability and maintainability.<n>We quantitatively analyse 260K from 49K GitHub repositories to understand how they are used in practice and how their usage has evolved from July 2019 to August 2025.
• Score: 44.257027748554606
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Developers often struggle with maintaining GitHub Actions workflow configurations in GitHub-hosted repositories, with recent studies showing frequent execution failures. This paper empirically explores how the adoption and evolution of GitHub Actions language constructs impacts workflow reliability and maintainability. To do so, we quantitatively analyse 260K workflows from 49K GitHub repositories to understand how they are used in practice and how their usage has evolved from July 2019 to August 2025. We identify 197 language constructs available in the GitHub Actions language and map them to 14 features reflecting workflow capabilities. We observe that only a small set of constructs and features are used very frequently, and that larger and more complex workflows are associated with higher failure rates and more maintenance effort. We identify specific features that are more likely to be linked with reliability and maintainability risks. These insights can help practitioners and researchers improve their understanding and usage of the GitHub Actions language, which can help in improving and sustaining workflow automation practices.

Related papers

• Beyond the YAML File: Understanding Real-World GitHub Actions Workflow Adoption [3.1994648513393873]
  GitHub Actions (GHA) are emerging as a dominant automation platform.<n>We quantitatively analyze 258,300 workflow run records from 952 repositories to understand how maintainers and contributors interact with workflow results.<n>We identify three distinct failure response patterns, observe that higher usage of GHA correlates with lower failure rates, and uncover a configuration-usage gap.
  arXiv  Detail & Related papers  (2026-04-19T23:23:59Z)
• An Empirical Study of the Evolution of GitHub Actions Workflows [41.25198736954168]
  CI/CD practices play a significant role during collaborative software development.<n> GitHub Actions, the CI/CD tool integrated into GitHub, allows repository maintainers to automate development.<n>We conducted a mixed methods analysis of GitHub Actions workflow changes over time.
  arXiv  Detail & Related papers  (2026-02-16T09:05:42Z)
• Automation and Reuse Practices in GitHub Actions Workflows: A Practitioner's Perspective [41.512965779724354]
  GitHub supports workflow automation through GitHub Actions.<n>We surveyed 419 practitioners to elucidate good and bad workflow development practices.<n>We observe a tendency to focus automation efforts on core CI/CD tasks, with less emphasis on crucial areas like security analysis and performance monitoring.
  arXiv  Detail & Related papers  (2026-01-16T13:54:54Z)
• SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving [90.32201622392137]
  We present SwingArena, a competitive evaluation framework for Large Language Models (LLMs)<n>Unlike traditional static benchmarks, SwingArena models the collaborative process of software by pairing LLMs as iterations, who generate patches, and reviewers, who create test cases and verify the patches through continuous integration (CI) pipelines.
  arXiv  Detail & Related papers  (2025-05-29T18:28:02Z)
• The Hidden Costs of Automation: An Empirical Study on GitHub Actions Workflow Maintenance [45.53834452021771]
  GitHub Actions (GA) is an orchestration platform that streamlines the automatic execution of engineering tasks. Human intervention is necessary to correct defects, update dependencies, or existing workflow files.
  arXiv  Detail & Related papers  (2024-09-04T01:33:16Z)
• Automatic Categorization of GitHub Actions with Transformers and Few-shot Learning [12.254055731378045]
  GitHub Actions (GHA) have been conceived to provide developers with a practical tool to create and maintain a pipeline. To expose actions to search engines, GitHub allows developers to assign them to one or more categories manually. We propose Gavel, a practical solution to increasing the visibility of actions in GitHub.
  arXiv  Detail & Related papers  (2024-07-24T02:27:36Z)
• On the effectiveness of Large Language Models for GitHub Workflows [9.82254417875841]
  Large Language Models (LLMs) have demonstrated their effectiveness in various software development tasks. We perform the first comprehensive study to understand the effectiveness of LLMs on five workflow-related tasks with different levels of prompts. Our evaluation of three state-of-art LLMs and their fine-tuned variants revealed various interesting findings on the current effectiveness and drawbacks of LLMs.
  arXiv  Detail & Related papers  (2024-03-19T05:14:12Z)
• The GitHub Development Workflow Automation Ecosystems [47.818229204130596]
  Large-scale software development has become a highly collaborative endeavour. This chapter explores the ecosystems of development bots and GitHub Actions. It provides an extensive survey of the state-of-the-art in this domain.
  arXiv  Detail & Related papers  (2023-05-08T15:24:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.