A Mixed Method Study of DevOps Challenges

• URL: http://arxiv.org/abs/2403.16436v1
• Date: Mon, 25 Mar 2024 05:35:40 GMT
• Title: A Mixed Method Study of DevOps Challenges
• Authors: Minaoar Hossain Tanzil, Masud Sarker, Gias Uddin, Anindya Iqbal,
• Abstract summary: We conduct an empirical study by applying topic modeling on 174K SO posts that contain DevOps discussions. We then validate and extend the empirical study findings with a survey of 21 professional DevOps practitioners.
• Score: 2.2957483176038584
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Context: DevOps practices combine software development and IT operations. There is a growing number of DevOps related posts in popular online developer forum Stack Overflow (SO). While previous research analyzed SO posts related to build/release engineering, we are aware of no research that specifically focused on DevOps related discussions. Objective: To learn the challenges developers face while using the currently available DevOps tools and techniques along with the organizational challenges in DevOps practices. Method: We conduct an empirical study by applying topic modeling on 174K SO posts that contain DevOps discussions. We then validate and extend the empirical study findings with a survey of 21 professional DevOps practitioners. Results: We find that: (1) There are 23 DevOps topics grouped into four categories: Cloud & CI/CD Tools, Infrastructure as Code, Container & Orchestration, and Quality Assurance. (2) The topic category Cloud & CI/CD Tools contains the highest number of topics (10) which cover 48.6% of all questions in our dataset, followed by the category Infrastructure as Code (28.9%). (3) File management is the most popular topic followed by Jenkins Pipeline, while infrastructural Exception Handling and Jenkins Distributed Architecture are the most difficult topics (with least accepted answers). (4) In the survey, developers mention that it requires hands-on experience before current DevOps tools can be considered easy. They raised the needs for better documentation and learning resources to learn the rapidly changing DevOps tools and techniques. Practitioners also emphasized on the formal training approach by the organizations for DevOps skill development. Conclusion: Architects and managers can use the findings of this research to adopt appropriate DevOps technologies, and organizations can design tool or process specific DevOps training programs.

Related papers

• DevOps Automation Pipeline Deployment with IaC (Infrastructure as Code) [0.9786690381850356]
  This paper aims to streamline the current software development and deployment process as Continuous Integration and Continuous Delivery (CI/CD) pipelines. The further objective of the paper is to demonstrate the implementation strategy of DevOps Infrastructure as Code (IaC) and Pipeline as a code.
  arXiv  Detail & Related papers  (2025-03-20T11:12:54Z)
• CLOVER: A Test Case Generation Benchmark with Coverage, Long-Context, and Verification [71.34070740261072]
  This paper presents a benchmark, CLOVER, to evaluate models' capabilities in generating and completing test cases. The benchmark is containerized for code execution across tasks, and we will release the code, data, and construction methodologies.
  arXiv  Detail & Related papers  (2025-02-12T21:42:56Z)
• A Web-Based IDE for DevOps Learning in Software Engineering Higher Education [0.0]
  This paper presents an innovative online Integrated Development Environment (IDE) designed to facilitate DevOps learning within university curricula. The devised tool offers a standardized, accessible learning environment, equipped with devcontainers and engaging tutorials. Research findings highlight a marked preference among students for self-paced learning approaches.
  arXiv  Detail & Related papers  (2024-12-08T12:29:08Z)
• An Empirical Investigation on the Challenges in Scientific Workflow Systems Development [2.704899832646869]
  This study examines interactions between developers and researchers on Stack Overflow (SO) and GitHub. By analyzing issues, we identified 13 topics (e.g., Errors and Bug Fixing, Documentation, Dependencies) and discovered that data structures and operations is the most difficult. We also found common topics between SO and GitHub, such as data structures and operations, task management, and workflow scheduling.
  arXiv  Detail & Related papers  (2024-11-16T21:14:11Z)
• RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graph [63.87660059104077]
  We present RepoGraph, a plug-in module that manages a repository-level structure for modern AI software engineering solutions. RepoGraph substantially boosts the performance of all systems, leading to a new state-of-the-art among open-source frameworks.
  arXiv  Detail & Related papers  (2024-10-03T05:45:26Z)
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents [109.8507367518992]
  We introduce OpenHands, a platform for the development of AI agents that interact with the world in similar ways to a human developer. We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, and incorporation of evaluation benchmarks.
  arXiv  Detail & Related papers  (2024-07-23T17:50:43Z)
• Chronicles of CI/CD: A Deep Dive into its Usage Over Time [0.5705775078773656]
  This paper analyzes the technologies developers use for CI/CD by analyzing GitHub repositories. Using a list of the state-of-the-art CI/CD technologies, we use the GitHub search API to find repositories using each of these technologies. We provide an overview of the use of CI/CD technologies in our days, but also what happened in the last 12 years.
  arXiv  Detail & Related papers  (2024-02-27T15:20:11Z)
• DevEval: Evaluating Code Generation in Practical Software Projects [52.16841274646796]
  We propose a new benchmark named DevEval, aligned with Developers' experiences in practical projects. DevEval is collected through a rigorous pipeline, containing 2,690 samples from 119 practical projects. We assess five popular LLMs on DevEval and reveal their actual abilities in code generation.
  arXiv  Detail & Related papers  (2024-01-12T06:51:30Z)
• Automated DevOps Pipeline Generation for Code Repositories using Large Language Models [5.011328607647701]
  The research scrutinizes the proficiency of GPT 3.5 and GPT 4 in generating GitHub, while assessing the influence of various prompt elements in constructing the most efficient pipeline. Results indicate substantial advancements in GPT 4. The research introduces a GitHub App built on Probot, empowering users to automate workflow generation within GitHub ecosystem.
  arXiv  Detail & Related papers  (2023-12-20T17:47:52Z)
• DevBots can co-design APIs [0.0]
  DevBots are automated tools that perform various tasks in order to support software development. We analyzed 24 articles to investigate the state of the art of using DevBots in software development.
  arXiv  Detail & Related papers  (2023-12-10T02:29:05Z)
• RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmark [69.19502244910632]
  Deep reinforcement learning (RL) has shown significant benefits in solving optimization (CO) problems. We introduce RL4CO, a unified benchmark with in-depth library coverage of 23 state-of-the-art methods and more than 20 CO problems. Built on efficient software libraries and best practices in implementation, RL4CO features modularized implementation and flexible configuration of diverse RL algorithms, neural network architectures, inference techniques, and environments.
  arXiv  Detail & Related papers  (2023-06-29T16:57:22Z)
• Factors that Contribute to the Success of a Software Organisation's DevOps Environment: A Systematic Review [0.0]
  This research assesses the aspects of software organizations' DevOps environments and identifies the factors contributing to these environments' success. The systematic review consisted of 33 articles from five selected search systems and databases from 2015 to 2021. 15 factors were identified and grouped into four categories: Collaborative Culture, Organizational Aspects, Tooling and Technology, and Continuous Practices.
  arXiv  Detail & Related papers  (2022-11-08T09:03:35Z)
• UKP-SQUARE: An Online Platform for Question Answering Research [50.35348764297317]
  We present UKP-SQUARE, an online QA platform for researchers which allows users to query and analyze a large collection of modern Skills. UKP-SQUARE allows users to query and analyze a large collection of modern Skills via a user-friendly web interface and integrated tests.
  arXiv  Detail & Related papers  (2022-03-25T15:00:24Z)
• Conditional Prompt Learning for Vision-Language Models [107.06776396086471]
  A recently proposed method named Context Optimization (CoOp) turns context words in a prompt into a set of learnable vectors. CoOp generalizes much better than CoOp to unseen classes, even showing promising transferability beyond a single dataset. Our experiments show that CoCoOp generalizes much better than CoOp to unseen classes, even showing promising transferability beyond a single dataset.
  arXiv  Detail & Related papers  (2022-03-10T18:59:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.