Do you monitor CI Practices? I don't know. You tell me: A case study

• URL: http://arxiv.org/abs/2503.02610v1
• Date: Tue, 04 Mar 2025 13:30:06 GMT
• Title: Do you monitor CI Practices? I don't know. You tell me: A case study
• Abstract summary: We aim to evaluate the impact of monitoring seven CI practices in a real-world scenario on three public organizations in Brazil.<n>We recommend that companies adopt monitoring of CI practices and that CI services integrate this monitoring into their dashboards.
• Score: 1.660201734459127
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Background: In this paper we seek for understand the benefits and challenges of monitoring CI practices in day-to-day software development. Aims: We aim to evaluate the impact of monitoring seven CI practices in a real-world scenario on three public organizations in Brazil. Method: We first developed a CI practices monitoring suite tool and conducted a multiple-case study applying a mixed-methods strategy, combining surveys, interviews, log data, and mining data from CI services. Results: We verified organization' interest in monitoring CI practices. Monitoring provided an overview of the organization's CI status, not covered by other tools, motivated constant improvement in these practices, a perception of software quality, improve the communication and and it is easy to adopt. Conclusions: We recommend that companies adopt monitoring of CI practices and that CI services integrate this monitoring into their dashboards.

Related papers

• Cooperative Informative Sensing for Monitoring Dynamic Indoor Environments via Multi-Agent Reinforcement Learning [56.64821510576244]
  We formulate cooperative active observation as a decentralized control problem in which multiple robots adjust their motion to directly optimize monitoring accuracy under partial observability.<n>We propose a learning-based framework for cooperative policies from decentralized observations using multi-agent reinforcement learning (MARL), supported by an architecture that handles variable numbers of humans and temporal dependencies.
  arXiv  Detail & Related papers  (2026-04-25T07:20:15Z)
• Learning Contextual Runtime Monitors for Safe AI-Based Autonomy [42.24674899629751]
  We introduce a novel framework for learning context-aware runtime monitors for AI-based control ensembles.<n>Our approach comes with two key benefits: (1) theoretical safety guarantees during controller selection, and (2) improved utilization of controller diversity.
  arXiv  Detail & Related papers  (2026-01-28T14:49:04Z)
• MIT Lincoln Laboratory: A Case Study on Improving Software Support for Research Projects [0.2711476170130695]
  MIT Lincoln Laboratory has sought to improve the effectiveness and culture surrounding software engineering in execution of its mission.<n>The Homeland Protection and Air Traffic Control Division conducted an internal study to examine challenges to effective and efficient research software development.<n>The study delivered actionable recommendations, including centralizing and standardizing software support tooling.
  arXiv  Detail & Related papers  (2025-12-01T13:22:58Z)
• From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence [150.3696990310269]
  Large language models (LLMs) have transformed automated software development by enabling direct translation of natural language descriptions into functional code.<n>We provide a comprehensive synthesis and practical guide (a series of analytic and probing experiments) about code LLMs.<n>We analyze the code capability of the general LLMs (GPT-4, Claude, LLaMA) and code-specialized LLMs (StarCoder, Code LLaMA, DeepSeek-Coder, and QwenCoder)
  arXiv  Detail & Related papers  (2025-11-23T17:09:34Z)
• Operationalizing AI: Empirical Evidence on MLOps Practices, User Satisfaction, and Organizational Context [0.0]
  This study analyzes over 8,000 user reviews of AI development platforms from G2.com.<n>We measure review sentiment toward nine established Machine Learning Operations practices.<n>Seven of the nine practices show a significant positive relationship with user satisfaction.
  arXiv  Detail & Related papers  (2025-10-11T02:57:14Z)
• Bridging the Mobile Trust Gap: A Zero Trust Framework for Consumer-Facing Applications [51.56484100374058]
  This paper proposes an extended Zero Trust model designed for mobile applications operating in untrusted, user-controlled environments.<n>Using a design science methodology, the study introduced a six-pillar framework that supports runtime enforcement of trust.<n>The proposed model offers a practical and standards-aligned approach to securing mobile applications beyond pre-deployment controls.
  arXiv  Detail & Related papers  (2025-08-20T18:42:36Z)
• AISafetyLab: A Comprehensive Framework for AI Safety Evaluation and Improvement [73.0700818105842]
  We introduce AISafetyLab, a unified framework and toolkit that integrates representative attack, defense, and evaluation methodologies for AI safety.<n> AISafetyLab features an intuitive interface that enables developers to seamlessly apply various techniques.<n>We conduct empirical studies on Vicuna, analyzing different attack and defense strategies to provide valuable insights into their comparative effectiveness.
  arXiv  Detail & Related papers  (2025-02-24T02:11:52Z)
• Reviewing Uses of Regulatory Compliance Monitoring [0.0]
  This work presents a systematic literature review on uses of regulatory compliance monitoring of business processes. We highlight commonalities and differences between the approaches and find that various steps are performed manually.
  arXiv  Detail & Related papers  (2024-12-06T15:54:36Z)
• TrustOps: Continuously Building Trustworthy Software [42.81677042059531]
  We argue that gathering verifiable evidence during software development and operations is needed for creating a new trust model.<n>We present TrustOps, an approach for continuously collecting verifiable evidence in all phases of the software life cycle.
  arXiv  Detail & Related papers  (2024-12-04T10:41:01Z)
• Adoption and Adaptation of CI/CD Practices in Very Small Software Development Entities: A Systematic Literature Review [0.0]
  This study presents a systematic review on the adoption of Continuous Integration and Continuous Delivery (CI/CD) practices in Very Small Entities (VSEs) in software development. The research analyzes 13 selected studies to identify common CI/CD practices, characterize the specific limitations of VSEs, and explore strategies for adapting these practices to small-scale environments.
  arXiv  Detail & Related papers  (2024-09-29T04:43:15Z)
• On the Need to Monitor Continuous Integration Practices -- An Empirical Study [4.407128462695972]
  Continuous Integration (CI) encompasses a set of widely adopted practices that enhance software development. This paper explores developers' perceptions regarding the monitoring CI practices.
  arXiv  Detail & Related papers  (2024-09-08T14:08:07Z)
• Deep Reinforcement Learning Empowered Activity-Aware Dynamic Health Monitoring Systems [69.41229290253605]
  Existing monitoring approaches were designed on the premise that medical devices track several health metrics concurrently. This means that they report all relevant health values within that scope, which can result in excess resource use and the gathering of extraneous data. We propose Dynamic Activity-Aware Health Monitoring strategy (DActAHM) for striking a balance between optimal monitoring performance and cost efficiency.
  arXiv  Detail & Related papers  (2024-01-19T16:26:35Z)
• Crowd management, crime detection, work monitoring using aiml [0.0]
  This research endeavors to harness the potential of existing CCTV networks for a comprehensive approach to crowd management, crime prevention, and workplace monitoring. The primary objective is to develop and implement advanced algorithms capable of real-time analysis of video feeds. By leveraging AI/ML, the project aims to optimize surveillance capabilities, thereby enhancing public safety measures and improving organizational productivity.
  arXiv  Detail & Related papers  (2023-11-21T14:12:17Z)
• From Compliance to Impact: Tracing the Transformation of an Organizational Security Awareness Program [3.3916160303055567]
  We conduct a year-long case study of a security awareness program in a U.S. government agency. Our findings reveal the challenges and practices involved in the progression of a security awareness program.
  arXiv  Detail & Related papers  (2023-09-14T14:01:05Z)
• Exploring Security Practices in Infrastructure as Code: An Empirical Study [54.669404064111795]
  Cloud computing has become popular thanks to the widespread use of Infrastructure as Code (IaC) tools. scripting process does not automatically prevent practitioners from introducing misconfigurations, vulnerabilities, or privacy risks. Ensuring security relies on practitioners understanding and the adoption of explicit policies, guidelines, or best practices.
  arXiv  Detail & Related papers  (2023-08-07T23:43:32Z)
• Advancements In Crowd-Monitoring System: A Comprehensive Analysis of Systematic Approaches and Automation Algorithms: State-of-The-Art [0.0]
  Crowd monitoring systems depend on a bifurcated approach, encompassing vision-based and non-vision-based technologies. This paper endeavors to present an in-depth analysis of the recent incorporation of artificial intelligence (AI) algorithms and models into automated systems.
  arXiv  Detail & Related papers  (2023-08-07T20:50:48Z)
• Managing Controlled Unclassified Information in Research Institutions [1.7778609937758323]
  This work explains the concept of Controlled Unclassified Information (CUI) and the challenges it brings to the research institutions. A managed research ecosystem is introduced in this work.
  arXiv  Detail & Related papers  (2022-11-27T16:54:24Z)
• Mastering the Unsupervised Reinforcement Learning Benchmark from Pixels [112.63440666617494]
  Reinforcement learning algorithms can succeed but require large amounts of interactions between the agent and the environment. We propose a new method to solve it, using unsupervised model-based RL, for pre-training the agent. We show robust performance on the Real-Word RL benchmark, hinting at resiliency to environment perturbations during adaptation.
  arXiv  Detail & Related papers  (2022-09-24T14:22:29Z)
• Towards Sequence-Level Training for Visual Tracking [60.95799261482857]
  This work introduces a sequence-level training strategy for visual tracking based on reinforcement learning. Four representative tracking models, SiamRPN++, SiamAttn, TransT, and TrDiMP, consistently improve by incorporating the proposed methods in training.
  arXiv  Detail & Related papers  (2022-08-11T13:15:36Z)
• An Uncommon Task: Participatory Design in Legal AI [64.54460979588075]
  We examine a notable yet understudied AI design process in the legal domain that took place over a decade ago. We show how an interactive simulation methodology allowed computer scientists and lawyers to become co-designers.
  arXiv  Detail & Related papers  (2022-03-08T15:46:52Z)
• Curriculum Learning for Safe Mapless Navigation [71.55718344087657]
  This work investigates the effects of Curriculum Learning (CL)-based approaches on the agent's performance. In particular, we focus on the safety aspect of robotic mapless navigation, comparing over a standard end-to-end (E2E) training strategy.
  arXiv  Detail & Related papers  (2021-12-23T12:30:36Z)
• Prescriptive Process Monitoring: Quo Vadis? [64.39761523935613]
  The paper studies existing methods in this field via a Systematic Literature Review ( SLR) The SLR provides insights into challenges and areas for future research that could enhance the usefulness and applicability of prescriptive process monitoring methods.
  arXiv  Detail & Related papers  (2021-12-03T08:06:24Z)
• Q-Mixing Network for Multi-Agent Pathfinding in Partially Observable Grid Environments [62.997667081978825]
  We consider the problem of multi-agent navigation in partially observable grid environments. We suggest utilizing the reinforcement learning approach when the agents, first, learn the policies that map observations to actions and then follow these policies to reach their goals.
  arXiv  Detail & Related papers  (2021-08-13T09:44:47Z)
• CoCoMoT: Conformance Checking of Multi-Perspective Processes via SMT (Extended Version) [62.96267257163426]
  We introduce the CoCoMoT (Computing Conformance Modulo Theories) framework. First, we show how SAT-based encodings studied in the pure control-flow setting can be lifted to our data-aware case. Second, we introduce a novel preprocessing technique based on a notion of property-preserving clustering.
  arXiv  Detail & Related papers  (2021-03-18T20:22:50Z)
• EEG-based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and their Applications [65.32004302942218]
  Brain-Computer Interface (BCI) is a powerful communication tool between users and systems. Recent technological advances have increased interest in electroencephalographic (EEG) based BCI for translational and healthcare applications.
  arXiv  Detail & Related papers  (2020-01-28T10:36:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.