Causal Inference for the Effect of Code Coverage on Bug Introduction

• URL: http://arxiv.org/abs/2602.03585v1
• Date: Tue, 03 Feb 2026 14:36:30 GMT
• Title: Causal Inference for the Effect of Code Coverage on Bug Introduction
• Abstract summary: We aim to quantify the causal effect of code coverage on bug introduction (outcome) in the context of mature JavaScript and TypeScript open source projects.
• Score: 11.877258445515318
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Context: Code coverage is widely used as a software quality assurance measure. However, its effect, and specifically the advisable dose, are disputed in both the research and engineering communities. Prior work reports only correlational associations, leaving results vulnerable to confounding factors. Objective: We aim to quantify the causal effect of code coverage (exposure) on bug introduction (outcome) in the context of mature JavaScript and TypeScript open source projects, addressing both the overall effect and its variance across coverage levels. Method: We construct a causal directed acyclic graph to identify confounders within the software engineering process, modeling key variables from the source code, issue- and review systems, and continuous integration. Using generalized propensity score adjustment, we will apply doubly robust regression-based causal inference for continuous exposure to a novel dataset of bug-introducing and non-bug-introducing changes. We estimate the average treatment effect and dose-response relationship to examine potential non-linear patterns (e.g., thresholds or diminishing returns) within the projects of our dataset.

Related papers

• CLAM: Causal Spatial Disaggregation to Infer Local Effects From Coarse Data [1.1979851857700952]
  CLAM is a method for estimating localized causal effects from coarse observations.<n>It supports localized effect estimation, counterfactual reasoning, and principled outcome disaggregation.<n>This is particularly relevant for applications such as public health and environmental policy.
  arXiv  Detail & Related papers  (2026-08-08T11:05:19Z)
• Deployment Risk Assessment Using Diff-Aware Features: A Case Study at Prime Video [0.4310167974376404]
  Current change control approaches use blanket deployment freezes that block all changes regardless of risk.<n>We introduce a framework centered on diff-aware features, characteristics derived directly from code modifications.<n>We employ LLMs as multi-language feature extractors, demonstrating their effectiveness for code analysis beyond generation tasks.
  arXiv  Detail & Related papers  (2026-07-07T19:54:16Z)
• Causal Effect Estimation with Latent Textual Treatments [9.451877252547197]
  We present an end-to-end pipeline for the generation and causal estimation of latent textual interventions.<n>Our work first performs hypothesis generation and steering via sparse autoencoders (SAEs), followed by robust causal estimation.
  arXiv  Detail & Related papers  (2026-02-17T17:06:12Z)
• Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship [54.575090553659074]
  We develop an algorithm that efficiently uncovers causal relationships with quadratic complexity in the number of observational variables.<n>Our experiments on a varied benchmark of large-scale datasets show superior or equivalent performance compared to existing works.
  arXiv  Detail & Related papers  (2026-02-03T10:26:16Z)
• Data Fusion for Partial Identification of Causal Effects [62.56890808004615]
  We propose a novel partial identification framework that enables researchers to answer key questions.<n>Is the causal effect positive or negative? and How severe must assumption violations be to overturn this conclusion?<n>We apply our framework to the Project STAR study, which investigates the effect of classroom size on students' third-grade standardized test performance.
  arXiv  Detail & Related papers  (2025-05-30T07:13:01Z)
• Black Box Causal Inference: Effect Estimation via Meta Prediction [56.277798874118425]
  We frame causal inference as a dataset-level prediction problem, offloading algorithm design to the learning process.<n>We introduce, called black box causal inference (BBCI), builds estimators in a black-box manner by learning to predict causal effects from sampled dataset-effect pairs.<n>We demonstrate accurate estimation of average treatment effects (ATEs) and conditional average treatment effects (CATEs) with BBCI across several causal inference problems.
  arXiv  Detail & Related papers  (2025-03-07T23:43:19Z)
• An AI-powered Bayesian generative modeling approach for causal inference in observational studies [4.4876925770439415]
  CausalBGM is an AI-powered Bayesian generative modeling approach.<n>It estimates the individual treatment effect (ITE) by learning individual-specific distributions of a low-dimensional latent feature set.
  arXiv  Detail & Related papers  (2025-01-01T06:52:45Z)
• Large-Scale Targeted Cause Discovery via Learning from Simulated Data [66.51307552703685]
  We propose a novel machine learning approach for inferring causal variables of a target variable from observations.<n>We train a neural network using supervised learning on simulated data to infer causality.<n> Empirical results demonstrate superior performance in identifying causal relationships within large-scale gene regulatory networks.
  arXiv  Detail & Related papers  (2024-08-29T02:21:11Z)
• Do Finetti: On Causal Effects for Exchangeable Data [45.96632286841583]
  We study causal effect estimation in a setting where the data are not i.i.d. We focus on exchangeable data satisfying an assumption of independent causal mechanisms.
  arXiv  Detail & Related papers  (2024-05-29T07:31:18Z)
• BayesIMP: Uncertainty Quantification for Causal Data Fusion [52.184885680729224]
  We study the causal data fusion problem, where datasets pertaining to multiple causal graphs are combined to estimate the average treatment effect of a target variable. We introduce a framework which combines ideas from probabilistic integration and kernel mean embeddings to represent interventional distributions in the reproducing kernel Hilbert space.
  arXiv  Detail & Related papers  (2021-06-07T10:14:18Z)
• Targeted VAE: Variational and Targeted Learning for Causal Inference [39.351088248776435]
  Undertaking causal inference with observational data is incredibly useful across a wide range of tasks. There are two significant challenges associated with undertaking causal inference using observational data. We address these two challenges by combining structured inference and targeted learning.
  arXiv  Detail & Related papers  (2020-09-28T16:55:24Z)
• Estimating Causal Effects with the Neural Autoregressive Density Estimator [6.59529078336196]
  We use neural autoregressive density estimators to estimate causal effects within the Pearl's do-calculus framework. We show that the approach can retrieve causal effects from non-linear systems without explicitly modeling the interactions between the variables.
  arXiv  Detail & Related papers  (2020-08-17T13:12:38Z)
• Progressive Graph Learning for Open-Set Domain Adaptation [48.758366879597965]
  Domain shift is a fundamental problem in visual recognition which typically arises when the source and target data follow different distributions. In this paper, we tackle a more realistic problem of open-set domain shift where the target data contains additional classes that are not present in the source data. We introduce an end-to-end Progressive Graph Learning framework where a graph neural network with episodic training is integrated to suppress underlying conditional shift.
  arXiv  Detail & Related papers  (2020-06-22T09:10:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.