Measuring the Invisible: Evaluating the Impact of Public Funding on Open Source Software

• URL: http://arxiv.org/abs/2607.05413v1
• Date: Tue, 16 Jun 2026 10:59:48 GMT
• Title: Measuring the Invisible: Evaluating the Impact of Public Funding on Open Source Software
• Abstract summary: Open Source Software (OSS) forms a critical layer of contemporary digital infrastructure, yet remains largely overlooked by the institutions and societies that depend on it.<n>Despite growing institutional interest, the causal impact of public funding on OSS project sustainability remains empirically unresolved.<n>This work combines a Goal-Metric framework with the Generalized Synthetic Control Method to estimate the causal effect of the Sovereign Tech Fund on OSS repository activity.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Open Source Software (OSS) forms a critical layer of contemporary digital infrastructure, yet remains largely overlooked by the institutions and societies that depend on it. Despite growing institutional interest, the causal impact of public funding on OSS project sustainability remains empirically unresolved. Existing literature is divided between econometric and socio-technical approaches with few attempts at causal identification. This work aims to bridge that divide by combining a Goal-Question-Metric framework with the Generalized Synthetic Control Method to estimate the causal effect of the Sovereign Tech Fund on OSS repository activity. Counterfactual trajectories are constructed from a matched donor pool of unfunded projects, enabling identification of what funded repositories would have looked like in the absence of intervention. The main results show that the funding has a significant positive effect on project velocity metrics: commits, pull requests --both merged and new ones--, and new issues. There is no significant effect on the number of releases, contributors or closed issues. This indicates that the STF funding mobilises existing development activity rather than expanding the contributor base or accelerating backlog resolution. These findings carry practical implications for the design of public OSS funding evaluation frameworks, where assessment metrics should be matched to programme objectives rather than applied uniformly across interventions.

Related papers

• TAPO: Tool-Aware Policy Optimization via Credit Transfer for Multimodal Search Agents [54.08846865906602]
  We characterize credit misassignment as a systematic failure mode of GRPO in tool-augmented multimodal search agents.<n>We propose Tool-Aware Policy Optimization (TAPO), which exploits the parameter-determinism property of information-acquisition tools.
  arXiv  Detail & Related papers  (2026-06-04T07:15:43Z)
• Perception Without Engagement: Dissecting the Causal Discovery Deficit in LMMs [68.58207076756237]
  We introduce ProCauEval, a perturbation-based evaluation protocol that shifts from outcome assessment to mechanism diagnosis.<n>We find that models faithfully perceive video content yet systematically underexploit it during causal reasoning.<n>We propose Anti-Distillation Policy Optimization (ADPO), a reinforcement learning framework built on negative teacher alignment.
  arXiv  Detail & Related papers  (2026-05-10T08:48:58Z)
• Bye Bye Perspective API: Lessons for Measurement Infrastructure in NLP, CSS and LLM Evaluation [5.257562413412994]
  Perspective API at the end of 2026 discards what has functioned as the de facto standard for automated toxicity measurement.<n>We document the structural dependence that the communities built on this single proprietary tool.<n>We call for an independent, valid, adaptable, and reproducible toxicity and hate speech measurement infrastructure.
  arXiv  Detail & Related papers  (2026-04-28T12:49:54Z)
• Evaluating LLMs in Finance Requires Explicit Bias Consideration [88.38155218924999]
  Finance-specific biases can inflate performance, contaminate backtests, and make reported results useless for deployment claims.<n>No single bias is discussed in more than 28 percent of studies.<n>We propose a Structural Validity Framework and an evaluation checklist with minimal requirements for bias diagnosis and future system design.
  arXiv  Detail & Related papers  (2026-02-15T17:02:01Z)
• Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science [70.3658845234978]
  Large Language Models (LLMs) have greatly extended the capabilities of Multi-Agent Systems (MAS)<n>Despite this rapid progress, the field still relies heavily on empirical trial-and-error.<n>This bottleneck stems from the ambiguity of attribution.<n>We propose a factor attribution paradigm to systematically identify collaboration-driving factors.
  arXiv  Detail & Related papers  (2026-02-05T04:19:52Z)
• Governance Matters: Lessons from Restructuring the data.table OSS Project [7.308586458018547]
  Data.table is a high-performance R package widely adopted in production analytics pipelines.<n>Before the reform, data.table faced a growing backlog of unresolved issues and open pull requests.<n>Following the reform, the project experienced a 200% increase in new contributor recruitment, a drop in pull request resolution time from over 700 days to under a week, and a 3x increase in contributor retention.
  arXiv  Detail & Related papers  (2026-01-19T23:41:18Z)
• Data Fusion for Partial Identification of Causal Effects [62.56890808004615]
  We propose a novel partial identification framework that enables researchers to answer key questions.<n>Is the causal effect positive or negative? and How severe must assumption violations be to overturn this conclusion?<n>We apply our framework to the Project STAR study, which investigates the effect of classroom size on students' third-grade standardized test performance.
  arXiv  Detail & Related papers  (2025-05-30T07:13:01Z)
• Exploring the Susceptibility to Fraud of Monetary Incentive Mechanisms for Strengthening FOSS Projects [0.0]
  We find non-commercial incentives to fill an important gap, ensuring longevity and sustainability of projects.<n>We find the Sovereign Tech Fund to be able to achieve a high resilience against fraud attempts, while tea is highly susceptible to fraud.
  arXiv  Detail & Related papers  (2025-05-09T09:05:38Z)
• An Overview of Cyber Security Funding for Open Source Software [3.5880059456896842]
  The paper examines two such funding bodies for OSS and the projects they have funded.<n>The focus of both funding bodies is on software security and cyber security in general.
  arXiv  Detail & Related papers  (2024-12-08T10:48:30Z)
• A Toolkit for Measuring the Impacts of Public Funding on Open Source Software Development [0.0]
  Impacts of public funding on open source software development remain poorly understood. We present a taxonomy of potential social, economic, and technological impacts that can be both positive and negative. With this toolkit, we contribute to the multi-stakeholder conversation about the value and impacts of funding on OSS developers and society at large.
  arXiv  Detail & Related papers  (2024-11-09T01:13:45Z)
• Public-private funding models in open source software development: A case study on scikit-learn [0.0]
  This study is a case study on scikit-learn, a Python library for machine learning funded by public research grants, commercial sponsorship, micro-donations, and a 32 euro million grant announced in France's artificial intelligence strategy. Through 25 interviews with scikit-learn's maintainers and funders, this study makes two key contributions. It contributes empirical findings about the benefits and drawbacks of public and private funding in an impactful OSS project, and the governance protocols employed by the maintainers to balance the diverse interests of their community and funders.
  arXiv  Detail & Related papers  (2024-04-09T17:35:11Z)
• Contingency-Aware Influence Maximization: A Reinforcement Learning Approach [52.109536198330126]
  influence (IM) problem aims at finding a subset of seed nodes in a social network that maximize the spread of influence. In this study, we focus on a sub-class of IM problems, where whether the nodes are willing to be the seeds when being invited is uncertain, called contingency-aware IM. Despite the initial success, a major practical obstacle in promoting the solutions to more communities is the tremendous runtime of the greedy algorithms.
  arXiv  Detail & Related papers  (2021-06-13T16:42:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.