From First Patch to Long-Term Contributor: Evaluating Onboarding Recommendations for OSS Newcomers

• URL: http://arxiv.org/abs/2407.04159v2
• Date: Sun, 09 Mar 2025 03:11:34 GMT
• Title: From First Patch to Long-Term Contributor: Evaluating Onboarding Recommendations for OSS Newcomers
• Authors: Asif Kamal Turzo, Sayma Sultana, Amiangshu Bosu,
• Abstract summary: There are two key research gaps regarding recommendations for newcomers to open-source software (OSS) projects.<n>First, most of the existing recommendations are based on a limited number of projects, which raises concerns about their generalizability.<n>Second, it's unclear whether these recommendations also apply to experienced contributors.
• Score: 3.673153666095999
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Attracting and retaining a steady stream of new contributors is crucial to ensuring the long-term survival of open-source software (OSS) projects. However, there are two key research gaps regarding recommendations for onboarding new contributors to OSS projects. First, most of the existing recommendations are based on a limited number of projects, which raises concerns about their generalizability. If a recommendation yields conflicting results in a different context, it could hinder a newcomer's onboarding process rather than help them. Second, it's unclear whether these recommendations also apply to experienced contributors. If certain recommendations are specific to newcomers, continuing to follow them after their initial contributions are accepted could hinder their chances of becoming long-term contributors. To address these gaps, we conducted a two-stage mixed-method study. In the first stage, we conducted a Systematic Literature Review (SLR) and identified 15 task-related actionable recommendations that newcomers to OSS projects can follow to improve their odds of successful onboarding. In the second stage, we conduct a large-scale empirical study of five Gerrit-based projects and 1,155 OSS projects from GitHub to assess whether those recommendations assist newcomers' successful onboarding. Our results suggest that four recommendations positively correlate with newcomers' first patch acceptance in most contexts. Four recommendations are context-dependent, and four indicate significant negative associations for most projects. Our results also found three newcomer-specific recommendations, which OSS joiners should abandon at non-newcomer status to increase their odds of becoming long-term contributors.

Related papers

• Do Good, Stay Longer? Temporal Patterns and Predictors of Newcomer-to-Core Transitions in Conventional OSS and OSS4SG [3.2952032218821565]
  OSS4SG projects retain contributors at 2.2X higher rates and contributors have 19.6% higher probability of achieving core status.<n>Our findings suggest that finding a project aligned with personal values and taking time to understand the before major contributions are key strategies for achieving core status.
  arXiv  Detail & Related papers  (2026-01-30T16:30:25Z)
• Revolutionizing Newcomers' Onboarding Process in OSS Communities: The Future AI Mentor [14.957282851088479]
  Onboarding newcomers is vital for the sustainability of open-source software (OSS) projects.<n>To lower barriers and increase engagement, OSS projects have dedicated experts who provide guidance for newcomers.<n>The recent rapid advancements of AI in software engineering have brought opportunities to leverage AI as a substitute for expert mentoring.
  arXiv  Detail & Related papers  (2025-05-07T09:27:41Z)
• Reason4Rec: Large Language Models for Recommendation with Deliberative User Preference Alignment [69.11529841118671]
  We propose a new Deliberative Recommendation task, which incorporates explicit reasoning about user preferences as an additional alignment goal. We then introduce the Reasoning-powered Recommender framework for deliberative user preference alignment.
  arXiv  Detail & Related papers  (2025-02-04T07:17:54Z)
• CURE4Rec: A Benchmark for Recommendation Unlearning with Deeper Influence [55.21518669075263]
  CURE4Rec is the first comprehensive benchmark for recommendation unlearning evaluation. We consider the deeper influence of unlearning on recommendation fairness and robustness towards data with varying impact levels.
  arXiv  Detail & Related papers  (2024-08-26T16:21:50Z)
• Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process [12.742338558480064]
  We compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system.
  arXiv  Detail & Related papers  (2024-06-13T09:44:04Z)
• How to Gain Commit Rights in Modern Top Open Source Communities? [14.72524623433377]
  We study the policies and practical implementations of committer qualifications in modern top OSS communities. We construct a taxonomy of committer qualifications, consisting of 26 codes categorized into nine themes. We find that the probability of gaining commit rights decreases as participation time passes.
  arXiv  Detail & Related papers  (2024-05-03T01:23:06Z)
• Personalized First Issue Recommender for Newcomers in Open Source Projects [12.444293953494032]
  We analyze 37 newcomers and their first issues resolved across multiple projects. We find that the first issues resolved by the same newcomer share similarities in task type, programming language, and project domain. We propose a Personalized First Issue Recommender (PFIRec) to rank candidate issues for a given newcomer by leveraging the identified influential features.
  arXiv  Detail & Related papers  (2023-08-17T15:19:13Z)
• An Exploratory Study on the Evidence of Hackathons' Role in Solving OSS Newcomers' Challenges [54.56931759953522]
  We aim to understand and discuss the challenges newcomers face when joining an OSS project. We collect evidence on how hackathons were used to address those challenges.
  arXiv  Detail & Related papers  (2023-05-16T15:40:19Z)
• Attracting and Retaining OSS Contributors with a Maintainer Dashboard [19.885747206499712]
  We design a maintainer dashboard that provides recommendations on how to attract and retain open source contributors. We conduct a project-specific evaluation with maintainers to better understand use cases in which this tool will be most helpful. We distill our findings to share what the future of recommendations in open source looks like and how to make these recommendations most meaningful over time.
  arXiv  Detail & Related papers  (2022-02-15T21:39:37Z)
• Measuring "Why" in Recommender Systems: a Comprehensive Survey on the Evaluation of Explainable Recommendation [87.82664566721917]
  This survey is based on more than 100 papers from top-tier conferences like IJCAI, AAAI, TheWebConf, Recsys, UMAP, and IUI.
  arXiv  Detail & Related papers  (2022-02-14T02:58:55Z)
• Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good [17.145094780239564]
  We conducted 21 semi-structured interviews with OSS for Social Good contributors. We find that the majority of contributors demonstrate a distinction between OSS4SG and OSS. OSS4SG contributors evaluate the owners of the project significantly more than OSS contributors.
  arXiv  Detail & Related papers  (2021-04-26T21:50:11Z)
• Fairness-Aware Explainable Recommendation over Knowledge Graphs [73.81994676695346]
  We analyze different groups of users according to their level of activity, and find that bias exists in recommendation performance between different groups. We show that inactive users may be more susceptible to receiving unsatisfactory recommendations, due to insufficient training data for the inactive users. We propose a fairness constrained approach via re-ranking to mitigate this problem in the context of explainable recommendation over knowledge graphs.
  arXiv  Detail & Related papers  (2020-06-03T05:04:38Z)
• Reward Constrained Interactive Recommendation with Natural Language Feedback [158.8095688415973]
  We propose a novel constraint-augmented reinforcement learning (RL) framework to efficiently incorporate user preferences over time. Specifically, we leverage a discriminator to detect recommendations violating user historical preference. Our proposed framework is general and is further extended to the task of constrained text generation.
  arXiv  Detail & Related papers  (2020-05-04T16:23:34Z)
• A Survey on Knowledge Graph-Based Recommender Systems [65.50486149662564]
  We conduct a systematical survey of knowledge graph-based recommender systems. We focus on how the papers utilize the knowledge graph for accurate and explainable recommendation. We introduce datasets used in these works.
  arXiv  Detail & Related papers  (2020-02-28T02:26:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.