Revolutionizing Newcomers' Onboarding Process in OSS Communities: The Future AI Mentor

• URL: http://arxiv.org/abs/2505.04277v1
• Date: Wed, 07 May 2025 09:27:41 GMT
• Title: Revolutionizing Newcomers' Onboarding Process in OSS Communities: The Future AI Mentor
• Abstract summary: Onboarding newcomers is vital for the sustainability of open-source software (OSS) projects.<n>To lower barriers and increase engagement, OSS projects have dedicated experts who provide guidance for newcomers.<n>The recent rapid advancements of AI in software engineering have brought opportunities to leverage AI as a substitute for expert mentoring.
• Score: 14.957282851088479
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Onboarding newcomers is vital for the sustainability of open-source software (OSS) projects. To lower barriers and increase engagement, OSS projects have dedicated experts who provide guidance for newcomers. However, timely responses are often hindered by experts' busy schedules. The recent rapid advancements of AI in software engineering have brought opportunities to leverage AI as a substitute for expert mentoring. However, the potential role of AI as a comprehensive mentor throughout the entire onboarding process remains unexplored. To identify design strategies of this ``AI mentor'', we applied Design Fiction as a participatory method with 19 OSS newcomers. We investigated their current onboarding experience and elicited 32 design strategies for future AI mentor. Participants envisioned AI mentor being integrated into OSS platforms like GitHub, where it could offer assistance to newcomers, such as ``recommending projects based on personalized requirements'' and ``assessing and categorizing project issues by difficulty''. We also collected participants' perceptions of a prototype, named ``OSSerCopilot'', that implemented the envisioned strategies. They found the interface useful and user-friendly, showing a willingness to use it in the future, which suggests the design strategies are effective. Finally, in order to identify the gaps between our design strategies and current research, we conducted a comprehensive literature review, evaluating the extent of existing research support for this concept. We find that research is relatively scarce in certain areas where newcomers highly anticipate AI mentor assistance, such as ``discovering an interested project''. Our study has the potential to revolutionize the current newcomer-expert mentorship and provides valuable insights for researchers and tool designers aiming to develop and enhance AI mentor systems.

Related papers

• Let the Barbarians In: How AI Can Accelerate Systems Performance Research [80.43506848683633]
  We term this iterative cycle of generation, evaluation, and refinement AI-Driven Research for Systems.<n>We demonstrate that ADRS-generated solutions can match or even outperform human state-of-the-art designs.
  arXiv  Detail & Related papers  (2025-12-16T18:51:23Z)
• Learning to Code with Context: A Study-Based Approach [0.28675177318965045]
  The rapid emergence of generative AI tools is transforming the way software is developed.<n>Project-based courses offer an effective environment to explore and evaluate the integration of AI assistance into real-world development practices.<n>This paper presents our approach and a user study conducted within a university programming project in which students collaboratively developed computer games.
  arXiv  Detail & Related papers  (2025-12-04T20:40:36Z)
• DIP-AI: A Discovery Framework for AI Innovation Projects [1.3704574906282525]
  This research contributes to academia by sharing DIP-AI as a framework for AI problem discovery.<n>For industry, we discuss the use of this framework in a real IAC program that develops AI innovation projects.
  arXiv  Detail & Related papers  (2025-10-20T18:48:29Z)
• AI That Helps Us Help Each Other: A Proactive System for Scaffolding Mentor-Novice Collaboration in Entrepreneurship Coaching [3.101600812051321]
  Entrepreneurship requires navigating open-ended, ill-defined problems.<n>We present a human-AI coaching system that scaffolds both novice and mentor thinking.
  arXiv  Detail & Related papers  (2025-08-14T20:23:48Z)
• Facilitating Longitudinal Interaction Studies of AI Systems [45.430296301751895]
  UIST researchers develop tools to address user challenges.<n>User interactions with AI evolve over time through learning, adaptation, and repurposing, making one time evaluations insufficient.<n>Our workshop aims to tackle these challenges and prepare researchers with practical strategies for longitudinal studies.
  arXiv  Detail & Related papers  (2025-08-14T00:38:23Z)
• Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creation [15.100530378569866]
  We envision novel metacognitive support agents that assist designers in working more reflectively with GenAI.<n>We conducted exploratory prototyping through a Wizard of Oz elicitation study with 20 mechanical designers probing multiple metacognitive support strategies.<n>We found that agent-supported users created more feasible designs than non-supported users, with differing impacts between support strategies.
  arXiv  Detail & Related papers  (2025-06-15T15:09:37Z)
• Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support [23.409008559160256]
  We introduce and evaluate Codellaborator, a design probe agent that initiates programming assistance based on editor activities and task context.<n>We find that proactive agents increase efficiency compared to prompt-only paradigm, but also incur workflow disruptions.
  arXiv  Detail & Related papers  (2025-02-25T21:37:25Z)
• O1 Replication Journey: A Strategic Progress Report -- Part 1 [52.062216849476776]
  This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey. Our methodology addresses critical challenges in modern AI research, including the insularity of prolonged team-based projects. We propose the journey learning paradigm, which encourages models to learn not just shortcuts, but the complete exploration process.
  arXiv  Detail & Related papers  (2024-10-08T15:13:01Z)
• Future of Artificial Intelligence in Agile Software Development [0.0]
  AI can assist software development managers, software testers, and other team members by leveraging LLMs, GenAI models, and AI agents. AI has the potential to increase efficiency and reduce the risks encountered by the project management team.
  arXiv  Detail & Related papers  (2024-08-01T16:49:50Z)
• Networking Systems for Video Anomaly Detection: A Tutorial and Survey [55.28514053969056]
  Video Anomaly Detection (VAD) is a fundamental research task within the Artificial Intelligence (AI) community.<n>With the advancements in deep learning and edge computing, VAD has made significant progress.<n>This article offers an exhaustive tutorial for novices in NSVAD.
  arXiv  Detail & Related papers  (2024-05-16T02:00:44Z)
• Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory Study [6.028558240668647]
  We partner with a primary school to develop a constructionist curriculum centered on students interacting with a generative AI technology. We provide a detailed account of the design of and outputs from the curriculum and learning materials, finding centrally that the reflexive and prolonged hands-on' approach led to a co-development of students' practical and critical competencies.
  arXiv  Detail & Related papers  (2024-05-07T21:34:10Z)
• Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits [54.648819983899614]
  General purpose AI seems to have lowered the barriers for the public to use AI and harness its power. We introduce PARTICIP-AI, a framework for laypeople to speculate and assess AI use cases and their impacts.
  arXiv  Detail & Related papers  (2024-03-21T19:12:37Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice [64.29355073494125]
  This article aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation. We articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners.
  arXiv  Detail & Related papers  (2023-10-02T05:30:42Z)
• Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir" [76.44130385507894]
  This paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices. Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design.
  arXiv  Detail & Related papers  (2021-11-01T17:57:04Z)
• aiSTROM -- A roadmap for developing a successful AI strategy [3.5788754401889014]
  A total of 34% of AI research and development projects fails or are abandoned, according to a recent survey by Rackspace Technology. We propose a new strategic framework, aiSTROM, that empowers managers to create a successful AI strategy.
  arXiv  Detail & Related papers  (2021-06-25T08:40:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.