Is AI the better programming partner? Human-Human Pair Programming vs.
Human-AI pAIr Programming
- URL: http://arxiv.org/abs/2306.05153v2
- Date: Fri, 9 Jun 2023 01:08:40 GMT
- Title: Is AI the better programming partner? Human-Human Pair Programming vs.
Human-AI pAIr Programming
- Authors: Qianou Ma, Tongshuang Wu, Kenneth Koedinger
- Abstract summary: We compare human-human and human-AI pair programming, exploring their similarities and differences in interaction, measures, benefits, and challenges.
We find that the effectiveness of both approaches is mixed in the literature.
We summarize factors on the success of human-human pair programming, which provides opportunities for pAIr programming research.
- Score: 18.635201328291597
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The emergence of large-language models (LLMs) that excel at code generation
and commercial products such as GitHub's Copilot has sparked interest in
human-AI pair programming (referred to as "pAIr programming") where an AI
system collaborates with a human programmer. While traditional pair programming
between humans has been extensively studied, it remains uncertain whether its
findings can be applied to human-AI pair programming. We compare human-human
and human-AI pair programming, exploring their similarities and differences in
interaction, measures, benefits, and challenges. We find that the effectiveness
of both approaches is mixed in the literature (though the measures used for
pAIr programming are not as comprehensive). We summarize moderating factors on
the success of human-human pair programming, which provides opportunities for
pAIr programming research. For example, mismatched expertise makes pair
programming less productive, therefore well-designed AI programming assistants
may adapt to differences in expertise levels.
Related papers
- Rethinking Software Engineering in the Foundation Model Era: From Task-Driven AI Copilots to Goal-Driven AI Pair Programmers [30.996760992473064]
We propose a paradigm shift towards goal-driven AI-powered pair programmers that collaborate with human developers.
We envision AI pair programmers that are goal-driven, human partners, SE-aware, and self-learning.
arXiv Detail & Related papers (2024-04-16T02:10:20Z) - The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond [22.33734581699234]
We advocate for a paradigm where AI is seen as a collaborative co-pilot, working under human guidance rather than as a mere tool.
Our paper proposes a design approach that emphasizes active human engagement, control, and skill enhancement in the AI partnership.
arXiv Detail & Related papers (2023-11-16T13:58:15Z) - AI in Software Engineering: Case Studies and Prospects [2.7064617166078087]
Using AI techniques such as deep learning and machine learning in software systems contributes to intelligent systems.
IBM Watson and Google AlphaGo that use different AI techniques in solving real world challenging problems have been analysed.
arXiv Detail & Related papers (2023-09-27T16:37:05Z) - Applying HCAI in developing effective human-AI teaming: A perspective
from human-AI joint cognitive systems [10.746728034149989]
Research and application have used human-AI teaming (HAT) as a new paradigm to develop AI systems.
We elaborate on our proposed conceptual framework of human-AI joint cognitive systems (HAIJCS)
We propose a conceptual framework of human-AI joint cognitive systems (HAIJCS) to represent and implement HAT.
arXiv Detail & Related papers (2023-07-08T06:26:38Z) - Human-AI Coevolution [48.74579595505374]
Coevolution AI is a process in which humans and AI algorithms continuously influence each other.
This paper introduces Coevolution AI as the cornerstone for a new field of study at the intersection between AI and complexity science.
arXiv Detail & Related papers (2023-06-23T18:10:54Z) - The centaur programmer -- How Kasparov's Advanced Chess spans over to
the software development of the future [0.0]
We introduce the idea of Centaur Programmer, based on the premise that a collaborative approach between humans and AI will be more effective than AI alone.
The paper introduces several collaboration models for programming alongside an AI, including the guidance model, the sketch model, and the inverted control model.
arXiv Detail & Related papers (2023-04-21T14:20:38Z) - Human Decision Makings on Curriculum Reinforcement Learning with
Difficulty Adjustment [52.07473934146584]
We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process.
Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications.
It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
arXiv Detail & Related papers (2022-08-04T23:53:51Z) - Human-Centered AI for Data Science: A Systematic Approach [48.71756559152512]
Human-Centered AI (HCAI) refers to the research effort that aims to design and implement AI techniques to support various human tasks.
We illustrate how we approach HCAI using a series of research projects around Data Science (DS) works as a case study.
arXiv Detail & Related papers (2021-10-03T21:47:13Z) - Joint Mind Modeling for Explanation Generation in Complex Human-Robot
Collaborative Tasks [83.37025218216888]
We propose a novel explainable AI (XAI) framework for achieving human-like communication in human-robot collaborations.
The robot builds a hierarchical mind model of the human user and generates explanations of its own mind as a form of communications.
Results show that the generated explanations of our approach significantly improves the collaboration performance and user perception of the robot.
arXiv Detail & Related papers (2020-07-24T23:35:03Z) - Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork [54.309495231017344]
We argue that AI systems should be trained in a human-centered manner, directly optimized for team performance.
We study this proposal for a specific type of human-AI teaming, where the human overseer chooses to either accept the AI recommendation or solve the task themselves.
Our experiments with linear and non-linear models on real-world, high-stakes datasets show that the most accuracy AI may not lead to highest team performance.
arXiv Detail & Related papers (2020-04-27T19:06:28Z) - Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs [90.20235972293801]
Aiming to understand how human (false-temporal)-belief-a core socio-cognitive ability unify-would affect human interactions with robots, this paper proposes to adopt a graphical model to the representation of object states, robot knowledge, and human (false-)beliefs.
An inference algorithm is derived to fuse individual pg from all robots across multi-views into a joint pg, which affords more effective reasoning inference capability to overcome the errors originated from a single view.
arXiv Detail & Related papers (2020-04-25T23:02:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.