Many bioinformatics programming tasks can be automated with ChatGPT
- URL: http://arxiv.org/abs/2303.13528v1
- Date: Tue, 7 Mar 2023 23:32:17 GMT
- Title: Many bioinformatics programming tasks can be automated with ChatGPT
- Authors: Stephen R. Piccolo, Paul Denny, Andrew Luxton-Reilly, Samuel Payne,
Perry G. Ridge
- Abstract summary: Recent advances in artificial intelligence have made it possible to translate human-language prompts to functional code.
We evaluated the extent to which one such model -- OpenAI's ChatGPT -- can successfully complete basic- to moderate-level programming tasks.
- Score: 3.2698789104455677
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Computer programming is a fundamental tool for life scientists, allowing them
to carry out many essential research tasks. However, despite a variety of
educational efforts, learning to write code can be a challenging endeavor for
both researchers and students in life science disciplines. Recent advances in
artificial intelligence have made it possible to translate human-language
prompts to functional code, raising questions about whether these technologies
can aid (or replace) life scientists' efforts to write code. Using 184
programming exercises from an introductory-bioinformatics course, we evaluated
the extent to which one such model -- OpenAI's ChatGPT -- can successfully
complete basic- to moderate-level programming tasks. On its first attempt,
ChatGPT solved 139 (75.5%) of the exercises. For the remaining exercises, we
provided natural-language feedback to the model, prompting it to try different
approaches. Within 7 or fewer attempts, ChatGPT solved 179 (97.3%) of the
exercises. These findings have important implications for life-sciences
research and education. For many programming tasks, researchers no longer need
to write code from scratch. Instead, machine-learning models may produce usable
solutions. Instructors may need to adapt their pedagogical approaches and
assessment techniques to account for these new capabilities that are available
to the general public.
Related papers
- ChatGPT as a Solver and Grader of Programming Exams written in Spanish [3.8984586307450093]
We assess ChatGPT's capacities to solve and grade real programming exams.
Our findings suggest that this AI model is only effective for solving simple coding tasks.
Its proficiency in tackling complex problems or evaluating solutions authored by others are far from effective.
arXiv Detail & Related papers (2024-09-23T15:20:07Z) - Evaluating Contextually Personalized Programming Exercises Created with Generative AI [4.046163999707179]
This article reports on a user study conducted in an elective programming course that included contextually personalized programming exercises created with GPT-4.
The results demonstrate that the quality of exercises generated with GPT-4 was generally high.
This suggests that AI-generated programming problems can be a worthwhile addition to introductory programming courses.
arXiv Detail & Related papers (2024-06-11T12:59:52Z) - Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models [54.58108387797138]
We investigate the effectiveness of prompt learning in code intelligence tasks.
Existing automatic prompt design methods are very limited to code intelligence tasks.
We propose Genetic Auto Prompt (GenAP) which utilizes an elaborate genetic algorithm to automatically design prompts.
arXiv Detail & Related papers (2024-03-20T13:37:00Z) - Kattis vs. ChatGPT: Assessment and Evaluation of Programming Tasks in
the Age of Artificial Intelligence [0.0]
The effectiveness of using large language models for solving programming tasks has been underexplored.
The present study examines ChatGPT's ability to generate code solutions at different difficulty levels for introductory programming courses.
Results contribute to the ongoing debate on the utility of AI-powered tools in programming education.
arXiv Detail & Related papers (2023-12-02T11:09:17Z) - Towards Coding Social Science Datasets with Language Models [4.280286557747323]
Researchers often rely on humans to code (label, annotate, etc.) large sets of texts.
Recent advances in a specific kind of artificial intelligence tool - language models (LMs) - provide a solution.
We find that GPT-3 can match the performance of typical human coders and offers benefits over other machine learning methods of coding text.
arXiv Detail & Related papers (2023-06-03T19:11:34Z) - ChatGPT, Can You Generate Solutions for my Coding Exercises? An
Evaluation on its Effectiveness in an undergraduate Java Programming Course [4.779196219827508]
ChatGPT is a large-scale, deep learning-driven natural language processing model.
Our evaluation involves analyzing ChatGPT-generated solutions for 80 diverse programming exercises.
arXiv Detail & Related papers (2023-05-23T04:38:37Z) - A Survey of Deep Learning for Mathematical Reasoning [71.88150173381153]
We review the key tasks, datasets, and methods at the intersection of mathematical reasoning and deep learning over the past decade.
Recent advances in large-scale neural language models have opened up new benchmarks and opportunities to use deep learning for mathematical reasoning.
arXiv Detail & Related papers (2022-12-20T18:46:16Z) - Giving Feedback on Interactive Student Programs with Meta-Exploration [74.5597783609281]
Developing interactive software, such as websites or games, is a particularly engaging way to learn computer science.
Standard approaches require instructors to manually grade student-implemented interactive programs.
Online platforms that serve millions, like Code.org, are unable to provide any feedback on assignments for implementing interactive programs.
arXiv Detail & Related papers (2022-11-16T10:00:23Z) - Competition-Level Code Generation with AlphaCode [74.87216298566942]
We introduce AlphaCode, a system for code generation that can create novel solutions to problems that require deeper reasoning.
In simulated evaluations on recent programming competitions on the Codeforces platform, AlphaCode achieved on average a ranking of top 54.3%.
arXiv Detail & Related papers (2022-02-08T23:16:31Z) - ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback [54.142719510638614]
In this paper, we frame the problem of providing feedback as few-shot classification.
A meta-learner adapts to give feedback to student code on a new programming question from just a few examples by instructors.
Our approach was successfully deployed to deliver feedback to 16,000 student exam-solutions in a programming course offered by a tier 1 university.
arXiv Detail & Related papers (2021-07-23T22:41:28Z) - Ten Quick Tips for Deep Learning in Biology [116.78436313026478]
Machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling.
Deep learning has become its own subfield of machine learning.
In the context of biological research, deep learning has been increasingly used to derive novel insights from high-dimensional biological data.
arXiv Detail & Related papers (2021-05-29T21:02:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.