The impact of AI and peer feedback on research writing skills: a study using the CGScholar platform among Kazakhstani scholars

• URL: http://arxiv.org/abs/2503.05820v1
• Date: Wed, 05 Mar 2025 04:34:25 GMT
• Title: The impact of AI and peer feedback on research writing skills: a study using the CGScholar platform among Kazakhstani scholars
• Authors: Raigul Zheldibayeva,
• Abstract summary: This research studies the impact of AI and peer feedback on the academic writing development of Kazakhstani scholars using the CGScholar platform.<n>The study aimed to find out how familiarity with AI tools and peer feedback processes impacts participants' openness to incorporating feedback into their academic writing.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This research studies the impact of AI and peer feedback on the academic writing development of Kazakhstani scholars using the CGScholar platform - a product of research into collaborative learning, big data, and artificial intelligence developed by educators and computer scientists at the University of Illinois at Urbana-Champaign (UIUC). The study aimed to find out how familiarity with AI tools and peer feedback processes impacts participants' openness to incorporating feedback into their academic writing. The study involved 36 scholars enrolled in a scientific internship focused on education at UIUC. A survey with 15 multiple-choice questions, a Likert scale, and open-ended questions was used to collect data. The survey was conducted via Google Forms in both English and Russian to ensure linguistic accessibility. Demographic information such as age, gender, and first language was collected to provide a detailed understanding of the data. The analysis revealed a moderate positive correlation between familiarity with AI tools and openness to making changes based on feedback, and a strong positive correlation between research writing experience and expectations of peer feedback, especially in the area of research methodology. These results show that participants are open-minded to AI-assisted feedback; however, they still highly appreciate peer input, especially regarding methodological guidance. This study demonstrates the potential benefits of integrating AI tools with traditional feedback mechanisms to improve research writing quality in academic settings.

Related papers

• Evaluating the AI-Lab Intervention: Impact on Student Perception and Use of Generative AI in Early Undergraduate Computer Science Courses [0.0]
  Generative AI (GenAI) is rapidly entering computer science education. Concerns about overreliance coexist with a gap in research on structured scaffolding to guide tool use in formal courses. This study examines the impact of a dedicated "AI-Lab" intervention on undergraduate students.
  arXiv  Detail & Related papers  (2025-04-30T18:12:42Z)
• Artificial Intelligence in Sports: Insights from a Quantitative Survey among Sports Students in Germany about their Perceptions, Expectations, and Concerns regarding the Use of AI Tools [0.0]
  The manuscript presents findings from a quantitative survey conducted among sports students of all semesters in Germany. Students express confidence that the proliferation of AI will not compromise their critical thinking skills. Students have concerns about plagiarism, lecturer preparedness and their own skills and future skill development.
  arXiv  Detail & Related papers  (2025-02-27T05:37:53Z)
• Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
  A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently.<n>Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
  arXiv  Detail & Related papers  (2025-02-07T18:26:45Z)
• Generative AI for Analyzing Participatory Rural Appraisal Data: An Exploratory Case Study in Gender Research [0.0]
  This study explores the novel application of Generative Artificial Intelligence (GenAI) in analyzing unstructured visual data generated through Participatory Rural Appraisal (PRA)<n>Using the "Ideal Village" PRA activity as a case study, we evaluate three state-of-the-art Large Language Models (LLMs) in their ability to interpret hand-drawn artifacts containing multilingual content from various Indian states.<n>Our findings reveal significant challenges in AI's current capabilities to process such unstructured data, particularly in handling multilingual content, maintaining contextual accuracy, and avoiding hallucinations.
  arXiv  Detail & Related papers  (2025-02-02T11:55:52Z)
• The Impact of AI-Driven Tools on Student Writing Development: A Case Study From The CGScholar AI Helper Project [1.1234721101613931]
  The case study examines the impact of the CGScholar (Common Ground Scholar) AI Helper on a pilot research initiative involving the writing development of 11th-grade students in English Language Arts (ELA)<n>CGScholar AI Helper is an evolving and innovative web-based application designed to support students in their writing tasks by providing specified AI-generated feedback.
  arXiv  Detail & Related papers  (2025-01-14T22:38:14Z)
• Analyzing the Impact of AI Tools on Student Study Habits and Academic Performance [0.0]
  The research focuses on how AI tools can support personalized learning, adaptive test adjustments, and provide real-time classroom analysis.<n>Student feedback revealed strong support for these features, and the study found a significant reduction in study hours alongside an increase in GPA.<n>Despite these benefits, challenges such as over-reliance on AI and difficulties in integrating AI with traditional teaching methods were also identified.
  arXiv  Detail & Related papers  (2024-12-03T04:51:57Z)
• Augmenting the Author: Exploring the Potential of AI Collaboration in Academic Writing [25.572926673827165]
  This case study highlights the importance of prompt design, output analysis, and recognizing the AI's limitations to ensure responsible and effective AI integration in scholarly work. The paper contributes to the field of Human-Computer Interaction by exploring effective prompt strategies and providing a comparative analysis of Gen AI models.
  arXiv  Detail & Related papers  (2024-04-23T19:06:39Z)
• SurveyAgent: A Conversational System for Personalized and Efficient Research Survey [50.04283471107001]
  This paper introduces SurveyAgent, a novel conversational system designed to provide personalized and efficient research survey assistance to researchers. SurveyAgent integrates three key modules: Knowledge Management for organizing papers, Recommendation for discovering relevant literature, and Query Answering for engaging with content on a deeper level. Our evaluation demonstrates SurveyAgent's effectiveness in streamlining research activities, showcasing its capability to facilitate how researchers interact with scientific literature.
  arXiv  Detail & Related papers  (2024-04-09T15:01:51Z)
• A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [55.33653554387953]
  Pattern Analysis and Machine Intelligence (PAMI) has led to numerous literature reviews aimed at collecting and fragmented information.<n>This paper presents a thorough analysis of these literature reviews within the PAMI field.<n>We try to address three core research questions: (1) What are the prevalent structural and statistical characteristics of PAMI literature reviews; (2) What strategies can researchers employ to efficiently navigate the growing corpus of reviews; and (3) What are the advantages and limitations of AI-generated reviews compared to human-authored ones.
  arXiv  Detail & Related papers  (2024-02-20T11:28:50Z)
• Experimental Evidence on Negative Impact of Generative AI on Scientific Learning Outcomes [0.0]
  Using AI for summarization significantly improved both quality and output. Individuals with a robust background in the reading topic and superior reading/writing skills benefitted the most.
  arXiv  Detail & Related papers  (2023-09-23T21:59:40Z)
• Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach [77.61131357420201]
  We conduct a thorough and rigorous study on fairness disparities in peer review with the help of large language models (LMs) We collect, assemble, and maintain a comprehensive relational database for the International Conference on Learning Representations (ICLR) conference from 2017 to date. We postulate and study fairness disparities on multiple protective attributes of interest, including author gender, geography, author, and institutional prestige.
  arXiv  Detail & Related papers  (2022-11-07T16:19:42Z)
• Neural Approaches to Conversational Information Retrieval [94.77863916314979]
  A conversational information retrieval (CIR) system is an information retrieval (IR) system with a conversational interface. Recent progress in deep learning has brought tremendous improvements in natural language processing (NLP) and conversational AI. This book surveys recent advances in CIR, focusing on neural approaches that have been developed in the last few years.
  arXiv  Detail & Related papers  (2022-01-13T19:04:59Z)
• Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir" [76.44130385507894]
  This paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices. Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design.
  arXiv  Detail & Related papers  (2021-11-01T17:57:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.