Students' Perception of LLM Use in Requirements Engineering Education: An Empirical Study Across Two Universities

• URL: http://arxiv.org/abs/2509.05995v1
• Date: Sun, 07 Sep 2025 09:52:47 GMT
• Title: Students' Perception of LLM Use in Requirements Engineering Education: An Empirical Study Across Two Universities
• Authors: Sharon Guardado, Risha Parveen, Zheying Zhang, Maruf Rayhan, Nirnaya Tripathi,
• Abstract summary: Large Language Models (LLMs) in Requirements Engineering (RE) education is reshaping pedagogical approaches.<n>This study empirically evaluates the impact of integrating LLMs in RE coursework.<n>Students raised concerns about academic integrity, overreliance on AI, and challenges in integrating AI-generated content into assignments.
• Score: 1.7094085866965287
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The integration of Large Language Models (LLMs) in Requirements Engineering (RE) education is reshaping pedagogical approaches, seeking to enhance student engagement and motivation while providing practical tools to support their professional future. This study empirically evaluates the impact of integrating LLMs in RE coursework. We examined how the guided use of LLMs influenced students' learning experiences, and what benefits and challenges they perceived in using LLMs in RE practices. The study collected survey data from 179 students across two RE courses in two universities. LLMs were integrated into coursework through different instructional formats, i.e., individual assignments versus a team-based Agile project. Our findings indicate that LLMs improved students' comprehension of RE concepts, particularly in tasks like requirements elicitation and documentation. However, students raised concerns about LLMs in education, including academic integrity, overreliance on AI, and challenges in integrating AI-generated content into assignments. Students who worked on individual assignments perceived that they benefited more than those who worked on team-based assignments, highlighting the importance of contextual AI integration. This study offers recommendations for the effective integration of LLMs in RE education. It proposes future research directions for balancing AI-assisted learning with critical thinking and collaborative practices in RE courses.

Related papers

• Demystify, Use, Reflect: Preparing students to be informed LLM-users [12.70014939919203]
  This course introduces Large Language Models (LLMs) in a structured, critical, and practical manner.<n>It aims to help students develop the skills needed to engage meaningfully and responsibly with AI.
  arXiv  Detail & Related papers  (2025-11-14T04:43:49Z)
• Can Large Language Models Help Students Prove Software Correctness? An Experimental Study with Dafny [75.55915044740566]
  Students in computing education increasingly use large language models (LLMs) such as ChatGPT.<n>This paper investigates how students interact with an LLM when solving formal verification exercises in Dafny.
  arXiv  Detail & Related papers  (2025-06-27T16:34:13Z)
• Beyond Answers: How LLMs Can Pursue Strategic Thinking in Education [9.836302410524842]
  Large Language Models (LLMs) can act as both patient tutors and collaborative partners to enhance education delivery.<n>As tutors, LLMs personalize learning by offering step-by-step explanations and addressing individual needs.<n>As collaborators, they expand students' horizons, supporting them in tackling complex, real-world problems.
  arXiv  Detail & Related papers  (2025-04-07T08:09:46Z)
• LLM Agents for Education: Advances and Applications [49.3663528354802]
  Large Language Model (LLM) agents have demonstrated remarkable capabilities in automating tasks and driving innovation across diverse educational applications.<n>This survey aims to provide a comprehensive technological overview of LLM agents for education, fostering further research and collaboration to enhance their impact for the greater good of learners and educators alike.
  arXiv  Detail & Related papers  (2025-03-14T11:53:44Z)
• Position: LLMs Can be Good Tutors in English Education [120.25980336297444]
  Large language models (LLMs) have the potential to serve as effective tutors in English Education.<n>LLMs can play three critical roles: as data enhancers, improving the creation of learning materials or serving as student simulations.
  arXiv  Detail & Related papers  (2025-02-08T06:48:49Z)
• Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students [53.20318273452059]
  Large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education.<n>Despite school restrictions, our survey of over 300 middle and high school students revealed that a remarkable 70% of students have utilized LLMs.<n>We propose a few ideas to address such issues, including subject-specific models, personalized learning, and AI classrooms.
  arXiv  Detail & Related papers  (2024-11-27T19:19:34Z)
• Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs [49.18567856499736]
  We investigate whether large language models (LLMs) can be supportive of open-ended dialogue tutoring.<n>We apply a range of knowledge tracing (KT) methods on the resulting labeled data to track student knowledge levels over an entire dialogue.<n>We conduct experiments on two tutoring dialogue datasets, and show that a novel yet simple LLM-based method, LLMKT, significantly outperforms existing KT methods in predicting student response correctness in dialogues.
  arXiv  Detail & Related papers  (2024-09-24T22:31:39Z)
• I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education [0.0]
  Large Language Models (LLMs) in platforms like Open AI's ChatGPT, has led to their rapid adoption among university students.<n>This study addresses the research question: How does the use of LLMs by students impact Informational and Procedural Justice, influencing Team Trust and Expected Team Performance?<n>Our findings indicate that lecturers are less concerned about the fairness of LLM use per se but are more focused on the transparency of student utilization.
  arXiv  Detail & Related papers  (2024-06-21T05:35:57Z)
• Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing [56.75702900542643]
  We introduce AlphaLLM for the self-improvements of Large Language Models.<n>It integrates Monte Carlo Tree Search (MCTS) with LLMs to establish a self-improving loop.<n>Our experimental results show that AlphaLLM significantly enhances the performance of LLMs without additional annotations.
  arXiv  Detail & Related papers  (2024-04-18T15:21:34Z)
• Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics [0.0]
  The advent of Large Language Models (LLMs) started a serious discussion among educators on how they would affect curricula, assessments, and students' competencies. This report presents an assignment within a course on professional competencies, including some related to ethics, that computing master's students need in their careers.
  arXiv  Detail & Related papers  (2024-04-09T09:03:47Z)
• Analyzing LLM Usage in an Advanced Computing Class in India [4.580708389528142]
  This study examines the use of large language models (LLMs) by undergraduate and graduate students for programming assignments in advanced computing classes. We conducted a comprehensive analysis involving 411 students from a Distributed Systems class at an Indian university.
  arXiv  Detail & Related papers  (2024-04-06T12:06:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.