Understanding Student Attitudes and Acceptability of GenAI Tools in Higher Ed: Scale Development and Evaluation
- URL: http://arxiv.org/abs/2508.01926v1
- Date: Sun, 03 Aug 2025 21:22:34 GMT
- Title: Understanding Student Attitudes and Acceptability of GenAI Tools in Higher Ed: Scale Development and Evaluation
- Authors: Xiuxiu Tang, Si Chen, Ying Cheng, Nitesh V Chawla, Ronald Metoyer, G. Alex Ambrose,
- Abstract summary: This study introduces a validated survey instrument designed to assess students' perceptions of generative AI (GenAI)<n>The instrument includes six thematic domains: institutional understanding, fairness and trust, academic and career influence, societal concerns, and GenAI use in writing and coursework.<n>Students from multilingual households perceived greater clarity in institutional policy, while first-generation students reported a stronger belief in GenAI's impact on future careers.
- Score: 22.35484281040714
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As generative AI (GenAI) tools like ChatGPT become more common in higher education, understanding student attitudes is essential for evaluating their educational impact and supporting responsible AI integration. This study introduces a validated survey instrument designed to assess students' perceptions of GenAI, including its acceptability for academic tasks, perceived influence on learning and careers, and broader societal concerns. We administered the survey to 297 undergraduates at a U.S. university. The instrument includes six thematic domains: institutional understanding, fairness and trust, academic and career influence, societal concerns, and GenAI use in writing and coursework. Exploratory factor analysis revealed four attitudinal dimensions: societal concern, policy clarity, fairness and trust, and career impact. Subgroup analyses identified statistically significant differences across student backgrounds. Male students and those speaking a language other than English at home rated GenAI use in writing tasks as more acceptable. First-year students expressed greater societal concern than upper-year peers. Students from multilingual households perceived greater clarity in institutional policy, while first-generation students reported a stronger belief in GenAI's impact on future careers. This work contributes a practical scale for evaluating the student impact of GenAI tools, informing the design of educational AI systems.
Related papers
- From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
arXiv Detail & Related papers (2025-05-17T08:30:10Z) - The GenAI Generation: Student Views of Awareness, Preparedness, and Concern [1.5709900716890133]
Outpacing the development of uniform policies and structures, GenAI has heralded a unique era and given rise to the GenAI Generation.<n>This study examines students' perceptions of GenAI through a concise survey with optional open-ended questions.<n>Students with greater curricular exposure to GenAI tend to feel more prepared, while those without it more often express vulnerability and uncertainty.
arXiv Detail & Related papers (2025-05-04T19:37:13Z) - Generative AI in Education: Student Skills and Lecturer Roles [0.0]
This study aims to identify and evaluate the key competencies students need to effectively engage with GenAI in education.<n>The literature review identified 14 essential student skills for GenAI engagement, with AI literacy, critical thinking, and ethical AI practices emerging as the most critical.<n>In our study of lecturer strategies, we identified six key areas, with GenAI Integration and Curriculum Design being the most emphasised.
arXiv Detail & Related papers (2025-04-28T10:58:30Z) - Engineering Educators' Perspectives on the Impact of Generative AI in Higher Education [4.06279597585806]
This study reports findings from a survey of engineering educators on their use of and perspectives toward generative AI.<n>We asked them about their use of and comfort with GenAI, their overall perspectives on GenAI, the challenges and potential harms of using it for teaching, learning, and research, and examined whether their approach to using and integrating GenAI in their classroom influenced their experiences with GenAI and perceptions of it.
arXiv Detail & Related papers (2025-02-01T21:29:53Z) - Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge [78.35388859345056]
We argue that the ML community would benefit from learning from and drawing on the social sciences when developing measurement instruments for evaluating GenAI systems.<n>We present a four-level framework, grounded in measurement theory from the social sciences, for measuring concepts related to the capabilities, behaviors, and impacts of GenAI systems.
arXiv Detail & Related papers (2025-02-01T21:09:51Z) - Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023 [38.83649319653387]
There is limited prior research on computing students' use and perceptions of GenAI.
We surveyed all computer science majors in a small engineering-focused R1 university.
We discuss the impact of our findings on the emerging conversation around GenAI and education.
arXiv Detail & Related papers (2024-11-17T20:17:47Z) - Hey GPT, Can You be More Racist? Analysis from Crowdsourced Attempts to Elicit Biased Content from Generative AI [41.96102438774773]
This work presents the findings from a university-level competition, which challenged participants to design prompts for eliciting biased outputs from GenAI tools.
We quantitatively and qualitatively analyze the competition submissions and identify a diverse set of biases in GenAI and strategies employed by participants to induce bias in GenAI.
arXiv Detail & Related papers (2024-10-20T18:44:45Z) - Understanding Student and Academic Staff Perceptions of AI Use in Assessment and Feedback [0.0]
The rise of Artificial Intelligence (AI) and Generative Artificial Intelligence (GenAI) in higher education necessitates assessment reform.
This study addresses a critical gap by exploring student and academic staff experiences with AI and GenAI tools.
An online survey collected data from 35 academic staff and 282 students across two universities in Vietnam and one in Singapore.
arXiv Detail & Related papers (2024-06-22T10:25:01Z) - Students' Voices on Generative AI: Perceptions, Benefits, and Challenges
in Higher Education [2.0711789781518752]
This study explores university students' perceptions of generative AI (GenAI) technologies, such as ChatGPT, in higher education.
Students recognized the potential for personalized learning support, writing and brainstorming assistance, and research and analysis capabilities.
Concerns about accuracy, privacy, ethical issues, and the impact on personal development, career prospects, and societal values were also expressed.
arXiv Detail & Related papers (2023-04-29T15:53:38Z) - AI Explainability 360: Impact and Design [120.95633114160688]
In 2019, we created AI Explainability 360 (Arya et al. 2020), an open source software toolkit featuring ten diverse and state-of-the-art explainability methods.
This paper examines the impact of the toolkit with several case studies, statistics, and community feedback.
The paper also describes the flexible design of the toolkit, examples of its use, and the significant educational material and documentation available to its users.
arXiv Detail & Related papers (2021-09-24T19:17:09Z) - Creation and Evaluation of a Pre-tertiary Artificial Intelligence (AI)
Curriculum [58.86139968005518]
The Chinese University of Hong Kong (CUHK)-Jockey Club AI for the Future Project (AI4Future) co-created an AI curriculum for pre-tertiary education.
A team of 14 professors with expertise in engineering and education collaborated with 17 principals and teachers from 6 secondary schools to co-create the curriculum.
The co-creation process generated a variety of resources which enhanced the teachers knowledge in AI, as well as fostered teachers autonomy in bringing the subject matter into their classrooms.
arXiv Detail & Related papers (2021-01-19T11:26:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.