Analyzing Security and Privacy Challenges in Generative AI Usage Guidelines for Higher Education

• URL: http://arxiv.org/abs/2506.20463v1
• Date: Wed, 25 Jun 2025 14:12:18 GMT
• Title: Analyzing Security and Privacy Challenges in Generative AI Usage Guidelines for Higher Education
• Authors: Bei Yi Ng, Jiarui Li, Xinyuan Tong, Kevin Ye, Gauthami Yenne, Varun Chandrasekaran, Jingjie Li,
• Abstract summary: Universities are developing policies to guide GenAI use while safeguarding security and privacy.<n>This work examines these emerging policies and guidelines, with a particular focus on privacy and security dimensions.<n>We identify key challenges and opportunities institutions face in providing effective privacy and security protections.
• Score: 13.414092505955205
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Educators and learners worldwide are embracing the rise of Generative Artificial Intelligence (GenAI) as it reshapes higher education. However, GenAI also raises significant privacy and security concerns, as models and privacy-sensitive user data, such as student records, may be misused by service providers. Unfortunately, end-users often have little awareness of or control over how these models operate. To address these concerns, universities are developing institutional policies to guide GenAI use while safeguarding security and privacy. This work examines these emerging policies and guidelines, with a particular focus on the often-overlooked privacy and security dimensions of GenAI integration in higher education, alongside other academic values. Through a qualitative analysis of GenAI usage guidelines from universities across 12 countries, we identify key challenges and opportunities institutions face in providing effective privacy and security protections, including the need for GenAI safeguards tailored specifically to the academic context.

Related papers

• Generative AI-Empowered Secure Communications in Space-Air-Ground Integrated Networks: A Survey and Tutorial [107.26005706569498]
  Space-air-ground integrated networks (SAGINs) face unprecedented security challenges due to their inherent characteristics.<n>Generative AI (GAI) is a transformative approach that can safeguard SAGIN security by synthesizing data, understanding semantics, and making autonomous decisions.
  arXiv  Detail & Related papers  (2025-08-04T01:42:57Z)
• The Singapore Consensus on Global AI Safety Research Priorities [128.58674892183657]
  "2025 Singapore Conference on AI (SCAI): International Scientific Exchange on AI Safety" aimed to support research in this space.<n>Report builds on the International AI Safety Report chaired by Yoshua Bengio and backed by 33 governments.<n>Report organises AI safety research domains into three types: challenges with creating trustworthy AI systems (Development), challenges with evaluating their risks (Assessment) and challenges with monitoring and intervening after deployment (Control)
  arXiv  Detail & Related papers  (2025-06-25T17:59:50Z)
• From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
  We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
  arXiv  Detail & Related papers  (2025-05-17T08:30:10Z)
• The GenAI Generation: Student Views of Awareness, Preparedness, and Concern [1.5709900716890133]
  Outpacing the development of uniform policies and structures, GenAI has heralded a unique era and given rise to the GenAI Generation.<n>This study examines students' perceptions of GenAI through a concise survey with optional open-ended questions.<n>Students with greater curricular exposure to GenAI tend to feel more prepared, while those without it more often express vulnerability and uncertainty.
  arXiv  Detail & Related papers  (2025-05-04T19:37:13Z)
• Generative AI in Education: Student Skills and Lecturer Roles [0.0]
  This study aims to identify and evaluate the key competencies students need to effectively engage with GenAI in education.<n>The literature review identified 14 essential student skills for GenAI engagement, with AI literacy, critical thinking, and ethical AI practices emerging as the most critical.<n>In our study of lecturer strategies, we identified six key areas, with GenAI Integration and Curriculum Design being the most emphasised.
  arXiv  Detail & Related papers  (2025-04-28T10:58:30Z)
• Generative Artificial Intelligence for Academic Research: Evidence from Guidance Issued for Researchers by Higher Education Institutions in the United States [4.06279597585806]
  generative AI (GenAI) has signaled a significant shift in research activities.<n>This has raised questions about how to balance the seemingly productive uses of GenAI with ethical concerns.<n>To address these concerns, many Higher Education Institutions (HEIs) have released institutional guidance for researchers.
  arXiv  Detail & Related papers  (2025-03-01T23:34:02Z)
• Open Problems in Machine Unlearning for AI Safety [61.43515658834902]
  Machine unlearning -- the ability to selectively forget or suppress specific types of knowledge -- has shown promise for privacy and data removal tasks.<n>In this paper, we identify key limitations that prevent unlearning from serving as a comprehensive solution for AI safety.
  arXiv  Detail & Related papers  (2025-01-09T03:59:10Z)
• "So what if I used GenAI?" -- Implications of Using Cloud-based GenAI in Software Engineering Research [0.0]
  This paper sheds light on the various research aspects in which GenAI is used, thus raising awareness of its legal implications to novice and budding researchers.<n>We summarize key aspects regarding our current knowledge that every software researcher involved in using GenAI should be aware of to avoid critical mistakes that may expose them to liability claims.
  arXiv  Detail & Related papers  (2024-12-10T06:18:15Z)
• Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023 [38.83649319653387]
  There is limited prior research on computing students' use and perceptions of GenAI. We surveyed all computer science majors in a small engineering-focused R1 university. We discuss the impact of our findings on the emerging conversation around GenAI and education.
  arXiv  Detail & Related papers  (2024-11-17T20:17:47Z)
• Attack Atlas: A Practitioner's Perspective on Challenges and Pitfalls in Red Teaming GenAI [52.138044013005]
  generative AI, particularly large language models (LLMs), become increasingly integrated into production applications. New attack surfaces and vulnerabilities emerge and put a focus on adversarial threats in natural language and multi-modal systems. Red-teaming has gained importance in proactively identifying weaknesses in these systems, while blue-teaming works to protect against such adversarial attacks. This work aims to bridge the gap between academic insights and practical security measures for the protection of generative AI systems.
  arXiv  Detail & Related papers  (2024-09-23T10:18:10Z)
• Privacy Risks of General-Purpose AI Systems: A Foundation for Investigating Practitioner Perspectives [47.17703009473386]
  Powerful AI models have led to impressive leaps in performance across a wide range of tasks. Privacy concerns have led to a wealth of literature covering various privacy risks and vulnerabilities of AI models. We conduct a systematic review of these survey papers to provide a concise and usable overview of privacy risks in GPAIS.
  arXiv  Detail & Related papers  (2024-07-02T07:49:48Z)
• Securing the Future of GenAI: Policy and Technology [50.586585729683776]
  Governments globally are grappling with the challenge of regulating GenAI, balancing innovation against safety. A workshop co-organized by Google, University of Wisconsin, Madison, and Stanford University aimed to bridge this gap between GenAI policy and technology. This paper summarizes the discussions during the workshop which addressed questions, such as: How regulation can be designed without hindering technological progress?
  arXiv  Detail & Related papers  (2024-05-21T20:30:01Z)
• Generative AI in Higher Education: Seeing ChatGPT Through Universities' Policies, Resources, and Guidelines [11.470910427306569]
  This study analyzes academic policies and guidelines established by top-ranked U.S. universities regarding the use of GenAI. Results show that the majority of these universities adopt an open but cautious approach towards GenAI. Findings provide four practical implications for educators in teaching practices.
  arXiv  Detail & Related papers  (2023-12-08T18:33:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.