Not a Swiss Army Knife: Academics' Perceptions of Trade-Offs Around Generative Artificial Intelligence Use

• URL: http://arxiv.org/abs/2405.00995v1
• Date: Thu, 2 May 2024 04:25:35 GMT
• Title: Not a Swiss Army Knife: Academics' Perceptions of Trade-Offs Around Generative Artificial Intelligence Use
• Authors: Afsaneh Razi, Layla Bouzoubaa, Aria Pessianzadeh, John S. Seberger, Rezvaneh Rezapour,
• Abstract summary: We interviewed 18 knowledge workers, including faculty and students, to investigate the social and technical dimensions of generative AI (Gen AI) Our participants raised concerns about the opacity of the data used to train Gen AI. Participants recognized Gen AI's potential to democratize knowledge by accelerating the learning process and act as an accessible research assistant.
• Score: 7.917580802104543
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In the rapidly evolving landscape of computing disciplines, substantial efforts are being dedicated to unraveling the sociotechnical implications of generative AI (Gen AI). While existing research has manifested in various forms, there remains a notable gap concerning the direct engagement of knowledge workers in academia with Gen AI. We interviewed 18 knowledge workers, including faculty and students, to investigate the social and technical dimensions of Gen AI from their perspective. Our participants raised concerns about the opacity of the data used to train Gen AI. This lack of transparency makes it difficult to identify and address inaccurate, biased, and potentially harmful, information generated by these models. Knowledge workers also expressed worries about Gen AI undermining trust in the relationship between instructor and student and discussed potential solutions, such as pedagogy readiness, to mitigate them. Additionally, participants recognized Gen AI's potential to democratize knowledge by accelerating the learning process and act as an accessible research assistant. However, there were also concerns about potential social and power imbalances stemming from unequal access to such technologies. Our study offers insights into the concerns and hopes of knowledge workers about the ethical use of Gen AI in educational settings and beyond, with implications for navigating this new landscape.

Related papers

• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We argue that shortcomings stem from one overarching failure: AI systems lack wisdom. While AI research has focused on task-level strategies, metacognition is underdeveloped in AI systems. We propose that integrating metacognitive capabilities into AI systems is crucial for enhancing their robustness, explainability, cooperation, and safety.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• Human-Centric eXplainable AI in Education [0.0]
  This paper explores Human-Centric eXplainable AI (HCXAI) in the educational landscape. It emphasizes its role in enhancing learning outcomes, fostering trust among users, and ensuring transparency in AI-driven tools. It outlines comprehensive frameworks for developing HCXAI systems that prioritize user understanding and engagement.
  arXiv  Detail & Related papers  (2024-10-18T14:02:47Z)
• Measuring Human Contribution in AI-Assisted Content Generation [68.03658922067487]
  This study raises the research question of measuring human contribution in AI-assisted content generation. By calculating mutual information between human input and AI-assisted output relative to self-information of AI-assisted output, we quantify the proportional information contribution of humans in content generation.
  arXiv  Detail & Related papers  (2024-08-27T05:56:04Z)
• Generative AI in Education: A Study of Educators' Awareness, Sentiments, and Influencing Factors [2.217351976766501]
  This study delves into university instructors' experiences and attitudes toward AI language models. We find no correlation between teaching style and attitude toward generative AI. While CS educators show far more confidence in their technical understanding of generative AI tools, they show no more confidence in their ability to detect AI-generated work.
  arXiv  Detail & Related papers  (2024-03-22T19:21:29Z)
• The Ethics of AI in Education [0.0]
  The transition of Artificial Intelligence from a lab-based science to live human contexts brings into sharp focus many historic, socio-cultural biases, inequalities, and moral dilemmas. Questions that have been raised regarding the broader ethics of AI are also relevant for AI in Education (AIED) AIED raises further challenges related to the impact of its technologies on users, how such technologies might be used to reinforce or alter the way that we learn and teach, and what we, as a society and individuals, value as outcomes of education.
  arXiv  Detail & Related papers  (2024-03-22T11:41:37Z)
• Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Brain [0.7770029179741429]
  The intersection of Artificial Intelligence (AI) and neuroscience in Explainable AI (XAI) is pivotal for enhancing transparency and interpretability in complex decision-making processes. This paper explores the evolution of XAI methodologies, ranging from feature-based to human-centric approaches. The challenges in achieving explainability in generative models, ensuring responsible AI practices, and addressing ethical implications are discussed.
  arXiv  Detail & Related papers  (2024-02-07T14:09:11Z)
• Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge [22.21959942886099]
  We introduce a process-oriented notion of appropriate reliance called critical use that centers the human's ability to situate AI predictions against knowledge that is uniquely available to them but unavailable to the AI model. We conduct a randomized online experiment in a complex social decision-making setting: child maltreatment screening. We find that, by providing participants with accelerated, low-stakes opportunities to practice AI-assisted decision-making, novices came to exhibit patterns of disagreement with AI that resemble those of experienced workers.
  arXiv  Detail & Related papers  (2023-08-30T01:54:31Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• Trustworthy AI: A Computational Perspective [54.80482955088197]
  We focus on six of the most crucial dimensions in achieving trustworthy AI: (i) Safety & Robustness, (ii) Non-discrimination & Fairness, (iii) Explainability, (iv) Privacy, (v) Accountability & Auditability, and (vi) Environmental Well-Being. For each dimension, we review the recent related technologies according to a taxonomy and summarize their applications in real-world systems.
  arXiv  Detail & Related papers  (2021-07-12T14:21:46Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things [98.10037444792444]
  We show how AI can empower the IoT to make it faster, smarter, greener, and safer. First, we present progress in AI research for IoT from four perspectives: perceiving, learning, reasoning, and behaving. Finally, we summarize some promising applications of AIoT that are likely to profoundly reshape our world.
  arXiv  Detail & Related papers  (2020-11-17T13:14:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.