The Impact and Opportunities of Generative AI in Fact-Checking

• URL: http://arxiv.org/abs/2405.15985v1
• Date: Fri, 24 May 2024 23:58:01 GMT
• Title: The Impact and Opportunities of Generative AI in Fact-Checking
• Authors: Robert Wolfe, Tanushree Mitra,
• Abstract summary: Generative AI appears poised to transform white collar professions, with more than 90% of Fortune 500 companies using OpenAI's flagship GPT models. But how will such technologies impact organizations whose job is to verify and report factual information? We conducted 30 interviews with N=38 participants working at 29 fact-checking organizations across six continents.
• Score: 12.845170214324662
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Generative AI appears poised to transform white collar professions, with more than 90% of Fortune 500 companies using OpenAI's flagship GPT models, which have been characterized as "general purpose technologies" capable of effecting epochal changes in the economy. But how will such technologies impact organizations whose job is to verify and report factual information, and to ensure the health of the information ecosystem? To investigate this question, we conducted 30 interviews with N=38 participants working at 29 fact-checking organizations across six continents, asking about how they use generative AI and the opportunities and challenges they see in the technology. We found that uses of generative AI envisioned by fact-checkers differ based on organizational infrastructure, with applications for quality assurance in Editing, for trend analysis in Investigation, and for information literacy in Advocacy. We used the TOE framework to describe participant concerns ranging from the Technological (lack of transparency), to the Organizational (resource constraints), to the Environmental (uncertain and evolving policy). Building on the insights of our participants, we describe value tensions between fact-checking and generative AI, and propose a novel Verification dimension to the design space of generative models for information verification work. Finally, we outline an agenda for fairness, accountability, and transparency research to support the responsible use of generative AI in fact-checking. Throughout, we highlight the importance of human infrastructure and labor in producing verified information in collaboration with AI. We expect that this work will inform not only the scientific literature on fact-checking, but also contribute to understanding of organizational adaptation to a powerful but unreliable new technology.

Related papers

• Do Responsible AI Artifacts Advance Stakeholder Goals? Four Key Barriers Perceived by Legal and Civil Stakeholders [59.17981603969404]
  The responsible AI (RAI) community has introduced numerous processes and artifacts to facilitate transparency and support the governance of AI systems. We conduct semi-structured interviews with 19 government, legal, and civil society stakeholders who inform policy and advocacy around responsible AI efforts. We organize these beliefs into four barriers that help explain how RAI artifacts may (inadvertently) reconfigure power relations across civil society, government, and industry.
  arXiv  Detail & Related papers  (2024-08-22T00:14:37Z)
• The Implications of Open Generative Models in Human-Centered Data Science Work: A Case Study with Fact-Checking Organizations [12.845170214324662]
  We focus on the impact of open models on organizations, which use AI to observe and analyze large volumes of circulating misinformation. We conducted an interview study with N=24 professionals at 20 fact-checking organizations on six continents. We find that fact-checking organizations prefer open models for Organizational Autonomy, Data Privacy and Ownership, Application Specificity, and Capability Transparency.
  arXiv  Detail & Related papers  (2024-08-04T08:41:48Z)
• Accuracy of training data and model outputs in Generative AI: CREATe Response to the Information Commissioner Office Consultation [6.699484354380871]
  CREATe welcomes the ICO call for evidence on the accuracy of Generative AI. We are happy to highlight aspects of data protection law and AI regulation that we believe should receive attention.
  arXiv  Detail & Related papers  (2024-05-30T10:34:49Z)
• On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Norms [56.119374302685934]
  There have been severe concerns over the trustworthiness of AI technologies. Machine and deep learning algorithms depend heavily on the data used during their development. We propose a framework to evaluate the datasets through a responsible rubric.
  arXiv  Detail & Related papers  (2023-10-24T14:01:53Z)
• Requirements for Explainability and Acceptance of Artificial Intelligence in Collaborative Work [0.0]
  The present structured literature analysis examines the requirements for the explainability and acceptance of AI. Results indicate that the two main groups of users are developers who require information about the internal operations of the model. The acceptance of AI systems depends on information about the system's functions and performance, privacy and ethical considerations.
  arXiv  Detail & Related papers  (2023-06-27T11:36:07Z)
• AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges [60.56413461109281]
  Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions.
  arXiv  Detail & Related papers  (2023-04-10T15:38:12Z)
• Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment [66.91538273487379]
  There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes. We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
  arXiv  Detail & Related papers  (2023-02-13T16:44:44Z)
• Adaptive cognitive fit: Artificial intelligence augmented management of information facets and representations [62.997667081978825]
  Explosive growth in big data technologies and artificial intelligence [AI] applications have led to increasing pervasiveness of information facets. Information facets, such as equivocality and veracity, can dominate and significantly influence human perceptions of information. We suggest that artificially intelligent technologies that can adapt information representations to overcome cognitive limitations are necessary.
  arXiv  Detail & Related papers  (2022-04-25T02:47:25Z)
• AI Assurance using Causal Inference: Application to Public Policy [0.0]
  Most AI approaches can only be represented as "black boxes" and suffer from the lack of transparency. It is crucial not only to develop effective and robust AI systems, but to make sure their internal processes are explainable and fair.
  arXiv  Detail & Related papers  (2021-12-01T16:03:06Z)
• Empowering Local Communities Using Artificial Intelligence [70.17085406202368]
  It has become an important topic to explore the impact of AI on society from a people-centered perspective. Previous works in citizen science have identified methods of using AI to engage the public in research. This article discusses the challenges of applying AI in Community Citizen Science.
  arXiv  Detail & Related papers  (2021-10-05T12:51:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.