Automated, not Automatic: Needs and Practices in European Fact-checking
Organizations as a basis for Designing Human-centered AI Systems
- URL: http://arxiv.org/abs/2211.12143v1
- Date: Tue, 22 Nov 2022 10:18:09 GMT
- Title: Automated, not Automatic: Needs and Practices in European Fact-checking
Organizations as a basis for Designing Human-centered AI Systems
- Authors: Andrea Hrckova, Robert Moro, Ivan Srba, Jakub Simko, Maria Bielikova
- Abstract summary: Despite existing research, there is still a gap between the fact-checking practitioners' needs and the current AI research.
In this study, we conducted semi-structured in-depth interviews with Central European fact-checkers.
The information behavior and requirements on desired supporting tools were analyzed using iterative bottom-up content analysis.
- Score: 0.7874708385247353
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: To mitigate the negative effects of false information more effectively, the
development of automated AI (artificial intelligence) tools assisting
fact-checkers is needed. Despite the existing research, there is still a gap
between the fact-checking practitioners' needs and pains and the current AI
research. We aspire to bridge this gap by employing methods of information
behavior research to identify implications for designing better human-centered
AI-based supporting tools.
In this study, we conducted semi-structured in-depth interviews with Central
European fact-checkers. The information behavior and requirements on desired
supporting tools were analyzed using iterative bottom-up content analysis,
bringing the techniques from grounded theory. The most significant needs were
validated with a survey extended to fact-checkers from across Europe, in which
we collected 24 responses from 20 European countries, i.e., 62% active European
IFCN (International Fact-Checking Network) signatories.
Our contributions are theoretical as well as practical. First, by being able
to map our findings about the needs of fact-checking organizations to the
relevant tasks for AI research, we have shown that the methods of information
behavior research are relevant for studying the processes in the organizations
and that these methods can be used to bridge the gap between the users and AI
researchers. Second, we have identified fact-checkers' needs and pains focusing
on so far unexplored dimensions and emphasizing the needs of fact-checkers from
Central and Eastern Europe as well as from low-resource language groups which
have implications for development of new resources (datasets) as well as for
the focus of AI research in this domain.
Related papers
- Research information in the light of artificial intelligence: quality and data ecologies [0.0]
This paper presents multi- and interdisciplinary approaches for finding the appropriate AI technologies for research information.
Professional research information management (RIM) is becoming increasingly important as an expressly data-driven tool for researchers.
arXiv Detail & Related papers (2024-05-06T16:07:56Z) - Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness [53.91018508439669]
The study explores the complexities of integrating Artificial Intelligence into Autonomous Vehicles (AVs)
It examines the challenges introduced by AI components and the impact on testing procedures.
The paper identifies significant challenges and suggests future directions for research and development of AI in AV technology.
arXiv Detail & Related papers (2024-02-21T08:29:42Z) - Artificial intelligence to automate the systematic review of scientific
literature [0.0]
We present a survey of AI techniques proposed in the last 15 years to help researchers conduct systematic analyses of scientific literature.
We describe the tasks currently supported, the types of algorithms applied, and available tools proposed in 34 primary studies.
arXiv Detail & Related papers (2024-01-13T19:12:49Z) - On the Opportunities of Green Computing: A Survey [80.21955522431168]
Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades.
The needs for high computing power brings higher carbon emission and undermines research fairness.
To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
arXiv Detail & Related papers (2023-11-01T11:16:41Z) - Improving the State of the Art for Training Human-AI Teams: Technical
Report #2 -- Results of Researcher Knowledge Elicitation Survey [0.0]
Sonalysts has begun an internal initiative to explore the training of Human-AI teams.
The first step in this effort is to develop a Synthetic Task Environment (STE) that is capable of facilitating research on Human-AI teams.
arXiv Detail & Related papers (2023-08-29T13:54:32Z) - The ethical ambiguity of AI data enrichment: Measuring gaps in research
ethics norms and practices [2.28438857884398]
This study explores how, and to what extent, comparable research ethics requirements and norms have developed for AI research and data enrichment.
Leading AI venues have begun to establish protocols for human data collection, but these are are inconsistently followed by authors.
arXiv Detail & Related papers (2023-06-01T16:12:55Z) - Human-Centric Multimodal Machine Learning: Recent Advances and Testbed
on AI-based Recruitment [66.91538273487379]
There is a certain consensus about the need to develop AI applications with a Human-Centric approach.
Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes.
We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
arXiv Detail & Related papers (2023-02-13T16:44:44Z) - Towards AI-Empowered Crowdsourcing [27.0404686687184]
We propose a taxonomy which divides AI-Empowered Crowdsourcing into three major areas: task delegation, motivating workers, and quality control.
We discuss the limitations and insights, and curate the challenges of doing research in each of these areas to highlight promising future research directions.
arXiv Detail & Related papers (2022-12-28T05:06:55Z) - Adaptive cognitive fit: Artificial intelligence augmented management of
information facets and representations [62.997667081978825]
Explosive growth in big data technologies and artificial intelligence [AI] applications have led to increasing pervasiveness of information facets.
Information facets, such as equivocality and veracity, can dominate and significantly influence human perceptions of information.
We suggest that artificially intelligent technologies that can adapt information representations to overcome cognitive limitations are necessary.
arXiv Detail & Related papers (2022-04-25T02:47:25Z) - Wizard of Search Engine: Access to Information Through Conversations
with Search Engines [58.53420685514819]
We make efforts to facilitate research on CIS from three aspects.
We formulate a pipeline for CIS with six sub-tasks: intent detection (ID), keyphrase extraction (KE), action prediction (AP), query selection (QS), passage selection (PS) and response generation (RG)
We release a benchmark dataset, called wizard of search engine (WISE), which allows for comprehensive and in-depth research on all aspects of CIS.
arXiv Detail & Related papers (2021-05-18T06:35:36Z) - Artificial Intelligence for IT Operations (AIOPS) Workshop White Paper [50.25428141435537]
Artificial Intelligence for IT Operations (AIOps) is an emerging interdisciplinary field arising in the intersection between machine learning, big data, streaming analytics, and the management of IT operations.
Main aim of the AIOPS workshop is to bring together researchers from both academia and industry to present their experiences, results, and work in progress in this field.
arXiv Detail & Related papers (2021-01-15T10:43:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.