Search Engines Post-ChatGPT: How Generative Artificial Intelligence Could Make Search Less Reliable

• URL: http://arxiv.org/abs/2402.11707v1
• Date: Sun, 18 Feb 2024 21:10:18 GMT
• Title: Search Engines Post-ChatGPT: How Generative Artificial Intelligence Could Make Search Less Reliable
• Abstract summary: We discuss the evolving nature of search engines, as they begin to generate, index, and distribute content created by generative artificial intelligence (GenAI) Our discussion highlights challenges in the early stages of GenAI integration, particularly around factual inconsistencies and biases.
• Score: 2.7557703490816268
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this commentary, we discuss the evolving nature of search engines, as they begin to generate, index, and distribute content created by generative artificial intelligence (GenAI). Our discussion highlights challenges in the early stages of GenAI integration, particularly around factual inconsistencies and biases. We discuss how output from GenAI carries an unwarranted sense of credibility, while decreasing transparency and sourcing ability. Furthermore, search engines are already answering queries with error-laden, generated content, further blurring the provenance of information and impacting the integrity of the information ecosystem. We argue how all these factors could reduce the reliability of search engines. Finally, we summarize some of the active research directions and open questions.

Related papers

• Synthetic Sources?: Auditing Generative Search Engine Citations for Evidence of AI-Generated Sources [3.2065257821139195]
  It is unclear whether generative search engines can reliably omit citing synthetic sources.<n>This work presents an audit of four generative search engines using a total of 712 real-world human-generated queries.<n>Our findings show evidence of AI-generated sources being cited across all four generative search engines.
  arXiv  Detail & Related papers  (2026-05-22T14:33:52Z)
• From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents [96.65646344634524]
  Large Language Models (LLMs), endowed with reasoning and agentic capabilities, are ushering in a new paradigm termed Agentic Deep Research.<n>We trace the evolution from static web search to interactive, agent-based systems that plan, explore, and learn.<n>We demonstrate that Agentic Deep Research not only significantly outperforms existing approaches, but is also poised to become the dominant paradigm for future information seeking.
  arXiv  Detail & Related papers  (2025-06-23T17:27:19Z)
• Information Retrieval in the Age of Generative AI: The RGB Model [77.96475639967431]
  This paper presents a novel quantitative approach to shed light on the complex information dynamics arising from the growing use of generative AI tools. We propose a model to characterize the generation, indexing, and dissemination of information in response to new topics. Our findings suggest that the rapid pace of generative AI adoption, combined with increasing user reliance, can outpace human verification, escalating the risk of inaccurate information proliferation.
  arXiv  Detail & Related papers  (2025-04-29T10:21:40Z)
• GenAI vs. Human Fact-Checkers: Accurate Ratings, Flawed Rationales [2.3475022003300055]
  GPT-4o, one of the most used AI models in consumer applications, outperforms other models, but all models exhibit only moderate agreement with human coders. We also assess the effectiveness of summarized versus full content inputs, finding that summarized content holds promise for improving efficiency without sacrificing accuracy.
  arXiv  Detail & Related papers  (2025-02-20T17:47:40Z)
• Are Large Language Models Ready for Business Integration? A Study on Generative AI Adoption [0.6144680854063939]
  This research examines the readiness of other Large Language Models (LLMs) such as Google Gemini for potential business applications. A dataset of 42,654 reviews from distinct Disneyland branches was employed. Results presented a spectrum of responses, including 75% successful simplifications, 25% errors, and instances of model self-reference.
  arXiv  Detail & Related papers  (2025-01-28T21:01:22Z)
• "So what if I used GenAI?" -- Implications of Using Cloud-based GenAI in Software Engineering Research [0.0]
  This paper sheds light on the various research aspects in which GenAI is used, thus raising awareness of its legal implications to novice and budding researchers. We summarize key aspects regarding our current knowledge that every software researcher involved in using GenAI should be aware of to avoid critical mistakes that may expose them to liability claims.
  arXiv  Detail & Related papers  (2024-12-10T06:18:15Z)
• Exploring AI Text Generation, Retrieval-Augmented Generation, and Detection Technologies: a Comprehensive Overview [0.0]
  Concerns surrounding AI-generated content, including issues of originality, bias, misinformation, and accountability, have become prominent. This paper offers a comprehensive overview of AI text generators (AITGs), focusing on their evolution, capabilities, and ethical implications. The paper explores future directions for improving detection accuracy, supporting ethical AI development, and increasing accessibility.
  arXiv  Detail & Related papers  (2024-12-05T07:23:14Z)
• The Influencer Next Door: How Misinformation Creators Use GenAI [1.1650821883155187]
  We find that non-experts increasingly use GenAI to remix, repackage, and (re)produce content to meet their personal needs and desires. We analyze how these understudied emergent uses of GenAI produce new or accelerated misinformation harms.
  arXiv  Detail & Related papers  (2024-05-22T11:40:22Z)
• Generative AI for Secure and Privacy-Preserving Mobile Crowdsensing [74.58071278710896]
  generative AI has attracted much attention from both academic and industrial fields. Secure and privacy-preserving mobile crowdsensing (SPPMCS) has been widely applied in data collection/ acquirement.
  arXiv  Detail & Related papers  (2024-05-17T04:00:58Z)
• Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda [1.8592384822257952]
  We elaborate on why XAI has gained importance with the rise of GenAI and its challenges for explainability research. We also unveil novel and emerging desiderata that explanations should fulfill, covering aspects such as verifiability, interactivity, security, and cost.
  arXiv  Detail & Related papers  (2024-04-15T08:18:16Z)
• An ethical study of generative AI from the Actor-Network Theory perspective [3.0224187843434]
  We analyze ChatGPT as a case study within the framework of Actor-Network Theory. We examine the actors and processes of translation involved in the ethical issues related to ChatGPT.
  arXiv  Detail & Related papers  (2024-04-10T02:32:19Z)
• Evaluating Robustness of Generative Search Engine on Adversarial Factual Questions [89.35345649303451]
  Generative search engines have the potential to transform how people seek information online. But generated responses from existing large language models (LLMs)-backed generative search engines may not always be accurate. Retrieval-augmented generation exacerbates safety concerns, since adversaries may successfully evade the entire system.
  arXiv  Detail & Related papers  (2024-02-25T11:22:19Z)
• Prompt Smells: An Omen for Undesirable Generative AI Outputs [4.105236597768038]
  We propose two new concepts that will aid the research community in addressing limitations associated with the application of GenAI models. First, we propose a definition for the "desirability" of GenAI outputs and three factors which are observed to influence it. Second, drawing inspiration from Martin Fowler's code smells, we propose the concept of "prompt smells" and the adverse effects they are observed to have on the desirability of GenAI outputs.
  arXiv  Detail & Related papers  (2024-01-23T10:10:01Z)
• Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey [97.33926242130732]
  Large Language Models (LLMs) have revolutionized the domain of natural language processing (NLP) with remarkable capabilities of generating human-like text responses. Despite these advancements, several works in the existing literature have raised serious concerns about the potential misuse of LLMs. To address these concerns, a consensus among the research community is to develop algorithmic solutions to detect AI-generated text.
  arXiv  Detail & Related papers  (2023-10-23T18:11:32Z)
• Identifying and Mitigating the Security Risks of Generative AI [179.2384121957896]
  This paper reports the findings of a workshop held at Google on the dual-use dilemma posed by GenAI. GenAI can be used just as well by attackers to generate new attacks and increase the velocity and efficacy of existing attacks. We discuss short-term and long-term goals for the community on this topic.
  arXiv  Detail & Related papers  (2023-08-28T18:51:09Z)
• A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT [63.58711128819828]
  ChatGPT and other Generative AI (GAI) techniques belong to the category of Artificial Intelligence Generated Content (AIGC) The goal of AIGC is to make the content creation process more efficient and accessible, allowing for the production of high-quality content at a faster pace.
  arXiv  Detail & Related papers  (2023-03-07T20:36:13Z)
• Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things [98.10037444792444]
  We show how AI can empower the IoT to make it faster, smarter, greener, and safer. First, we present progress in AI research for IoT from four perspectives: perceiving, learning, reasoning, and behaving. Finally, we summarize some promising applications of AIoT that are likely to profoundly reshape our world.
  arXiv  Detail & Related papers  (2020-11-17T13:14:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.