How does AI chat change search behaviors?

• URL: http://arxiv.org/abs/2307.03826v1
• Date: Fri, 7 Jul 2023 20:41:26 GMT
• Title: How does AI chat change search behaviors?
• Authors: Robert Capra, Jaime Arguello
• Abstract summary: Generative AI tools such as chatGPT are poised to change the way people engage with online information. Microsoft announced their "new Bing" search system which incorporates chat and generative AI technology from OpenAI. Google has announced plans to deploy search interfaces that incorporate similar types of technology.
• Score: 7.601937548486356
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative AI tools such as chatGPT are poised to change the way people engage with online information. Recently, Microsoft announced their "new Bing" search system which incorporates chat and generative AI technology from OpenAI. Google has announced plans to deploy search interfaces that incorporate similar types of technology. These new technologies will transform how people can search for information. The research presented here is an early investigation into how people make use of a generative AI chat system (referred to simply as chat from here on) as part of a search process, and how the incorporation of chat systems with existing search tools may effect users search behaviors and strategies. We report on an exploratory user study with 10 participants who used a combined Chat+Search system that utilized the OpenAI GPT-3.5 API and the Bing Web Search v5 API. Participants completed three search tasks. In this pre-print paper of preliminary results, we report on ways that users integrated AI chat into their search process, things they liked and disliked about the chat system, their trust in the chat responses, and their mental models of how the chat system generated responses.

Related papers

• Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems [11.952998882009785]
  Ghosting is the ability to predict a user's intended text input for inline query auto-completion.<n>By suggesting completions to incomplete queries (or prefixes), ghosting aids users with slow typing speeds, disabilities, or limited language proficiency.<n>Despite the increasing prominence of chat-based systems utilizing ghosting, this challenging problem of Chat-Ghosting has received little attention from the NLP/ML research community.
  arXiv  Detail & Related papers  (2025-07-08T12:38:41Z)
• NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search [108.42163676745085]
  We envision NExT-Search, a next-generation paradigm designed to reintroduce fine-grained, process-level feedback into generative AI search.<n> NExT-Search integrates two complementary modes: User Debug Mode, which allows engaged users to intervene at key stages; and Shadow User Mode, where a personalized user agent simulates user preferences.
  arXiv  Detail & Related papers  (2025-05-20T17:59:13Z)
• Blending Queries and Conversations: Understanding Tactics, Trust, Verification, and System Choice in Web Search and Chat Interactions [0.8397730500554048]
  This paper presents a user study where participants used an interface combining Web Search and a Generative AI-Chat feature to solve health-related information tasks. We study how people behaved with the interface, why they behaved in certain ways, and what the outcomes of these behaviours were.
  arXiv  Detail & Related papers  (2025-04-07T14:59:55Z)
• A Survey of Conversational Search [44.09402706387407]
  We explore the recent advancements and potential future directions in conversational search. We highlight the integration of large language models (LLMs) in enhancing these systems. We provide insights into real-world applications and robust evaluations of current conversational search systems.
  arXiv  Detail & Related papers  (2024-10-21T01:54:46Z)
• MindSearch: Mimicking Human Minds Elicits Deep AI Searcher [50.68599514830046]
  We introduce MindSearch to mimic the human minds in web information seeking and integration.<n>The framework can be instantiated by a simple yet effective LLM-based multi-agent framework.<n> MindSearch demonstrates significant improvement in the response quality in terms of depth and breadth.
  arXiv  Detail & Related papers  (2024-07-29T17:12:40Z)
• Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines [3.5845457075304368]
  This research aims to dissect the mechanisms through which an LLM-powered search engine, specifically Bing Chat, selects information sources for its responses. Bing Chat exhibits a preference for content that is not only readable and formally structured, but also demonstrates lower perplexity levels. Our investigation documents a greater similarity among websites cited by RAG technologies compared to those ranked highest by conventional search engines.
  arXiv  Detail & Related papers  (2024-02-29T18:20:37Z)
• Social Commonsense-Guided Search Query Generation for Open-Domain Knowledge-Powered Conversations [66.16863141262506]
  We present a novel approach that focuses on generating internet search queries guided by social commonsense. Our proposed framework addresses passive user interactions by integrating topic tracking, commonsense response generation and instruction-driven query generation.
  arXiv  Detail & Related papers  (2023-10-22T16:14:56Z)
• Multi-Purpose NLP Chatbot : Design, Methodology & Conclusion [0.0]
  This research paper provides a thorough analysis of the chatbots technology environment as it exists today. It provides a very flexible system that makes use of reinforcement learning strategies to improve user interactions and conversational experiences. The complexity of chatbots technology development is also explored in this study, along with the causes that have propelled these developments and their far-reaching effects on a range of sectors.
  arXiv  Detail & Related papers  (2023-10-13T09:47:24Z)
• ChatGPT vs. Google: A Comparative Study of Search Performance and User Experience [0.0]
  We investigate the differences in user behavior when employing search engines and ChatGPT tools for information-seeking tasks. Our findings reveal that the ChatGPT group consistently spends less time on all tasks, with no significant difference in overall task performance. Users perceive ChatGPT's responses as having higher information quality compared to Google Search, despite displaying a similar level of trust in both tools.
  arXiv  Detail & Related papers  (2023-07-03T16:15:34Z)
• To ChatGPT, or not to ChatGPT: That is the question! [78.407861566006]
  This study provides a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection. We have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q&A, and finance domains. Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.
  arXiv  Detail & Related papers  (2023-04-04T03:04:28Z)
• FaceChat: An Emotion-Aware Face-to-face Dialogue Framework [58.67608580694849]
  FaceChat is a web-based dialogue framework that enables emotionally-sensitive and face-to-face conversations. System has a wide range of potential applications, including counseling, emotional support, and personalized customer service.
  arXiv  Detail & Related papers  (2023-03-08T20:45:37Z)
• Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production [98.98161995555485]
  We propose a dialogue model that can access the vast and dynamic information from any search engine for response generation. As the core module, a query producer is used to generate queries from a dialogue context to interact with a search engine. Experiments show that our query producer can achieve R@1 and R@5 rates of 62.4% and 74.8% for retrieving gold knowledge.
  arXiv  Detail & Related papers  (2023-02-16T01:58:10Z)
• Investigating Conversational Search Behavior For Domain Exploration [0.5512295869673147]
  This study investigates open-ended search behavior for navigation through unknown information landscapes. We apply statistical analyses and process mining techniques to uncover general information-seeking patterns across five different domains.
  arXiv  Detail & Related papers  (2023-01-10T17:43:03Z)
• Neural Approaches to Conversational Information Retrieval [94.77863916314979]
  A conversational information retrieval (CIR) system is an information retrieval (IR) system with a conversational interface. Recent progress in deep learning has brought tremendous improvements in natural language processing (NLP) and conversational AI. This book surveys recent advances in CIR, focusing on neural approaches that have been developed in the last few years.
  arXiv  Detail & Related papers  (2022-01-13T19:04:59Z)
• On the Social and Technical Challenges of Web Search Autosuggestion Moderation [118.47867428272878]
  Autosuggestions are typically generated by machine learning (ML) systems trained on a corpus of search logs and document representations. While current search engines have become increasingly proficient at suppressing such problematic suggestions, there are still persistent issues that remain. We discuss several dimensions of problematic suggestions, difficult issues along the pipeline, and why our discussion applies to the increasing number of applications beyond web search.
  arXiv  Detail & Related papers  (2020-07-09T19:22:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.