Towards Better Health Conversations: The Benefits of Context-seeking

• URL: http://arxiv.org/abs/2510.18880v1
• Date: Sun, 14 Sep 2025 01:08:42 GMT
• Title: Towards Better Health Conversations: The Benefits of Context-seeking
• Authors: Rory Sayres, Yuexing Hao, Abbi Ward, Amy Wang, Beverly Freeman, Serena Zhan, Diego Ardila, Jimmy Li, I-Ching Lee, Anna Iurchenko, Siyi Kou, Kartikeya Badola, Jimmy Hu, Bhawesh Kumar, Keith Johnson, Supriya Vijay, Justin Krogue, Avinatan Hassidim, Yossi Matias, Dale R. Webster, Sunny Virmani, Yun Liu, Quang Duong, Mike Schaekermann,
• Abstract summary: We present insights on how people interact with large language models (LLMs) for their own health questions.<n>Studies revealed the importance of context-seeking in conversational AIs to elicit specific details a person may not volunteer or know to share.<n>We developed a "Wayfinding AI" to proactively solicit context.
• Score: 17.329382113242556
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Navigating health questions can be daunting in the modern information landscape. Large language models (LLMs) may provide tailored, accessible information, but also risk being inaccurate, biased or misleading. We present insights from 4 mixed-methods studies (total N=163), examining how people interact with LLMs for their own health questions. Qualitative studies revealed the importance of context-seeking in conversational AIs to elicit specific details a person may not volunteer or know to share. Context-seeking by LLMs was valued by participants, even if it meant deferring an answer for several turns. Incorporating these insights, we developed a "Wayfinding AI" to proactively solicit context. In a randomized, blinded study, participants rated the Wayfinding AI as more helpful, relevant, and tailored to their concerns compared to a baseline AI. These results demonstrate the strong impact of proactive context-seeking on conversational dynamics, and suggest design patterns for conversational AI to help navigate health topics.

Related papers

• AI summaries in online search influence users' attitudes [3.459756369056329]
  This study examined how AI-generated summaries affect how users think about different issues.<n>Users perceived the AI summaries more useful when it emphasized health harms versus benefits.<n>These findings suggest that AI-generated search summaries can significantly shape public perceptions.
  arXiv  Detail & Related papers  (2025-11-27T23:45:19Z)
• CoCoNUTS: Concentrating on Content while Neglecting Uninformative Textual Styles for AI-Generated Peer Review Detection [60.52240468810558]
  We introduce CoCoNUTS, a content-oriented benchmark built upon a fine-grained dataset of AI-generated peer reviews.<n>We also develop CoCoDet, an AI review detector via a multi-task learning framework, to achieve more accurate and robust detection of AI involvement in review content.
  arXiv  Detail & Related papers  (2025-08-28T06:03:11Z)
• Modeling Human Responses to Multimodal AI Content [10.65875439980452]
  MhAIM dataset contains 154,552 online posts (111,153 of them AI-generated)<n>Our human study reveals that people are better at identifying AI content when posts include both text and visuals.<n>We present T-Lens, an agent system designed to answer user queries by incorporating predicted human responses to multimodal information.
  arXiv  Detail & Related papers  (2025-08-14T15:55:19Z)
• "What's Up, Doc?": Analyzing How Users Seek Health Information in Large-Scale Conversational AI Datasets [7.252397462273507]
  HealthChat-11K is a curated dataset of 11K real-world conversations composed of 25K user messages.<n>Our analysis reveals insights into the nature of how and why users seek health information.
  arXiv  Detail & Related papers  (2025-06-26T17:52:18Z)
• What Makes a Good Natural Language Prompt? [72.3282960118995]
  We conduct a meta-analysis surveying more than 150 prompting-related papers from leading NLP and AI conferences from 2022 to 2025.<n>We propose a property- and human-centric framework for evaluating prompt quality, encompassing 21 properties categorized into six dimensions.<n>We then empirically explore multi-property prompt enhancements in reasoning tasks, observing that single-property enhancements often have the greatest impact.
  arXiv  Detail & Related papers  (2025-06-07T23:19:27Z)
• DoYouTrustAI: A Tool to Teach Students About AI Misinformation and Prompt Engineering [2.3020018305241337]
  DoYouTrustAI is a web-based application that helps students enhance critical thinking by identifying misleading information in LLM responses about major historical figures.<n>The tool lets users select familiar individuals for testing to reduce random guessing and presents misinformation alongside known facts to maintain believability.<n>It also provides pre-configured prompt instructions to show how different prompts affect AI responses.
  arXiv  Detail & Related papers  (2025-03-22T19:11:57Z)
• Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writing [55.2480439325792]
  This study systematically evaluations twelve state-of-the-art AI-text detectors using our AI-Polished-Text Evaluation dataset.<n>Our findings reveal that detectors frequently flag even minimally polished text as AI-generated, struggle to differentiate between degrees of AI involvement, and exhibit biases against older and smaller models.
  arXiv  Detail & Related papers  (2025-02-21T18:45:37Z)
• Open Domain Question Answering with Conflicting Contexts [55.739842087655774]
  We find that as much as 25% of unambiguous, open domain questions can lead to conflicting contexts when retrieved using Google Search.<n>We ask our annotators to provide explanations for their selections of correct answers.
  arXiv  Detail & Related papers  (2024-10-16T07:24:28Z)
• Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health [1.8772687384996551]
  Large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. We showcase the power of LLMs in handling unstructured conversational data through four case studies.
  arXiv  Detail & Related papers  (2024-06-19T16:02:04Z)
• The Role of AI in Drug Discovery: Challenges, Opportunities, and Strategies [97.5153823429076]
  The benefits, challenges and drawbacks of AI in this field are reviewed. The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
  arXiv  Detail & Related papers  (2022-12-08T23:23:39Z)
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems [80.0781718687327]
  We analyze user intent patterns in information-seeking conversations and propose an intent-aware neural response ranking model "IART" IART is built on top of the integration of user intent modeling and language representation learning with the Transformer architecture.
  arXiv  Detail & Related papers  (2020-02-03T05:59:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.