Bowling with ChatGPT: On the Evolving User Interactions with Conversational AI Systems

• URL: http://arxiv.org/abs/2602.01114v2
• Date: Mon, 09 Feb 2026 17:32:29 GMT
• Title: Bowling with ChatGPT: On the Evolving User Interactions with Conversational AI Systems
• Authors: Sai Keerthana Karnam, Abhisek Dash, Krishna Gummadi, Animesh Mukherjee, Ingmar Weber, Savvas Zannettou,
• Abstract summary: InVivoGPT is a unique dataset consisting of 825K ChatGPT interactions donated by 300 users through their data rights.<n>We show that participants increasingly turn to ChatGPT for a broader range of purposes, including substantial growth in sensitive domains such as health and mental health.<n>Our results show that conversational AI systems are shifting from functional tools to social partners, raising important questions about their design and governance.
• Score: 7.455203407514098
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent studies have discussed how users are increasingly using conversational AI systems, powered by LLMs, for information seeking, decision support, and even emotional support. However, these macro-level observations offer limited insight into how the purpose of these interactions shifts over time, how users frame their interactions with the system, and how steering dynamics unfold in these human-AI interactions. To examine these evolving dynamics, we gathered and analyzed a unique dataset InVivoGPT: consisting of 825K ChatGPT interactions, donated by 300 users through their GDPR data rights. Our analyses reveal three key findings. First, participants increasingly turn to ChatGPT for a broader range of purposes, including substantial growth in sensitive domains such as health and mental health. Second, interactions become more socially framed: the system anthropomorphizes itself at rising rates, participants more frequently treat it as a companion, and personal data disclosure becomes both more common and more diverse. Third, conversational steering becomes more prominent, especially after the release of GPT-4o, with conversations where the participants followed a model-initiated suggestion quadrupling over the period of our dataset. Overall, our results show that conversational AI systems are shifting from functional tools to social partners, raising important questions about their design and governance.

Related papers

• The ICASSP 2026 HumDial Challenge: Benchmarking Human-like Spoken Dialogue Systems in the LLM Era [95.35748535806744]
  We launch the first Human-like Spoken Dialogue Systems Challenge (HumDial) at ICASSP 2026.<n>This paper summarizes the dataset, track configurations, and the final results.
  arXiv  Detail & Related papers  (2026-01-09T06:32:30Z)
• Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset [113.25650486482762]
  We introduce the Seamless Interaction dataset, a large-scale collection of over 4,000 hours of face-to-face interaction footage.<n>This dataset enables the development of AI technologies that understand dyadic embodied dynamics.<n>We develop a suite of models that utilize the dataset to generate dyadic motion gestures and facial expressions aligned with human speech.
  arXiv  Detail & Related papers  (2025-06-27T18:09:49Z)
• Investigating Affective Use and Emotional Well-being on ChatGPT [32.797983866308755]
  We investigate the extent to which interactions with ChatGPT may impact users' emotional well-being, behaviors and experiences.<n>We analyze over 3 million conversations for affective cues and surveying over 4,000 users on their perceptions of ChatGPT.<n>We conduct an Institutional Review Board (IRB)-approved randomized controlled trial (RCT) on close to 1,000 participants over 28 days.
  arXiv  Detail & Related papers  (2025-04-04T19:22:10Z)
• From Interaction to Collaboration: How Hybrid Intelligence Enhances Chatbot Feedback [0.0]
  This study explores the impact of two distinct narratives and feedback collection mechanisms on user engagement and feedback behavior.<n>Initial findings indicate that while small-scale survey measures allowed for no significant differences in user willingness to leave feedback, use the system, or trust the system, participants exposed to the HI narrative statistically significantly provided more detailed feedback.
  arXiv  Detail & Related papers  (2025-03-08T07:36:36Z)
• Mind the Gap! Static and Interactive Evaluations of Large Audio Models [55.87220295533817]
  Large Audio Models (LAMs) are designed to power voice-native experiences.<n>This study introduces an interactive approach to evaluate LAMs and collect 7,500 LAM interactions from 484 participants.
  arXiv  Detail & Related papers  (2025-02-21T20:29:02Z)
• REALTALK: A 21-Day Real-World Dataset for Long-Term Conversation [51.97224538045096]
  We introduce REALTALK, a 21-day corpus of authentic messaging app dialogues.<n>We compare EI attributes and persona consistency to understand the challenges posed by real-world dialogues.<n>Our findings reveal that models struggle to simulate a user solely from dialogue history, while fine-tuning on specific user chats improves persona emulation.
  arXiv  Detail & Related papers  (2025-02-18T20:29:01Z)
• Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation [70.52558242336988]
  We focus on predicting engagement in dyadic interactions by scrutinizing verbal and non-verbal cues, aiming to detect signs of disinterest or confusion. In this work, we collect a dataset featuring 34 participants engaged in casual dyadic conversations, each providing self-reported engagement ratings at the end of each conversation. We introduce a novel fusion strategy using Large Language Models (LLMs) to integrate multiple behavior modalities into a multimodal transcript''
  arXiv  Detail & Related papers  (2024-09-13T18:28:12Z)
• "You tell me": A Dataset of GPT-4-Based Behaviour Change Support Conversations [1.104960878651584]
  We share a dataset containing text-based user interactions related to behaviour change with two GPT-4-based conversational agents. This dataset includes conversation data, user language analysis, perception measures, and user feedback for LLM-generated turns.
  arXiv  Detail & Related papers  (2024-01-29T13:54:48Z)
• Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPT [10.907980864371213]
  This study focuses on playful interactions exhibited by users of a popular AI technology, ChatGPT.<n>We found that more than half (54%) of user discourse revolved around playful interactions.<n>It examines how these interactions can help users understand AI's agency, shape human-AI relationships, and provide insights for designing AI systems.
  arXiv  Detail & Related papers  (2024-01-16T14:44:13Z)
• Early ChatGPT User Portrait through the Lens of Data [9.497255050640344]
  We conduct a detailed analysis of real-world ChatGPT datasets with multi-turn conversations between users and ChatGPT. By understanding shifts in user demographics and interests, we aim to shed light on the changing nature of human-AI interaction.
  arXiv  Detail & Related papers  (2023-12-10T07:08:51Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.