Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisis

• URL: http://arxiv.org/abs/2512.23859v1
• Date: Mon, 29 Dec 2025 20:52:17 GMT
• Title: Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisis
• Abstract summary: We explore the first-person experience of turning to a conversational AI agent in a mental health crisis.<n>We find that people use AI agents to fill the in-between spaces of human support.<n>We find that human-human connection is an essential positive action when managing a mental health crisis.
• Score: 9.658745641503897
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Online, people often recount their experiences turning to conversational AI agents (e.g., ChatGPT, Claude, Copilot) for mental health support -- going so far as to replace their therapists. These anecdotes suggest that AI agents have great potential to offer accessible mental health support. However, it's unclear how to meet this potential in extreme mental health crisis use cases. In this work, we explore the first-person experience of turning to a conversational AI agent in a mental health crisis. From a testimonial survey (n = 53) of lived experiences, we find that people use AI agents to fill the in-between spaces of human support; they turn to AI due to lack of access to mental health professionals or fears of burdening others. At the same time, our interviews with mental health experts (n = 16) suggest that human-human connection is an essential positive action when managing a mental health crisis. Using the stages of change model, our results suggest that a responsible AI crisis intervention is one that increases the user's preparedness to take a positive action while de-escalating any intended negative action. We discuss the implications of designing conversational AI agents as bridges towards human-human connection rather than ends in themselves.

Related papers

• Stumbling Into AI Emotional Dependence: How Routine AI Interactions Reshape Human Connection [4.874541709090152]
  We show that AI emotional support commonly emerges incidentally within task-oriented interactions on general-purpose platforms.<n>Positive experiences of AI emotional support update people's beliefs about AI's emotional capabilities, increasing preference for AI and decreasing preference for humans.<n>We argue that effective regulations should extend to general-purpose AI systems and address cumulative, trajectory-level changes in how people seek support.
  arXiv  Detail & Related papers  (2026-06-02T19:18:39Z)
• When Should AI Read the Room? Public Perceptions of Social Intelligence in AI Agents [61.06747336710885]
  Social-AI agents are increasingly deployed in everyday settings.<n>Public perceptions of social intelligence in AI agents and the acceptability of these agents remain largely understudied.<n>We present a mixed-methods survey of adults in the United States.
  arXiv  Detail & Related papers  (2026-05-28T13:49:47Z)
• A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Services [0.5009488052972938]
  We show how generative AI can be used to enhance and scale training in mental health service provision.<n>We highlight key benefits of using generative AI to help train people to provide mental health services.<n>We illustrate why we should invest in using generative AI to support training people in mental health service provision.
  arXiv  Detail & Related papers  (2025-10-08T23:44:52Z)
• Technological folie à deux: Feedback Loops Between AI Chatbots and Mental Illness [11.364198566966204]
  We argue that individuals with mental health conditions face increased risks of chatbots-induced belief destabilization and dependence.<n>Current AI safety measures are inadequate to address these interaction-based risks.<n>To address this emerging public health concern, we need coordinated action across clinical practice, AI development, and regulatory frameworks.
  arXiv  Detail & Related papers  (2025-07-25T12:38:54Z)
• AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depression [5.093381538166489]
  This work explores the relationship between lived experience values, potential harms, and design recommendations for mental health AI chatbots.<n>We developed a technology probe, a GPT-4o based chatbots called Zenny, enabling participants to engage with depression self-management scenarios.<n>Our thematic analysis revealed key values: informational support, emotional support, personalization, privacy, and crisis management.
  arXiv  Detail & Related papers  (2025-04-26T14:17:25Z)
• EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safety [42.052840895090284]
  EmoAgent is a multi-agent AI framework designed to evaluate and mitigate mental health hazards in human-AI interactions.<n>EmoEval simulates virtual users, including those portraying mentally vulnerable individuals, to assess mental health changes before and after interactions with AI characters.<n>EmoGuard serves as an intermediary, monitoring users' mental status, predicting potential harm, and providing corrective feedback to mitigate risks.
  arXiv  Detail & Related papers  (2025-04-13T18:47:22Z)
• AutoCBT: An Autonomous Multi-agent Framework for Cognitive Behavioral Therapy in Psychological Counseling [57.054489290192535]
  Traditional in-person psychological counseling remains primarily niche, often chosen by individuals with psychological issues.<n>Online automated counseling offers a potential solution for those hesitant to seek help due to feelings of shame.
  arXiv  Detail & Related papers  (2025-01-16T09:57:12Z)
• From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agents [21.66189033227397]
  Our work presents a novel risk taxonomy focusing on psychological risks of using AI gathered through the lived experiences of individuals.<n>Our taxonomy features 19 AI behaviors, 21 negative psychological impacts, and 15 contexts related to individuals.
  arXiv  Detail & Related papers  (2024-12-10T22:31:29Z)
• Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations [58.65755268815283]
  Many real dialogues are interactive, meaning an agent's utterances will influence their conversational partner, elicit information, or change their opinion. We use this fact to rewrite and augment existing suboptimal data, and train via offline reinforcement learning (RL) an agent that outperforms both prompting and learning from unaltered human demonstrations. Our results in a user study with real humans show that our approach greatly outperforms existing state-of-the-art dialogue agents.
  arXiv  Detail & Related papers  (2024-11-07T21:37:51Z)
• Chatbots for Mental Health Support: Exploring the Impact of Emohaa on Reducing Mental Distress in China [50.12173157902495]
  The study included 134 participants, split into three groups: Emohaa (CBT-based), Emohaa (Full) and control. Emohaa is a conversational agent that provides cognitive support through CBT-based exercises and guided conversations. It also emotionally supports users by enabling them to vent their desired emotional problems.
  arXiv  Detail & Related papers  (2022-09-21T08:23:40Z)
• Mental Illness Classification on Social Media Texts using Deep Learning and Transfer Learning [55.653944436488786]
  According to the World health organization (WHO), approximately 450 million people are affected. Mental illnesses, such as depression, anxiety, bipolar disorder, ADHD, and PTSD. This study analyzes unstructured user data on Reddit platform and classifies five common mental illnesses: depression, anxiety, bipolar disorder, ADHD, and PTSD.
  arXiv  Detail & Related papers  (2022-07-03T11:33:52Z)
• Coral: An Approach for Conversational Agents in Mental Health Applications [0.0]
  We present an approach for creating a generative empathetic open-domain robot that can be used for mental health applications. We leverage large scale pre-training and empathetic conversational data to make the responses more empathetic in nature. Our models achieve state-of-the-art results on the Empathetic Dialogues test set.
  arXiv  Detail & Related papers  (2021-11-16T15:15:58Z)
• Trustworthy AI: A Computational Perspective [54.80482955088197]
  We focus on six of the most crucial dimensions in achieving trustworthy AI: (i) Safety & Robustness, (ii) Non-discrimination & Fairness, (iii) Explainability, (iv) Privacy, (v) Accountability & Auditability, and (vi) Environmental Well-Being. For each dimension, we review the recent related technologies according to a taxonomy and summarize their applications in real-world systems.
  arXiv  Detail & Related papers  (2021-07-12T14:21:46Z)
• Towards Socially Intelligent Agents with Mental State Transition and Human Utility [97.01430011496576]
  We propose to incorporate a mental state and utility model into dialogue agents. The hybrid mental state extracts information from both the dialogue and event observations. The utility model is a ranking model that learns human preferences from a crowd-sourced social commonsense dataset.
  arXiv  Detail & Related papers  (2021-03-12T00:06:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.