Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health

• URL: http://arxiv.org/abs/2604.13381v1
• Date: Wed, 15 Apr 2026 01:10:23 GMT
• Title: Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health
• Abstract summary: Mental health Intelligence Agent (Mia) originally designed for professionals in Australian youth services.<n>32 young people participated in online workshops exploring their perceptions of genAI chatbots in youth mental health.<n>Four themes were developed: (1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground.
• Score: 2.3593804601605353
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Conversational generative artificial intelligence agents (or genAI chatbots) could benefit youth mental health, yet young people's perspectives remain underexplored. We examined the Mental health Intelligence Agent (Mia), a genAI chatbot originally designed for professionals in Australian youth services. Following co-design, 32 young people participated in online workshops exploring their perceptions of genAI chatbots in youth mental health and to develop recommendations for reconceptualising Mia for consumers and integrating it into services. Four themes were developed: (1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground. This study offers insights into young people's attitudes, needs, and requirements regarding genAI chatbots in youth mental health, with key implications for service integration. Additionally, by co-designing system requirements, this work informs the ethics, design, development, implementation, and governance of genAI chatbots in youth mental health contexts.

Related papers

• Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety [45.487432410130474]
  Youth increasingly turn to AI chatbots for social and emotional support.<n>Existing child safety evaluations of AI lack grounding in real-world harms that youth experience.
  arXiv  Detail & Related papers  (2026-08-08T04:00:10Z)
• A Checklist for Trustworthy, Safe, and User-Friendly Mental Health Chatbots [8.847121869959523]
  We dive into the literature to identify critical gaps in the design and implementation of mental health chatbots.<n>We contribute an operational checklist to help guide the development and design of more trustworthy, safe, and user-friendly chatbots.<n>We discuss how this checklist is a step towards supporting more responsible design practices and supporting new standards for sociotechnically sound digital mental health tools.
  arXiv  Detail & Related papers  (2026-01-21T19:24:27Z)
• A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Services [0.5009488052972938]
  We show how generative AI can be used to enhance and scale training in mental health service provision.<n>We highlight key benefits of using generative AI to help train people to provide mental health services.<n>We illustrate why we should invest in using generative AI to support training people in mental health service provision.
  arXiv  Detail & Related papers  (2025-10-08T23:44:52Z)
• Exploring Socio-Cultural Challenges and Opportunities in Designing Mental Health Chatbots for Adolescents in India [5.511657284487823]
  Mental health challenges among Indian adolescents are shaped by unique cultural and systemic barriers.<n>This study explores how adolescents perceive mental health challenges and interact with digital tools.
  arXiv  Detail & Related papers  (2025-03-11T15:52:05Z)
• The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses [16.35125470386213]
  As social media becomes young people's main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. We discuss the role of training in online peer support exchange and its implications for supporting young people's well-being.
  arXiv  Detail & Related papers  (2024-05-04T16:53:19Z)
• Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery [0.22530496464901104]
  We discuss the current landscape and opportunities for Conversation Agents (CAs) to support adolescents' mental and sexual health knowledge discovery. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.
  arXiv  Detail & Related papers  (2024-04-03T19:18:25Z)
• Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading Activities [52.828843153565984]
  AI-based storytelling and reading technologies are becoming increasingly ubiquitous in preschoolers' lives. This paper investigates how they function in practical storytelling and reading scenarios and, how parents, the most critical stakeholders, experience and perceive them. Our findings suggest that even though AI-based storytelling and reading technologies provide more immersive and engaging interaction, they still cannot meet parents' expectations due to a series of interactive and algorithmic challenges.
  arXiv  Detail & Related papers  (2024-01-24T20:55:40Z)
• ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing [45.187790784934734]
  This paper focuses on Conversational XAI for AI-assisted scientific writing tasks. We identify four design rationales: "multifaceted", "controllability", "mix-initiative", "context-aware drill-down" We incorporate them into an interactive prototype, ConvXAI, which facilitates heterogeneous AI explanations for scientific writing through dialogue.
  arXiv  Detail & Related papers  (2023-05-16T19:48:49Z)
• Towards Healthy AI: Large Language Models Need Therapists Too [41.86344997530743]
  We define Healthy AI to be safe, trustworthy and ethical. We present the SafeguardGPT framework that uses psychotherapy to correct for these harmful behaviors.
  arXiv  Detail & Related papers  (2023-04-02T00:39:12Z)
• Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs [77.88043871260466]
  We show that one of today's largest language models lacks this kind of social intelligence out-of-the box. We conclude that person-centric NLP approaches might be more effective towards neural Theory of Mind.
  arXiv  Detail & Related papers  (2022-10-24T14:58:58Z)
• Social Assistive Robotics for Autistic Children [56.524774292536264]
  The goal of the project is testing autistic children's interactions with the social robot NAO. The innovative aspect of the project is that the children robot interaction will consider the children's emotions and specific features.
  arXiv  Detail & Related papers  (2022-09-25T18:28:19Z)
• Mental Illness Classification on Social Media Texts using Deep Learning and Transfer Learning [55.653944436488786]
  According to the World health organization (WHO), approximately 450 million people are affected. Mental illnesses, such as depression, anxiety, bipolar disorder, ADHD, and PTSD. This study analyzes unstructured user data on Reddit platform and classifies five common mental illnesses: depression, anxiety, bipolar disorder, ADHD, and PTSD.
  arXiv  Detail & Related papers  (2022-07-03T11:33:52Z)
• Mental Health Assessment for the Chatbots [39.081479891611664]
  We argue that it should have a healthy mental tendency in order to avoid the negative psychological impact on them. We establish several mental health assessment dimensions for chatbots and introduce the questionnaire-based mental health assessment methods.
  arXiv  Detail & Related papers  (2022-01-14T10:38:59Z)
• CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning [60.348822346249854]
  This study presents a framework whereby several empathetic chatbots are based on understanding users' implied feelings and replying empathetically for multiple dialogue turns. We call these chatbots CheerBots. CheerBots can be retrieval-based or generative-based and were finetuned by deep reinforcement learning. To respond in an empathetic way, we develop a simulating agent, a Conceptual Human Model, as aids for CheerBots in training with considerations on changes in user's emotional states in the future to arouse sympathy.
  arXiv  Detail & Related papers  (2021-10-08T07:44:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.