Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery

• URL: http://arxiv.org/abs/2404.03023v1
• Date: Wed, 3 Apr 2024 19:18:25 GMT
• Title: Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery
• Authors: Jinkyung Park, Vivek Singh, Pamela Wisniewski,
• Abstract summary: We discuss the current landscape and opportunities for Conversation Agents (CAs) to support adolescents' mental and sexual health knowledge discovery. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.
• Score: 0.22530496464901104
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Following the recent release of various Artificial Intelligence (AI) based Conversation Agents (CAs), adolescents are increasingly using CAs for interactive knowledge discovery on sensitive topics, including mental and sexual health topics. Exploring such sensitive topics through online search has been an essential part of adolescent development, and CAs can support their knowledge discovery on such topics through human-like dialogues. Yet, unintended risks have been documented with adolescents' interactions with AI-based CAs, such as being exposed to inappropriate content, false information, and/or being given advice that is detrimental to their mental and physical well-being (e.g., to self-harm). In this position paper, we discuss the current landscape and opportunities for CAs to support adolescents' mental and sexual health knowledge discovery. We also discuss some of the challenges related to ensuring the safety of adolescents when interacting with CAs regarding sexual and mental health topics. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.

Related papers

• The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses [16.35125470386213]
  As social media becomes young people's main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. We discuss the role of training in online peer support exchange and its implications for supporting young people's well-being.
  arXiv  Detail & Related papers  (2024-05-04T16:53:19Z)
• Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading Activities [52.828843153565984]
  AI-based storytelling and reading technologies are becoming increasingly ubiquitous in preschoolers' lives. This paper investigates how they function in practical storytelling and reading scenarios and, how parents, the most critical stakeholders, experience and perceive them. Our findings suggest that even though AI-based storytelling and reading technologies provide more immersive and engaging interaction, they still cannot meet parents' expectations due to a series of interactive and algorithmic challenges.
  arXiv  Detail & Related papers  (2024-01-24T20:55:40Z)
• Enabling High-Level Machine Reasoning with Cognitive Neuro-Symbolic Systems [67.01132165581667]
  We propose to enable high-level reasoning in AI systems by integrating cognitive architectures with external neuro-symbolic components. We illustrate a hybrid framework centered on ACT-R and we discuss the role of generative models in recent and future applications.
  arXiv  Detail & Related papers  (2023-11-13T21:20:17Z)
• Cognitively Inspired Components for Social Conversational Agents [2.1408617023874443]
  Two key categories of problem remain for conversational agents (CAs) technical problems resulting from the approach taken in creating the CA, such as scope with retrieval agents and the often nonsensical answers of former generative agents. Humans perceive CAs as social actors, and as a result expect the CA to adhere to social convention. This paper presents a survey highlighting a potential solution to both categories of problem through the introduction of cognitively inspired additions to the CA.
  arXiv  Detail & Related papers  (2023-11-09T15:38:58Z)
• The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agents [27.464382586864254]
  We argue that AI research should be informed by psychology and study socio-cognitive abilities enabling to enter a culture too. We present The SocialAI school - a tool including a customizable parameterized uite of procedurally generated environments.
  arXiv  Detail & Related papers  (2023-07-15T19:05:56Z)
• "Alexa doesn't have that many feelings": Children's understanding of AI through interactions with smart speakers in their homes [0.0]
  Children's understanding of AI-supported technology has educational implications. Findings will enable educators to develop appropriate materials to address the pressing need for AI literacy.
  arXiv  Detail & Related papers  (2023-05-09T16:39:34Z)
• The Role of AI in Drug Discovery: Challenges, Opportunities, and Strategies [97.5153823429076]
  The benefits, challenges and drawbacks of AI in this field are reviewed. The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
  arXiv  Detail & Related papers  (2022-12-08T23:23:39Z)
• TalkTive: A Conversational Agent Using Backchannels to Engage Older Adults in Neurocognitive Disorders Screening [51.97352212369947]
  We analyzed 246 conversations of cognitive assessments between older adults and human assessors. We derived the categories of reactive backchannels and proactive backchannels. This is used in the development of TalkTive, a CA which can predict both timing and form of backchanneling.
  arXiv  Detail & Related papers  (2022-02-16T17:55:34Z)
• StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement [61.47157418485633]
  We developed StoryBuddy, an AI-enabled system for parents to create interactive storytelling experiences. A user study validated StoryBuddy's usability and suggested design insights for future parent-AI collaboration systems.
  arXiv  Detail & Related papers  (2022-02-13T04:53:28Z)
• From Psychological Curiosity to Artificial Curiosity: Curiosity-Driven Learning in Artificial Intelligence Tasks [56.20123080771364]
  Psychological curiosity plays a significant role in human intelligence to enhance learning through exploration and information acquisition. In the Artificial Intelligence (AI) community, artificial curiosity provides a natural intrinsic motivation for efficient learning. CDL has become increasingly popular, where agents are self-motivated to learn novel knowledge.
  arXiv  Detail & Related papers  (2022-01-20T17:07:03Z)
• Interactive Storytelling for Children: A Case-study of Design and Development Considerations for Ethical Conversational AI [0.20999222360659603]
  Conversational Artificial Intelligence (CAI) systems and Intelligent Personal Assistants (IPA) are becoming ubiquitous in our lives. This paper reflects on the social context within a specific case of technology development, as substantiated and supported by argumentation from within the literature. Further research that engages with developers and stakeholders in the ethics of storytelling through CAI is highlighted as a matter of urgency.
  arXiv  Detail & Related papers  (2021-07-20T15:11:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.