Bridging the Skills Gap: Evaluating an AI-Assisted Provider Platform to Support Care Providers with Empathetic Delivery of Protocolized Therapy

• URL: http://arxiv.org/abs/2401.03631v1
• Date: Mon, 8 Jan 2024 02:23:17 GMT
• Title: Bridging the Skills Gap: Evaluating an AI-Assisted Provider Platform to Support Care Providers with Empathetic Delivery of Protocolized Therapy
• Abstract summary: Despite high prevalence and burden of mental health conditions, there is a global shortage of mental health providers. We developed AI-Assisted Provider Platform (A2P2), a text-based virtual therapy interface that includes a response feature. We studied providers with and without expertise in mental health treatment delivering a therapy session using the platform with (intervention) and without (control) AI-assistance features.
• Score: 5.6317091933490495
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Despite the high prevalence and burden of mental health conditions, there is a global shortage of mental health providers. Artificial Intelligence (AI) methods have been proposed as a way to address this shortage, by supporting providers with less extensive training as they deliver care. To this end, we developed the AI-Assisted Provider Platform (A2P2), a text-based virtual therapy interface that includes a response suggestion feature, which supports providers in delivering protocolized therapies empathetically. We studied providers with and without expertise in mental health treatment delivering a therapy session using the platform with (intervention) and without (control) AI-assistance features. Upon evaluation, the AI-assisted system significantly decreased response times by 29.34% (p=0.002), tripled empathic response accuracy (p=0.0001), and increased goal recommendation accuracy by 66.67% (p=0.001) across both user groups compared to the control. Both groups rated the system as having excellent usability.

Related papers

• CAIA in Practice: Field Evaluation of an AI-Assisted Support System for Text-Based Online Counselling [0.27988103729716907]
  CAIA is a co-designed AI-based tool suite that demonstrates responsible AI integration into counselling practice.<n>A field evaluation involved 34 professional counsellors conducting authentic sessions with trained student counsellees.
  arXiv  Detail & Related papers  (2026-08-23T07:22:05Z)
• Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Support [22.031194303408792]
  We introduce a framework that formulates therapeutic response generation as a decision-refinement problem driven by human-aligned evaluation.<n>In Stage I, we introduce TheraJudge, an open-source therapeutic evaluator trained via preference-based optimization on human-annotated data.<n>In Stage II, we introduce TheraAgent, which operationalizes TheraJudge's evaluations through a coordinated refinement process.
  arXiv  Detail & Related papers  (2026-06-29T20:22:25Z)
• Toward an AI Reasoning-Enabled System for Patient-Clinical Trial Matching [0.0]
  We present a secure, scalable proof-of-concept system for Artificial Intelligence (AI)-augmented patient-trial matching.<n>The system generates structured eligibility assessments with interpretable reasoning chains that support human-in-the-loop review.<n>The system aims to reduce coordinator burden, intelligently broaden the set of trials considered for each patient and guarantee comprehensive auditability of all AI-generated outputs.
  arXiv  Detail & Related papers  (2025-12-08T20:35:51Z)
• DispatchMAS: Fusing taxonomy and artificial intelligence agents for emergency medical services [49.70819009392778]
  Large Language Models (LLMs) and Multi-Agent Systems (MAS) offer opportunities to augment dispatchers.<n>This study aimed to develop and evaluate a taxonomy-grounded, multi-agent system for simulating realistic scenarios.
  arXiv  Detail & Related papers  (2025-10-24T08:01:21Z)
• Using AI to Optimize Patient Transfer and Resource Utilization During Mass-Casualty Incidents: A Simulation Platform [0.014285185279360277]
  Mass incidents (MCIs) overwhelm healthcare systems and demand rapid patient-hospital allocation decisions.<n>We developed and validated a deep reinforcement learning-based decision-support AI agent to optimize patient transfer decisions.<n>MasTER is a web-accessible command dashboard for MCI management simulations.
  arXiv  Detail & Related papers  (2025-09-10T16:46:54Z)
• Toward the Autonomous AI Doctor: Quantitative Benchmarking of an Autonomous Agentic AI Versus Board-Certified Clinicians in a Real World Setting [0.0]
  Globally we face a projected shortage of 11 million healthcare practitioners by 2030.<n>No end-to-end autonomous large language model (LLM)-based AI system has been rigorously evaluated in real-world clinical practice.
  arXiv  Detail & Related papers  (2025-06-27T19:04:44Z)
• MoodAngels: A Retrieval-augmented Multi-agent Framework for Psychiatry Diagnosis [58.67342568632529]
  MoodAngels is the first specialized multi-agent framework for mood disorder diagnosis.<n>MoodSyn is an open-source dataset of 1,173 synthetic psychiatric cases.
  arXiv  Detail & Related papers  (2025-06-04T09:18:25Z)
• Leveraging AI for Automatic Classification of PCOS Using Ultrasound Imaging [0.0]
  The AUTO-PCOS Classification Challenge seeks to advance the diagnostic capabilities of artificial intelligence (AI) in identifying Polycystic Ovary Syndrome (PCOS) This report outlines our methodology for building a robust AI pipeline utilizing transfer learning with the InceptionV3 architecture to achieve high accuracy in binary classification.
  arXiv  Detail & Related papers  (2024-12-30T11:56:11Z)
• TheraGen: Therapy for Every Generation [0.3277163122167434]
  TheraGen provides all-day personalized, compassionate mental health care. Our implementation employs transfer learning, fine-tuning, and advanced training techniques to optimize performance. The system achieved a BLEU score of 0.67 and a ROUGE score of 0.62, indicating strong response accuracy.
  arXiv  Detail & Related papers  (2024-09-12T17:15:44Z)
• Toward Large Language Models as a Therapeutic Tool: Comparing Prompting Techniques to Improve GPT-Delivered Problem-Solving Therapy [6.952909762512736]
  We examine the effects of prompt engineering to guide Large Language Models (LLMs) in delivering parts of a Problem-Solving Therapy session via text. We demonstrate that the models' capability to deliver protocolized therapy can be improved with the proper use of prompt engineering methods.
  arXiv  Detail & Related papers  (2024-08-27T17:25:16Z)
• Privacy Aware Question-Answering System for Online Mental Health Risk Assessment [0.45935798913942893]
  Social media platforms have enabled individuals suffering from mental illnesses to share their lived experiences and find the online support necessary to cope. We propose a Question-Answering (QA) approach to assess mental health risk using the Unified-QA model on two large mental health datasets. Our results demonstrate the effectiveness of modeling risk assessment as a QA task, specifically for mental health use cases.
  arXiv  Detail & Related papers  (2023-06-09T03:37:49Z)
• Robust and Efficient Medical Imaging with Self-Supervision [80.62711706785834]
  We present REMEDIS, a unified representation learning strategy to improve robustness and data-efficiency of medical imaging AI. We study a diverse range of medical imaging tasks and simulate three realistic application scenarios using retrospective data.
  arXiv  Detail & Related papers  (2022-05-19T17:34:18Z)
• Adherence Forecasting for Guided Internet-Delivered Cognitive Behavioral Therapy: A Minimally Data-Sensitive Approach [59.535699822923]
  Internet-delivered psychological treatments (IDPT) are seen as an effective and scalable pathway to improving the accessibility of mental healthcare. This work proposes a deep-learning approach to perform automatic adherence forecasting, while relying on minimally sensitive login/logout data. The proposed Self-Attention Network achieved over 70% average balanced accuracy, when only 1/3 of the treatment duration had elapsed.
  arXiv  Detail & Related papers  (2022-01-11T13:55:57Z)
• Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy: Iterative Design and Evaluation with Therapists and Post-Stroke Survivors [66.07833535962762]
  Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction. Previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, but deployment remains a challenge. We present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient's exercises.
  arXiv  Detail & Related papers  (2021-06-15T22:06:39Z)
• NUVA: A Naming Utterance Verifier for Aphasia Treatment [49.114436579008476]
  Assessment of speech performance using picture naming tasks is a key method for both diagnosis and monitoring of responses to treatment interventions by people with aphasia (PWA) Here we present NUVA, an utterance verification system incorporating a deep learning element that classifies 'correct' versus'incorrect' naming attempts from aphasic stroke patients. When tested on eight native British-English speaking PWA the system's performance accuracy ranged between 83.6% to 93.6%, with a 10-fold cross-validation mean of 89.5%.
  arXiv  Detail & Related papers  (2021-02-10T13:00:29Z)
• MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
  We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos. We release a new dataset, MEDICA, for mental health patient engagement detection.
  arXiv  Detail & Related papers  (2020-11-17T15:18:38Z)
• Artificial Intelligence Decision Support for Medical Triage [0.0]
  We developed a triage system, now certified and in use at the largest European telemedicine provider. The system evaluates care alternatives through interactions with patients via a mobile application. Reasoning on an initial set of provided symptoms, the triage application generates AI-powered, personalized questions to better characterize the problem.
  arXiv  Detail & Related papers  (2020-11-09T16:45:01Z)
• Opportunities of a Machine Learning-based Decision Support System for Stroke Rehabilitation Assessment [64.52563354823711]
  Rehabilitation assessment is critical to determine an adequate intervention for a patient. Current practices of assessment mainly rely on therapist's experience, and assessment is infrequently executed due to the limited availability of a therapist. We developed an intelligent decision support system that can identify salient features of assessment using reinforcement learning.
  arXiv  Detail & Related papers  (2020-02-27T17:04:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.