Exploring Reinforcement Learning for Fluid Transitions Between Clinical Mental Healthcare and Everyday Wellness Support
- URL: http://arxiv.org/abs/2606.06800v1
- Date: Fri, 05 Jun 2026 01:01:56 GMT
- Title: Exploring Reinforcement Learning for Fluid Transitions Between Clinical Mental Healthcare and Everyday Wellness Support
- Abstract summary: We build digital health systems that deliver clinical and wellness interventions proactively.<n>Many benefits of RL-optimized intervention sequences appeared only after interventions ended.<n>Participants most engaged with RL-generated interventions deepened their engagement over time.
- Score: 3.1909307480189324
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Mental health struggles wax and wane, yet clinical and wellness interventions typically operate separately, causing frequent breakdowns at care transitions. We explore reinforcement learning (RL) as a means to build digital health systems that deliver clinical and wellness interventions proactively, as part of a coherent care journey. We ask: what complexities does designing such a system involve? We built a contextual bandit that dynamically selects journaling prompts from clinical and wellness repertoires to optimize for an overarching health goal (sustained journaling) and deployed it in a four-week exploratory study (N=38). We found that, first, many benefits of RL-optimized intervention sequences appeared only after interventions ended, raising the question: Should systems that offer coherent clinical-wellness care journeys include stepping-back periods? If so, when and how? Second, participants most engaged with RL-generated interventions deepened their engagement over time, while those most engaged with a constant intervention tended to burn out and drop out later. It raises the question: When should a system blending clinical and wellness interventions reduce intensity to prevent burnout in versus sustain it to maximize treatment gains?
Related papers
- Ambivalence/Hesitancy Recognition in Videos for Personalized Digital Health Interventions [51.74800196847922]
Ambivalence and hesitancy (A/H) play a primary role for individuals to delay, avoid, or abandon health interventions.<n>While experts can be trained to recognize A/H, integrating them into digital health interventions is costly and less effective.<n>Here, we explore the application of deep learning models for A/H recognition in videos, a multi-modal task by nature.
arXiv Detail & Related papers (2026-04-13T17:05:38Z) - Learning Preference-Based Objectives from Clinical Narratives for Sequential Treatment Decision-Making [8.302720355559359]
We propose a framework for learning reward functions directly from discharge summaries by treating them as scalable supervision for trajectory-level preferences.<n>We derive trajectory quality scores (TQS) and construct pairwise preferences over patient trajectories, enabling reward learning via a structured preference-based objective.
arXiv Detail & Related papers (2026-04-12T19:18:02Z) - Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models [48.95516224614331]
We introduce MedGaze-Bench, the first benchmark leveraging clinician gaze as a Cognitive Cursor to assess intent understanding across surgery, emergency simulation, and diagnostic interpretation.<n>Our benchmark addresses three fundamental challenges: visual homogeneity of anatomical structures, strict temporal-causal dependencies in clinical, and implicit adherence to safety protocols.
arXiv Detail & Related papers (2026-01-11T02:20:40Z) - Realistic CDSS Drug Dosing with End-to-end Recurrent Q-learning for Dual Vasopressor Control [37.613456891934085]
We develop an end-to-end approach for learning optimal drug dosing and control policies for dual vasopressor administration in intensive care unit (ICU) patients with septic shock.<n>For realistic drug dosing, we apply action space design that accommodates discrete, continuous, and directional dosing strategies.<n>The proposed methods achieve improved patient outcomes of over 15% in survival improvement probability, while aligning with established clinical protocols.
arXiv Detail & Related papers (2025-10-01T23:02:00Z) - Towards Regulatory-Confirmed Adaptive Clinical Trials: Machine Learning Opportunities and Solutions [59.28853595868749]
We introduce two new objectives for future clinical trials that integrate regulatory constraints and treatment policy value for both the entire population and under-served populations.<n>We formulate Randomize First Augment Next (RFAN), a new framework for designing Phase III clinical trials.<n>Our framework consists of a standard randomized component followed by an adaptive one, jointly meant to efficiently and safely acquire and assign patients into treatment arms during the trial.
arXiv Detail & Related papers (2025-03-12T10:17:54Z) - A Deployed Online Reinforcement Learning Algorithm In An Oral Health Clinical Trial [20.944037982124037]
Dental disease is a chronic condition associated with substantial financial burden, personal suffering, and increased risk of systemic diseases.<n>Despite widespread recommendations for twice-daily tooth brushing, adherence to recommended oral self-care behaviors remains sub-optimal due to factors such as forgetfulness and disengagement.<n>We developed Oralytics, a mHealth intervention system designed to complement clinician-delivered preventative care for marginalized individuals at risk for dental disease.
arXiv Detail & Related papers (2024-09-03T17:16:01Z) - Improving Engagement and Efficacy of mHealth Micro-Interventions for Stress Coping: an In-The-Wild Study [4.704094564944504]
The Personalized Context-aware intervention selection algorithm improves engagement and efficacy of mHealth interventions.
Even brief, one-minute interventions can significantly reduce perceived stress levels.
Our study contributes to the literature by introducing a personalized context-aware intervention selection algorithm.
arXiv Detail & Related papers (2024-07-16T11:22:22Z) - Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
Time-series learning is the bread and butter of data-driven *clinical decision support*
Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit.
Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
arXiv Detail & Related papers (2023-10-28T12:08:03Z) - Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Care [46.2482873419289]
We introduce a deep Q-learning approach to obtain more reliable critical care policies.
We evaluate our method in off-policy and offline settings using simulated environments and real health records from intensive care units.
arXiv Detail & Related papers (2023-06-13T18:02:57Z) - Real-time landmark detection for precise endoscopic submucosal
dissection via shape-aware relation network [51.44506007844284]
We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery.
We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks.
We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
arXiv Detail & Related papers (2021-11-08T07:57:30Z) - Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in
Application to Preventive Healthcare [39.41918282603752]
We propose a Whittle index based Q-Learning mechanism for restless multi-armed bandit (RMAB) problems.
Our method improves over existing learning-based methods for RMABs on multiple benchmarks from literature and also on the maternal healthcare dataset.
arXiv Detail & Related papers (2021-05-17T15:44:55Z) - Clinical Temporal Relation Extraction with Probabilistic Soft Logic
Regularization and Global Inference [50.029659413650194]
Existing methods either require expensive feature engineering or are incapable of modeling the global dependencies among the events.
In this paper, we propose a novel method, Clinical Temporal ReLation Exaction with Probabilistic Soft Logic Regularization and Global Inference.
arXiv Detail & Related papers (2020-12-16T08:23:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.