Rapidly Personalizing Mobile Health Treatment Policies with Limited Data
- URL: http://arxiv.org/abs/2002.09971v1
- Date: Sun, 23 Feb 2020 18:59:46 GMT
- Title: Rapidly Personalizing Mobile Health Treatment Policies with Limited Data
- Authors: Sabina Tomkins, Peng Liao, Predrag Klasnja, Serena Yeung, Susan Murphy
- Abstract summary: We present IntelligentPooling, which learns personalized policies via an adaptive, principled use of other users' data.
We show that IntelligentPooling achieves an average of 26% lower regret than state-of-the-art across all generative models.
- Score: 9.07325490998379
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In mobile health (mHealth), reinforcement learning algorithms that adapt to
one's context without learning personalized policies might fail to distinguish
between the needs of individuals. Yet the high amount of noise due to the in
situ delivery of mHealth interventions can cripple the ability of an algorithm
to learn when given access to only a single user's data, making personalization
challenging. We present IntelligentPooling, which learns personalized policies
via an adaptive, principled use of other users' data. We show that
IntelligentPooling achieves an average of 26% lower regret than
state-of-the-art across all generative models. Additionally, we inspect the
behavior of this approach in a live clinical trial, demonstrating its ability
to learn from even a small group of users.
Related papers
- Adaptive Interventions with User-Defined Goals for Health Behavior Change [17.688448640253494]
Mobile health applications present a promising avenue for low-cost, scalable health behavior change promotion.
tailoring advice to a person's unique goals, preferences, and life circumstances is a critical component of health coaching.
We introduce a new Thompson sampling algorithm that can accommodate personalized reward functions.
arXiv Detail & Related papers (2023-11-16T01:00:04Z) - Policy Optimization for Personalized Interventions in Behavioral Health [8.10897203067601]
Behavioral health interventions, delivered through digital platforms, have the potential to significantly improve health outcomes.
We study the problem of optimizing personalized interventions for patients to maximize a long-term outcome.
We present a new approach for this problem that we dub DecompPI, which decomposes the state space for a system of patients to the individual level.
arXiv Detail & Related papers (2023-03-21T21:42:03Z) - A Meta-GNN approach to personalized seizure detection and classification [53.906130332172324]
We propose a personalized seizure detection and classification framework that quickly adapts to a specific patient from limited seizure samples.
We train a Meta-GNN based classifier that learns a global model from a set of training patients.
We show that our method outperforms the baselines by reaching 82.7% on accuracy and 82.08% on F1 score after only 20 iterations on new unseen patients.
arXiv Detail & Related papers (2022-11-01T14:12:58Z) - When Accuracy Meets Privacy: Two-Stage Federated Transfer Learning
Framework in Classification of Medical Images on Limited Data: A COVID-19
Case Study [77.34726150561087]
COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources.
CNN has been widely utilized and verified in analyzing medical images.
arXiv Detail & Related papers (2022-03-24T02:09:41Z) - Interpretable Off-Policy Learning via Hyperbox Search [20.83151214072516]
We propose an algorithm for interpretable off-policy learning via hyperbox search.
Our policies can be represented in disjunctive normal form (i.e., OR-of-ANDs) and are thus intelligible.
We demonstrate that our algorithm outperforms state-of-the-art methods from interpretable off-policy learning in terms of regret.
arXiv Detail & Related papers (2022-03-04T18:10:24Z) - Learning Language and Multimodal Privacy-Preserving Markers of Mood from
Mobile Data [74.60507696087966]
Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care.
One promising data source to help monitor human behavior is daily smartphone usage.
We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
arXiv Detail & Related papers (2021-06-24T17:46:03Z) - The Medkit-Learn(ing) Environment: Medical Decision Modelling through
Simulation [81.72197368690031]
We present a new benchmarking suite designed specifically for medical sequential decision making.
The Medkit-Learn(ing) Environment is a publicly available Python package providing simple and easy access to high-fidelity synthetic medical data.
arXiv Detail & Related papers (2021-06-08T10:38:09Z) - Privacy-Constrained Policies via Mutual Information Regularized Policy Gradients [54.98496284653234]
We consider the task of training a policy that maximizes reward while minimizing disclosure of certain sensitive state variables through the actions.
We solve this problem by introducing a regularizer based on the mutual information between the sensitive state and the actions.
We develop a model-based estimator for optimization of privacy-constrained policies.
arXiv Detail & Related papers (2020-12-30T03:22:35Z) - MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos.
We release a new dataset, MEDICA, for mental health patient engagement detection.
arXiv Detail & Related papers (2020-11-17T15:18:38Z) - IntelligentPooling: Practical Thompson Sampling for mHealth [0.38998241153792446]
Reinforcement learning is ideal for learning how to optimally make sequential treatment decisions.
We generalize Thompson-Sampling bandit algorithms to develop IntelligentPooling.
We show that IntelligentPooling achieves an average of 26% lower regret than state-of-the-art.
arXiv Detail & Related papers (2020-07-31T19:03:09Z) - Anonymizing Data for Privacy-Preserving Federated Learning [3.3673553810697827]
We propose the first syntactic approach for offering privacy in the context of federated learning.
Our approach aims to maximize utility or model performance, while supporting a defensible level of privacy.
We perform a comprehensive empirical evaluation on two important problems in the healthcare domain, using real-world electronic health data of 1 million patients.
arXiv Detail & Related papers (2020-02-21T02:30:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.