An Adaptive Optimization Approach to Personalized Financial Incentives
in Mobile Behavioral Weight Loss Interventions
- URL: http://arxiv.org/abs/2307.00444v2
- Date: Fri, 14 Jul 2023 18:25:17 GMT
- Title: An Adaptive Optimization Approach to Personalized Financial Incentives
in Mobile Behavioral Weight Loss Interventions
- Authors: Qiaomei Li, Kara L. Gavin, Corrine I. Voils, Yonatan Mintz
- Abstract summary: We create a machine learning approach that is able to predict how individuals may react to different incentive schedules.
We use this predictive model in an adaptive framework that computes what incentives to disburse to participants and remain within the study budget.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Obesity is a critical healthcare issue affecting the United States. The least
risky treatments available for obesity are behavioral interventions meant to
promote diet and exercise. Often these interventions contain a mobile component
that allows interventionists to collect participants level data and provide
participants with incentives and goals to promote long term behavioral change.
Recently, there has been interest in using direct financial incentives to
promote behavior change. However, adherence is challenging in these
interventions, as each participant will react differently to different
incentive structure and amounts, leading researchers to consider personalized
interventions. The key challenge for personalization, is that the clinicians do
not know a priori how best to administer incentives to participants, and given
finite intervention budgets how to disburse costly resources efficiently. In
this paper, we consider this challenge of designing personalized weight loss
interventions that use direct financial incentives to motivate weight loss
while remaining within a budget. We create a machine learning approach that is
able to predict how individuals may react to different incentive schedules
within the context of a behavioral intervention. We use this predictive model
in an adaptive framework that over the course of the intervention computes what
incentives to disburse to participants and remain within the study budget. We
provide both theoretical guarantees for our modeling and optimization
approaches as well as demonstrate their performance in a simulated weight loss
study. Our results highlight the cost efficiency and effectiveness of our
personalized intervention design for weight loss.
Related papers
- Improving Fast Adversarial Training Paradigm: An Example Taxonomy Perspective [61.38753850236804]
Fast adversarial training (FAT) is presented for efficient training and has become a hot research topic.
FAT suffers from catastrophic overfitting, which leads to a performance drop compared with multi-step adversarial training.
We present an example taxonomy in FAT, which identifies that catastrophic overfitting is caused by the imbalance between the inner and outer optimization in FAT.
arXiv Detail & Related papers (2024-07-22T03:56:27Z) - Improving Engagement and Efficacy of mHealth Micro-Interventions for Stress Coping: an In-The-Wild Study [4.704094564944504]
The Personalized Context-aware intervention selection algorithm improves engagement and efficacy of mHealth interventions.
Even brief, one-minute interventions can significantly reduce perceived stress levels.
Our study contributes to the literature by introducing a personalized context-aware intervention selection algorithm.
arXiv Detail & Related papers (2024-07-16T11:22:22Z) - Reduced-Rank Multi-objective Policy Learning and Optimization [57.978477569678844]
In practice, causal researchers do not have a single outcome in mind a priori.
In government-assisted social benefit programs, policymakers collect many outcomes to understand the multidimensional nature of poverty.
We present a data-driven dimensionality-reduction methodology for multiple outcomes in the context of optimal policy learning.
arXiv Detail & Related papers (2024-04-29T08:16:30Z) - Adaptive Interventions with User-Defined Goals for Health Behavior Change [17.688448640253494]
Mobile health applications present a promising avenue for low-cost, scalable health behavior change promotion.
tailoring advice to a person's unique goals, preferences, and life circumstances is a critical component of health coaching.
We introduce a new Thompson sampling algorithm that can accommodate personalized reward functions.
arXiv Detail & Related papers (2023-11-16T01:00:04Z) - Designing and evaluating an online reinforcement learning agent for
physical exercise recommendations in N-of-1 trials [0.9865722130817715]
We present an innovative N-of-1 trial study design testing whether implementing a personalized intervention by an online reinforcement learning agent is feasible and effective.
The results show that, first, implementing a personalized intervention by an online reinforcement learning agent is feasible.
Second, such adaptive interventions have the potential to improve patients' benefits even if only few observations are available.
arXiv Detail & Related papers (2023-09-25T14:08:21Z) - Zero-shot causal learning [64.9368337542558]
CaML is a causal meta-learning framework which formulates the personalized prediction of each intervention's effect as a task.
We show that CaML is able to predict the personalized effects of novel interventions that do not exist at the time of training.
arXiv Detail & Related papers (2023-01-28T20:14:11Z) - Actionable Recourse via GANs for Mobile Health [0.0]
Recourse via counterfactuals provides tangible mechanisms to modify user predictions.
We demonstrate the feasibility of GAN-generated recourse for mobile health applications on ensemble-survival-analysis-based prediction of medium-term engagement in the Safe Delivery App.
arXiv Detail & Related papers (2022-11-12T00:25:43Z) - Outcome-Driven Reinforcement Learning via Variational Inference [95.82770132618862]
We discuss a new perspective on reinforcement learning, recasting it as the problem of inferring actions that achieve desired outcomes, rather than a problem of maximizing rewards.
To solve the resulting outcome-directed inference problem, we establish a novel variational inference formulation that allows us to derive a well-shaped reward function.
We empirically demonstrate that this method eliminates the need to design reward functions and leads to effective goal-directed behaviors.
arXiv Detail & Related papers (2021-04-20T18:16:21Z) - Improving healthcare access management by predicting patient no-show
behaviour [0.0]
This work develops a Decision Support System (DSS) to support the implementation of strategies to encourage attendance.
We assess the effectiveness of different machine learning approaches to improve the accuracy of regression models.
In addition to quantifying relationships reported in previous studies, we find that income and neighbourhood crime statistics affect no-show probabilities.
arXiv Detail & Related papers (2020-12-10T14:57:25Z) - Power Constrained Bandits [46.44025793243983]
We develop general meta-algorithms to modify existing algorithms.
Our meta-algorithms are robust to various model mis-specifications possibly appearing in statistical studies.
arXiv Detail & Related papers (2020-04-13T23:08:52Z) - Cost-Sensitive Portfolio Selection via Deep Reinforcement Learning [100.73223416589596]
We propose a cost-sensitive portfolio selection method with deep reinforcement learning.
Specifically, a novel two-stream portfolio policy network is devised to extract both price series patterns and asset correlations.
A new cost-sensitive reward function is developed to maximize the accumulated return and constrain both costs via reinforcement learning.
arXiv Detail & Related papers (2020-03-06T06:28:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.