Adapting User Interfaces with Model-based Reinforcement Learning
- URL: http://arxiv.org/abs/2103.06807v1
- Date: Thu, 11 Mar 2021 17:24:34 GMT
- Title: Adapting User Interfaces with Model-based Reinforcement Learning
- Authors: Kashyap Todi, Gilles Bailly, Luis A. Leiva, Antti Oulasvirta
- Abstract summary: Adapting an interface requires taking into account both the positive and negative effects that changes may have on the user.
We propose a novel approach for adaptive user interfaces that yields a conservative adaptation policy.
- Score: 47.469980921522115
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Adapting an interface requires taking into account both the positive and
negative effects that changes may have on the user. A carelessly picked
adaptation may impose high costs to the user -- for example, due to surprise or
relearning effort -- or "trap" the process to a suboptimal design immaturely.
However, effects on users are hard to predict as they depend on factors that
are latent and evolve over the course of interaction. We propose a novel
approach for adaptive user interfaces that yields a conservative adaptation
policy: It finds beneficial changes when there are such and avoids changes when
there are none. Our model-based reinforcement learning method plans sequences
of adaptations and consults predictive HCI models to estimate their effects. We
present empirical and simulation results from the case of adaptive menus,
showing that the method outperforms both a non-adaptive and a frequency-based
policy.
Related papers
- Reinforcement Learning-Based Framework for the Intelligent Adaptation of User Interfaces [0.0]
Adapting the user interface (UI) of software systems to meet the needs and preferences of users is a complex task.
Recent advances in Machine Learning (ML) techniques may provide effective means to support the adaptation process.
In this paper, we instantiate a reference framework for Intelligent User Interface Adaptation by using Reinforcement Learning (RL) as the ML component.
arXiv Detail & Related papers (2024-05-15T11:14:33Z) - Learning from Interaction: User Interface Adaptation using Reinforcement
Learning [0.0]
This thesis proposes an RL-based UI adaptation framework that uses physiological data.
The framework aims to learn from user interactions and make informed adaptations to improve user experience (UX)
arXiv Detail & Related papers (2023-12-12T12:29:18Z) - AdaptSSR: Pre-training User Model with Augmentation-Adaptive
Self-Supervised Ranking [19.1857792382924]
We propose Augmentation-Supervised Ranking (AdaptSSR) to replace the contrastive learning task.
We adopt a multiple pairwise ranking loss which trains the user model to capture the similarity orders between the implicitly augmented view, the explicitly augmented view, and views from other users.
Experiments on both public and industrial datasets with six downstream tasks verify the effectiveness of AdaptSSR.
arXiv Detail & Related papers (2023-10-15T02:19:28Z) - A Comparative Study on Reward Models for UI Adaptation with
Reinforcement Learning [0.6899744489931015]
Reinforcement learning can be used to personalise interfaces for each context of use.
determining the reward of each adaptation alternative is a challenge in RL for UI adaptation.
Recent research has explored the use of reward models to address this challenge, but there is currently no empirical evidence on this type of model.
arXiv Detail & Related papers (2023-08-26T18:31:16Z) - Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform.
Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online.
Intent modeling is thus critical for understanding users and optimizing long-term user experience.
arXiv Detail & Related papers (2022-11-17T19:00:24Z) - Computational Adaptation of XR Interfaces Through Interaction Simulation [4.6193503399184275]
We discuss a computational approach to adapt XR interfaces with the goal of improving user experience and performance.
Our novel model, applied to menu selection tasks, simulates user interactions by considering both cognitive and motor costs.
arXiv Detail & Related papers (2022-04-19T23:37:07Z) - Generative Adversarial Reward Learning for Generalized Behavior Tendency
Inference [71.11416263370823]
We propose a generative inverse reinforcement learning for user behavioral preference modelling.
Our model can automatically learn the rewards from user's actions based on discriminative actor-critic network and Wasserstein GAN.
arXiv Detail & Related papers (2021-05-03T13:14:25Z) - Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate
and Momentum [97.84312669132716]
We disentangle the effects of Adaptive Learning Rate and Momentum of the Adam dynamics on saddle-point escaping and flat minima selection.
Our experiments demonstrate that the proposed adaptive inertia method can generalize significantly better than SGD and conventional adaptive gradient methods.
arXiv Detail & Related papers (2020-06-29T05:21:02Z) - Learning Compliance Adaptation in Contact-Rich Manipulation [81.40695846555955]
We propose a novel approach for learning predictive models of force profiles required for contact-rich tasks.
The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller.
arXiv Detail & Related papers (2020-05-01T05:23:34Z) - Logarithmic Regret Bound in Partially Observable Linear Dynamical
Systems [91.43582419264763]
We study the problem of system identification and adaptive control in partially observable linear dynamical systems.
We present the first model estimation method with finite-time guarantees in both open and closed-loop system identification.
We show that AdaptOn is the first algorithm that achieves $textpolylogleft(Tright)$ regret in adaptive control of unknown partially observable linear dynamical systems.
arXiv Detail & Related papers (2020-03-25T06:00:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.