Surveys without Questions: A Reinforcement Learning Approach
- URL: http://arxiv.org/abs/2006.06323v1
- Date: Thu, 11 Jun 2020 10:41:07 GMT
- Title: Surveys without Questions: A Reinforcement Learning Approach
- Authors: Atanu R Sinha, Deepali Jain, Nikhil Sheoran, Sopan Khosla, Reshmi
Sasidharan
- Abstract summary: We develop an approach based on Reinforcement Learning (RL) to extract proxy ratings from clickstream data.
We introduce two new metrics to represent ratings - one, customer-level and the other, aggregate-level for click actions across customers.
- Score: 12.044303977550229
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The 'old world' instrument, survey, remains a tool of choice for firms to
obtain ratings of satisfaction and experience that customers realize while
interacting online with firms. While avenues for survey have evolved from
emails and links to pop-ups while browsing, the deficiencies persist. These
include - reliance on ratings of very few respondents to infer about all
customers' online interactions; failing to capture a customer's interactions
over time since the rating is a one-time snapshot; and inability to tie back
customers' ratings to specific interactions because ratings provided relate to
all interactions. To overcome these deficiencies we extract proxy ratings from
clickstream data, typically collected for every customer's online interactions,
by developing an approach based on Reinforcement Learning (RL). We introduce a
new way to interpret values generated by the value function of RL, as proxy
ratings. Our approach does not need any survey data for training. Yet, on
validation against actual survey data, proxy ratings yield reasonable
performance results. Additionally, we offer a new way to draw insights from
values of the value function, which allow associating specific interactions to
their proxy ratings. We introduce two new metrics to represent ratings - one,
customer-level and the other, aggregate-level for click actions across
customers. Both are defined around proportion of all pairwise, successive
actions that show increase in proxy ratings. This intuitive customer-level
metric enables gauging the dynamics of ratings over time and is a better
predictor of purchase than customer ratings from survey. The aggregate-level
metric allows pinpointing actions that help or hurt experience. In sum, proxy
ratings computed unobtrusively from clickstream, for every action, for each
customer, and for every session can offer interpretable and more insightful
alternative to surveys.
Related papers
- Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph [49.66272783945571]
We propose Personalized Federated knowledge graph Embedding with client-wise relation graph.
PFedEG learns personalized supplementary knowledge for each client by amalgamating entity embedding from its neighboring clients.
We conduct extensive experiments on four benchmark datasets to evaluate our method against state-of-the-art models.
arXiv Detail & Related papers (2024-06-17T17:44:53Z) - Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback.
The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied.
We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
arXiv Detail & Related papers (2024-04-19T16:45:50Z) - How to Forget Clients in Federated Online Learning to Rank? [34.5695601040165]
We study an effective and efficient unlearning method that can remove a client's contribution without compromising the overall ranker effectiveness.
A key challenge is how to measure whether the model has instructd the contributions from the client $c*$ that has requested removal.
arXiv Detail & Related papers (2024-01-24T12:11:41Z) - Federated Learning via Consensus Mechanism on Heterogeneous Data: A New
Perspective on Convergence [8.849947967636336]
Federated learning (FL) on heterogeneous data (non-IID data) has recently received great attention.
We propose FedCOME, which introduces a consensus mechanism to enforce decreased risk for each client after each training round.
We theoretically show that the consensus mechanism can guarantee the convergence of the global objective.
arXiv Detail & Related papers (2023-11-21T05:26:33Z) - Online Decision Mediation [72.80902932543474]
Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior.
In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
arXiv Detail & Related papers (2023-10-28T05:59:43Z) - OpinSummEval: Revisiting Automated Evaluation for Opinion Summarization [52.720711541731205]
We present OpinSummEval, a dataset comprising human judgments and outputs from 14 opinion summarization models.
Our findings indicate that metrics based on neural networks generally outperform non-neural ones.
arXiv Detail & Related papers (2023-10-27T13:09:54Z) - SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item
Recommendation [48.1799451277808]
We propose a Sentiment-aware Interactive Fusion Network (SIFN) for review-based item recommendation.
We first encode user/item reviews via BERT and propose a light-weighted sentiment learner to extract semantic features of each review.
Then, we propose a sentiment prediction task that guides the sentiment learner to extract sentiment-aware features via explicit sentiment labels.
arXiv Detail & Related papers (2021-08-18T08:04:38Z) - Aggregated Customer Engagement Model [0.571097144710995]
E-commerce websites use machine learned ranking models to serve shopping results to customers.
New or under-impressed products do not have enough customer engagement signals and end up at a disadvantage when being ranked alongside popular products.
We propose a novel method for data curation that aggregates all customer engagements within a day for the same query to use as input training data.
arXiv Detail & Related papers (2021-08-17T20:58:10Z) - Classifying variety of customer's online engagement for churn prediction
with mixed-penalty logistic regression [0.0]
We provide new predictive analytics of customer churn rate based on a machine learning method that enhances the classification of logistic regression by adding a mixed penalty term.
We show the analytical properties of the proposed method and its computational advantage in this research.
arXiv Detail & Related papers (2021-05-17T08:40:34Z) - Graph Neural Networks to Predict Customer Satisfaction Following
Interactions with a Corporate Call Center [6.4047628200011815]
This work describes a fully operational system for predicting customer satisfaction following incoming phone calls.
The system takes as an input speech-to-text transcriptions of calls and predicts call satisfaction reported by customers on post-call surveys.
arXiv Detail & Related papers (2021-01-31T10:13:57Z) - Partial Bandit and Semi-Bandit: Making the Most Out of Scarce Users'
Feedback [62.997667081978825]
We present a novel approach for considering user feedback and evaluate it using three distinct strategies.
Despite a limited number of feedbacks returned by users (as low as 20% of the total), our approach obtains similar results to those of state of the art approaches.
arXiv Detail & Related papers (2020-09-16T07:32:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.