Estimating Causal Effects of Multi-Aspect Online Reviews with
Multi-Modal Proxies
- URL: http://arxiv.org/abs/2112.10274v1
- Date: Sun, 19 Dec 2021 22:29:02 GMT
- Title: Estimating Causal Effects of Multi-Aspect Online Reviews with
Multi-Modal Proxies
- Authors: Lu Cheng, Ruocheng Guo, Huan Liu
- Abstract summary: This work empirically examines the causal effects of user-generated online reviews on a granular level.
We consider multiple aspects, e.g., the Food and Service of a restaurant.
- Score: 24.246450472404614
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Online reviews enable consumers to engage with companies and provide
important feedback. Due to the complexity of the high-dimensional text, these
reviews are often simplified as a single numerical score, e.g., ratings or
sentiment scores. This work empirically examines the causal effects of
user-generated online reviews on a granular level: we consider multiple
aspects, e.g., the Food and Service of a restaurant. Understanding consumers'
opinions toward different aspects can help evaluate business performance in
detail and strategize business operations effectively. Specifically, we aim to
answer interventional questions such as What will the restaurant popularity be
if the quality w.r.t. its aspect Service is increased by 10%? The defining
challenge of causal inference with observational data is the presence of
"confounder", which might not be observed or measured, e.g., consumers'
preference to food type, rendering the estimated effects biased and
high-variance. To address this challenge, we have recourse to the multi-modal
proxies such as the consumer profile information and interactions between
consumers and businesses. We show how to effectively leverage the rich
information to identify and estimate causal effects of multiple aspects
embedded in online reviews. Empirical evaluations on synthetic and real-world
data corroborate the efficacy and shed light on the actionable insight of the
proposed approach.
Related papers
- Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback.
The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied.
We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
arXiv Detail & Related papers (2024-04-19T16:45:50Z) - AiGen-FoodReview: A Multimodal Dataset of Machine-Generated Restaurant
Reviews and Images on Social Media [57.70351255180495]
AiGen-FoodReview is a dataset of 20,144 restaurant review-image pairs divided into authentic and machine-generated.
We explore unimodal and multimodal detection models, achieving 99.80% multimodal accuracy with FLAVA.
The paper contributes by open-sourcing the dataset and releasing fake review detectors, recommending its use in unimodal and multimodal fake review detection tasks, and evaluating linguistic and visual features in synthetic versus authentic data.
arXiv Detail & Related papers (2024-01-16T20:57:36Z) - Decoding the Silent Majority: Inducing Belief Augmented Social Graph
with Large Language Model for Response Forecasting [74.68371461260946]
SocialSense is a framework that induces a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics.
Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings.
arXiv Detail & Related papers (2023-10-20T06:17:02Z) - Measuring the Effect of Influential Messages on Varying Personas [67.1149173905004]
We present a new task, Response Forecasting on Personas for News Media, to estimate the response a persona might have upon seeing a news message.
The proposed task not only introduces personalization in the modeling but also predicts the sentiment polarity and intensity of each response.
This enables more accurate and comprehensive inference on the mental state of the persona.
arXiv Detail & Related papers (2023-05-25T21:01:00Z) - Fair Effect Attribution in Parallel Online Experiments [57.13281584606437]
A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services.
It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly.
Despite a perfect randomization between different groups, simultaneous experiments can interact with each other and create a negative impact on average population outcomes.
arXiv Detail & Related papers (2022-10-15T17:15:51Z) - 5-Star Hotel Customer Satisfaction Analysis Using Hybrid Methodology [0.0]
Our research suggests a new way to find factors for customer satisfaction through review data.
Unlike many studies on customer satisfaction that have been conducted in the past, our research has a novelty of the thesis.
arXiv Detail & Related papers (2022-09-26T04:53:10Z) - Generating Persuasive Responses to Customer Reviews with Multi-Source
Prior Knowledge in E-commerce [11.586256303135329]
Customer reviews usually contain much information about one's online shopping experience.
It is of vital importance to carefully and persuasively reply to each negative review and minimize its disadvantageous effect.
We propose a Multi-Source Multi-Aspect Attentive Generation model for persuasive response generation.
arXiv Detail & Related papers (2022-09-20T06:20:45Z) - Impact of review valence and perceived uncertainty on purchase of
time-constrained and discounted search goods [0.0]
This study investigates how purchase decisions for new products are affected by past customer aggregate ratings when a soon-to-expire discount is being offered.
Considering review credibility, diagnosticity, and effectiveness as determinants of consumer attitude in a time-constrained search and purchase environment, we follow the approach-avoidance conflict theory.
arXiv Detail & Related papers (2021-10-09T19:50:08Z) - Effects of Multi-Aspect Online Reviews with Unobserved Confounders:
Estimation and Implication [19.74820808192969]
We study the effects of online reviews on business revenue and direct effects with the numerical cause -- ratings -- being the mediator.
We draw on recent advances in machine learning and causal inference to together estimate the hidden confounders and causal effects.
We present empirical evaluations using real-world examples to discuss the importance and implications of differentiating the multi-aspect effects in strategizing business operations.
arXiv Detail & Related papers (2021-10-04T23:38:21Z) - SentiLSTM: A Deep Learning Approach for Sentiment Analysis of Restaurant
Reviews [13.018530502810128]
This paper proposes, a deep learning-based technique (i.e., BiLSTM) to classify the reviews provided by the clients of the restaurant into positive and negative polarities.
The results of the evaluation on test dataset show that BiLSTM technique produced in the highest accuracy of 91.35%.
arXiv Detail & Related papers (2020-11-19T06:24:42Z) - Face to Purchase: Predicting Consumer Choices with Structured Facial and
Behavioral Traits Embedding [53.02059906193556]
We propose to predict consumers' purchases based on their facial features and purchasing histories.
We design a semi-supervised model based on a hierarchical embedding network to extract high-level features of consumers.
Our experimental results on a real-world dataset demonstrate the positive effect of incorporating facial information in predicting consumers' purchasing behaviors.
arXiv Detail & Related papers (2020-07-14T06:06:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.