Extracting Consumer Insight from Text: A Large Language Model Approach to Emotion and Evaluation Measurement

• URL: http://arxiv.org/abs/2602.15312v1
• Date: Tue, 17 Feb 2026 02:33:51 GMT
• Title: Extracting Consumer Insight from Text: A Large Language Model Approach to Emotion and Evaluation Measurement
• Authors: Stephan Ludwig, Peter J. Danaher, Xiaohao Yang, Yu-Ting Lin, Ehsan Abedin, Dhruv Grewal, Lan Du,
• Abstract summary: This study introduces the Linguistic eXtractor (LX), a fine-tuned, large language model trained on consumer-authored text.<n>LX consistently outperforms leading models, including GPT-4 Turbo, RoBERTa, and DeepSeek.<n>An application of LX to online retail data, using seemingly unrelated regression, affirms that review-expressed emotions predict product ratings.
• Score: 4.500361771169933
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurately measuring consumer emotions and evaluations from unstructured text remains a core challenge for marketing research and practice. This study introduces the Linguistic eXtractor (LX), a fine-tuned, large language model trained on consumer-authored text that also has been labeled with consumers' self-reported ratings of 16 consumption-related emotions and four evaluation constructs: trust, commitment, recommendation, and sentiment. LX consistently outperforms leading models, including GPT-4 Turbo, RoBERTa, and DeepSeek, achieving 81% macro-F1 accuracy on open-ended survey responses and greater than 95% accuracy on third-party-annotated Amazon and Yelp reviews. An application of LX to online retail data, using seemingly unrelated regression, affirms that review-expressed emotions predict product ratings, which in turn predict purchase behavior. Most emotional effects are mediated by product ratings, though some emotions, such as discontent and peacefulness, influence purchase directly, indicating that emotional tone provides meaningful signals beyond star ratings. To support its use, a no-code, cost-free, LX web application is available, enabling scalable analyses of consumer-authored text. In establishing a new methodological foundation for consumer perception measurement, this research demonstrates new methods for leveraging large language models to advance marketing research and practice, thereby achieving validated detection of marketing constructs from consumer data.

Related papers

• CPR: Leveraging LLMs for Topic and Phrase Suggestion to Facilitate Comprehensive Product Reviews [0.5249805590164902]
  This paper presents CPR, a novel methodology to guide users in crafting insightful and well-rounded reviews.<n>Our approach employs a three-stage process: first, we present users with product-specific terms for rating; second, we generate targeted phrase suggestions based on these ratings.<n>We evaluate CPR using text-to-text LLMs, comparing its performance against real-world customer reviews from Walmart.
  arXiv  Detail & Related papers  (2025-04-18T17:11:38Z)
• My Words Imply Your Opinion: Reader Agent-based Propagation Enhancement for Personalized Implicit Emotion Analysis [11.628440499885238]
  We introduce Personalized IEA (PIEA) and present the RAPPIE model, which addresses subjective variability by incorporating reader feedback.<n>We create reader agents based on large language models to simulate reader feedback.<n>We construct two new PIEA datasets covering English and Chinese social media with detailed user metadata.
  arXiv  Detail & Related papers  (2024-12-10T10:06:46Z)
• Towards Empathetic Conversational Recommender Systems [77.53167131692]
  We propose an empathetic conversational recommender (ECR) framework. ECR contains two main modules: emotion-aware item recommendation and emotion-aligned response generation. Our experiments on the ReDial dataset validate the efficacy of our framework in enhancing recommendation accuracy and improving user satisfaction.
  arXiv  Detail & Related papers  (2024-08-30T15:43:07Z)
• What Matters in Explanations: Towards Explainable Fake Review Detection Focusing on Transformers [45.55363754551388]
  Customers' reviews and feedback play crucial role on e-commerce platforms like Amazon, Zalando, and eBay. There is a prevailing concern that sellers often post fake or spam reviews to deceive potential customers and manipulate their opinions about a product. We propose an explainable framework for detecting fake reviews with high precision in identifying fraudulent content with explanations.
  arXiv  Detail & Related papers  (2024-07-24T13:26:02Z)
• AiGen-FoodReview: A Multimodal Dataset of Machine-Generated Restaurant Reviews and Images on Social Media [57.70351255180495]
  AiGen-FoodReview is a dataset of 20,144 restaurant review-image pairs divided into authentic and machine-generated. We explore unimodal and multimodal detection models, achieving 99.80% multimodal accuracy with FLAVA. The paper contributes by open-sourcing the dataset and releasing fake review detectors, recommending its use in unimodal and multimodal fake review detection tasks, and evaluating linguistic and visual features in synthetic versus authentic data.
  arXiv  Detail & Related papers  (2024-01-16T20:57:36Z)
• Bring Your Own Data! Self-Supervised Evaluation for Large Language Models [52.15056231665816]
  We propose a framework for self-supervised evaluation of Large Language Models (LLMs) We demonstrate self-supervised evaluation strategies for measuring closed-book knowledge, toxicity, and long-range context dependence. We find strong correlations between self-supervised and human-supervised evaluations.
  arXiv  Detail & Related papers  (2023-06-23T17:59:09Z)
• Measuring the Effect of Influential Messages on Varying Personas [67.1149173905004]
  We present a new task, Response Forecasting on Personas for News Media, to estimate the response a persona might have upon seeing a news message. The proposed task not only introduces personalization in the modeling but also predicts the sentiment polarity and intensity of each response. This enables more accurate and comprehensive inference on the mental state of the persona.
  arXiv  Detail & Related papers  (2023-05-25T21:01:00Z)
• 5-Star Hotel Customer Satisfaction Analysis Using Hybrid Methodology [0.0]
  Our research suggests a new way to find factors for customer satisfaction through review data. Unlike many studies on customer satisfaction that have been conducted in the past, our research has a novelty of the thesis.
  arXiv  Detail & Related papers  (2022-09-26T04:53:10Z)
• SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item Recommendation [48.1799451277808]
  We propose a Sentiment-aware Interactive Fusion Network (SIFN) for review-based item recommendation. We first encode user/item reviews via BERT and propose a light-weighted sentiment learner to extract semantic features of each review. Then, we propose a sentiment prediction task that guides the sentiment learner to extract sentiment-aware features via explicit sentiment labels.
  arXiv  Detail & Related papers  (2021-08-18T08:04:38Z)
• SentiLSTM: A Deep Learning Approach for Sentiment Analysis of Restaurant Reviews [13.018530502810128]
  This paper proposes, a deep learning-based technique (i.e., BiLSTM) to classify the reviews provided by the clients of the restaurant into positive and negative polarities. The results of the evaluation on test dataset show that BiLSTM technique produced in the highest accuracy of 91.35%.
  arXiv  Detail & Related papers  (2020-11-19T06:24:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.