Sentiment Analysis Of Shopee Product Reviews Using Distilbert

• URL: http://arxiv.org/abs/2511.22313v1
• Date: Thu, 27 Nov 2025 10:43:51 GMT
• Title: Sentiment Analysis Of Shopee Product Reviews Using Distilbert
• Abstract summary: This study examines the use of DistilBERT, a lightweight transformer-based deep learning model, for sentiment classification on Shopee product reviews.<n>The dataset used consists of approximately one million English-language reviews that have been preprocessed and trained.<n>DistilBERT achieved an accuracy of 94.8%, slightly below BERT (95.3%) but significantly higher than SVM (90.2%), with computation time reduced by more than 55%.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The rapid growth of digital commerce has led to the accumulation of a massive number of consumer reviews on online platforms. Shopee, as one of the largest e-commerce platforms in Southeast Asia, receives millions of product reviews every day containing valuable information regarding customer satisfaction and preferences. Manual analysis of these reviews is inefficient, thus requiring a computational approach such as sentiment analysis. This study examines the use of DistilBERT, a lightweight transformer-based deep learning model, for sentiment classification on Shopee product reviews. The dataset used consists of approximately one million English-language reviews that have been preprocessed and trained using the distilbert-base-uncased model. Evaluation was conducted using accuracy, precision, recall, and F1-score metrics, and compared against benchmark models such as BERT and SVM. The results show that DistilBERT achieved an accuracy of 94.8%, slightly below BERT (95.3%) but significantly higher than SVM (90.2%), with computation time reduced by more than 55%. These findings demonstrate that DistilBERT provides an optimal balance between accuracy and efficiency, making it suitable for large scale sentiment analysis on e-commerce platforms. Keywords: Sentiment Analysis, DistilBERT, Shopee Reviews, Natural Language Processing, Deep Learning, Transformer Models.

Related papers

• Evaluating LLM Usage for Efficient and Explainable Numerical and Classified Implicit Sentiment Analysis of Product Desirability [0.0]
  This paper presents a scalable and interpretable framework that uses large language models (LLMs) to quantify product desirability.<n>The framework also incorporates model confidence ratings and human-readable rationale explanations (xAI)
  arXiv  Detail & Related papers  (2026-06-04T21:16:00Z)
• Benchmarking Logistic Regression, SVM, Naive Bayes, and IndoBERT Fine-Tuning for Sentiment Analysis on Indonesian Product Reviews [0.0]
  This paper benchmarks traditional Machine Learning approaches against a Transformer-based Deep Learning model for a three-class sentiment analysis task.<n>We fine-tuned the IndoBERT model for contextual sequence classification.<n>We demonstrate the practical viability of our pipeline by deploying the final sentiment classification model as an interactive Gradio web application.
  arXiv  Detail & Related papers  (2026-05-05T07:20:42Z)
• Taxonomy-based Negative Sampling In Personalized Semantic Search for E-commerce [46.251483528080236]
  We present a semantic retrieval model for e-commerce search that embeds queries and products into a shared vector space.<n>To further tailor retrievals, we incorporate user-level personalization by modeling each customer's past purchase history and behavior.
  arXiv  Detail & Related papers  (2025-11-01T20:25:00Z)
• LLM Based Sentiment Classification From Bangladesh E-Commerce Reviews [0.0]
  The viability of using transformer-based BERT models for sentiment analysis from Bangladesh e commerce reviews is investigated in this paper.<n>A subset of 4000 samples from the original dataset of Bangla and English customer reviews was utilized to fine-tune the model.<n>The fine tuned Llama-3.1-8B model outperformed other fine-tuned models, with an overall accuracy, precision, recall, and F1 score of 95.5%, 93%, 88%, 90%.
  arXiv  Detail & Related papers  (2025-09-30T16:46:09Z)
• Logits-Based Finetuning [48.18151583153572]
  We propose a logits-based fine-tuning framework that integrates the strengths of supervised learning and knowledge distillation.<n>Our approach constructs enriched training targets by combining teacher logits with ground truth labels, preserving both correctness and linguistic diversity.
  arXiv  Detail & Related papers  (2025-05-30T10:57:09Z)
• OpenCodeReasoning: Advancing Data Distillation for Competitive Coding [61.15402517835137]
  We build a supervised fine-tuning (SFT) dataset to achieve state-of-the-art coding capability results in models of various sizes.<n>Our models use only SFT to achieve 61.8% on LiveCodeBench and 24.6% on CodeContests, surpassing alternatives trained with reinforcement learning.
  arXiv  Detail & Related papers  (2025-04-02T17:50:31Z)
• AI-Driven Sentiment Analytics: Unlocking Business Value in the E-Commerce Landscape [0.0]
  This paper presents an AI-driven sentiment analysis system designed specifically for e-commerce applications.<n>Our approach integrates traditional machine learning techniques with modern deep learning models, allowing for a more nuanced understanding of customer sentiment.<n> Experimental results show that our system outperforms standard sentiment analysis methods, achieving an accuracy of 89.7% on diverse, large-scale datasets.
  arXiv  Detail & Related papers  (2025-03-20T18:56:22Z)
• BanglishRev: A Large-Scale Bangla-English and Code-mixed Dataset of Product Reviews in E-Commerce [2.5874041837241304]
  This work presents the largest e-commerce product review dataset to date for reviews written in Bengali, English, a mixture of both and Banglish, Bengali words written with English alphabets.<n>The dataset comprises of 1.74 million written reviews from 3.2 million ratings information collected from a total of 128k products being sold in online e-commerce platforms targeting the Bengali population.<n>It includes an extensive array of related metadata for each of the reviews including the rating given by the reviewer, date the review was posted and date of purchase, number of likes, dislikes, response from the seller, images associated with the review etc.
  arXiv  Detail & Related papers  (2024-12-17T18:39:10Z)
• What Matters in Explanations: Towards Explainable Fake Review Detection Focusing on Transformers [45.55363754551388]
  Customers' reviews and feedback play crucial role on e-commerce platforms like Amazon, Zalando, and eBay. There is a prevailing concern that sellers often post fake or spam reviews to deceive potential customers and manipulate their opinions about a product. We propose an explainable framework for detecting fake reviews with high precision in identifying fraudulent content with explanations.
  arXiv  Detail & Related papers  (2024-07-24T13:26:02Z)
• An Efficient Recommendation System in E-commerce using Passer learning optimization based on Bi-LSTM [4.483925165891734]
  This article introduces a recommendation system based on Passer Learning Optimization-enhanced Bi-LSTM classifier applicable to e-commerce recommendation systems.<n>It achieves as low as 1.24% MSE on the baby dataset. This lifts it as high as 88.58%. Besides, there is also robust performance of the system on digital music and patio lawn garden datasets at F1 of 88.46% and 92.51%, respectively.
  arXiv  Detail & Related papers  (2023-07-31T20:09:25Z)
• 5-Star Hotel Customer Satisfaction Analysis Using Hybrid Methodology [0.0]
  Our research suggests a new way to find factors for customer satisfaction through review data. Unlike many studies on customer satisfaction that have been conducted in the past, our research has a novelty of the thesis.
  arXiv  Detail & Related papers  (2022-09-26T04:53:10Z)
• DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing [117.41016786835452]
  This paper presents a new pre-trained language model, DeBERTaV3, which improves the original DeBERTa model. vanilla embedding sharing in ELECTRA hurts training efficiency and model performance. We propose a new gradient-disentangled embedding sharing method that avoids the tug-of-war dynamics.
  arXiv  Detail & Related papers  (2021-11-18T06:48:00Z)
• Towards Efficient NLP: A Standard Evaluation and A Strong Baseline [55.29756535335831]
  This work presents ELUE (Efficient Language Understanding Evaluation), a standard evaluation, and a public leaderboard for efficient NLP models. Along with the benchmark, we also pre-train and release a strong baseline, ElasticBERT, whose elasticity is both static and dynamic.
  arXiv  Detail & Related papers  (2021-10-13T21:17:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.