A Dataset of Low-Rated Applications from the Amazon Appstore for User Feedback Analysis
- URL: http://arxiv.org/abs/2601.03009v1
- Date: Tue, 06 Jan 2026 13:32:49 GMT
- Title: A Dataset of Low-Rated Applications from the Amazon Appstore for User Feedback Analysis
- Abstract summary: This study introduces a novel dataset curated from 64 low-rated applications sourced from the Amazon Software Appstore (ASA)<n>The dataset is designed to capture the most frequent issues identified by users, which are critical for improving software quality.
- Score: 5.949233960332969
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In todays digital landscape, end-user feedback plays a crucial role in the evolution of software applications, particularly in addressing issues that hinder user experience. While much research has focused on high-rated applications, low-rated applications often remain unexplored, despite their potential to reveal valuable insights. This study introduces a novel dataset curated from 64 low-rated applications sourced from the Amazon Software Appstore (ASA), containing 79,821 user reviews. The dataset is designed to capture the most frequent issues identified by users, which are critical for improving software quality. To further enhance the dataset utility, a subset of 6000 reviews was manually annotated to classify them into six district issue categories: user interface (UI) and user experience (UX), functionality and features, compatibility and device specificity, performance and stability, customer support and responsiveness, and security and privacy issues. This annotated dataset is a valuable resource for developing machine learning-based approaches aiming to automate the classification of user feedback into various issue types. Making both the annotated and raw datasets publicly available provides researchers and developers with a crucial tool to understand common issues in low-rated apps and inform software improvements. The comprehensive analysis and availability of this dataset lay the groundwork for data-derived solutions to improve software quality based on user feedback. Additionally, the dataset can provide opportunities for software vendors and researchers to explore various software evolution-related activities, including frequently missing features, sarcasm, and associated emotions, which will help better understand the reasons for comparatively low app ratings.
Related papers
- Exploring Ethical Concerns of Mobile Applications from App Reviews: A Literature Survey [0.0]
This paper presents a survey of 37 relevant studies published since 2012.<n>The studies examined vary in review counts, ranging from 500 to 626 million, and include between a single and 1.3 million apps.<n>Our findings identify persistent barriers to privacy, security, accessibility, transparency, fairness, accountability, and safety, as reported by users in app reviews.
arXiv Detail & Related papers (2026-04-18T01:30:06Z) - Understanding Usage and Engagement in AI-Powered Scientific Research Tools: The Asta Interaction Dataset [47.98539809308384]
We analyze the Asta Interaction dataset, a large-scale resource comprising over 200,000 user queries and interaction logs.<n>We characterize query patterns, engagement behaviors, and how usage evolves with experience.<n>We release the anonymized dataset and analysis with a new query taxonomy to inform future designs of real-world AI research assistants.
arXiv Detail & Related papers (2026-02-26T18:40:28Z) - AUTO-Explorer: Automated Data Collection for GUI Agent [58.58097564914626]
We propose an automated data collection method with minimal annotation costs, named Auto-Explorer.<n>It incorporates a simple yet effective exploration mechanism that autonomously parses and explores GUI environments.<n>Using the data gathered, we fine-tune a multimodal large language model (MLLM) and establish a GUI element grounding testing set.
arXiv Detail & Related papers (2025-11-09T15:13:45Z) - The Software Observatory: aggregating and analysing software metadata for trend computation and FAIR assessment [0.0]
The Software Observatory at OpenEBench is a novel web portal that consolidates software metadata from various sources.<n>Our platform enables users to analyse trends, identify patterns and advancements within the Life Sciences research software ecosystem.
arXiv Detail & Related papers (2025-10-07T09:15:02Z) - OSS-UAgent: An Agent-based Usability Evaluation Framework for Open Source Software [47.02288620982592]
Our framework employs intelligent agents powered by large language models (LLMs) to simulate developers performing programming tasks.<n> OSS-UAgent ensures accurate and context-aware code generation.<n>Our demonstration showcases OSS-UAgent's practical application in evaluating graph analytics platforms.
arXiv Detail & Related papers (2025-05-29T08:40:10Z) - From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets [19.140541190998842]
Software defect datasets are collections of software bugs and their associated information.<n>Over the years, numerous software defect datasets have been developed, providing rich resources for the community.<n>This article provides a comprehensive survey of 132 software defect datasets.
arXiv Detail & Related papers (2025-04-24T23:07:04Z) - Synthetic Data Generation with Large Language Models for Personalized Community Question Answering [47.300506002171275]
We build Sy-SE-PQA based on an existing dataset, SE-PQA, which consists of questions and answers posted on the popular StackExchange communities.
Our findings suggest that LLMs have high potential in generating data tailored to users' needs.
The synthetic data can replace human-written training data, even if the generated data may contain incorrect information.
arXiv Detail & Related papers (2024-10-29T16:19:08Z) - On the Automated Processing of User Feedback [7.229732269884235]
User feedback is an increasingly important source of information for requirements engineering, user interface design, and software engineering.
To tap the full potential of feedback, there are two main challenges that need to be solved.
Vendors must cope with a large quantity of feedback data, which is hard to manage manually.
Second, vendors must also cope with a varying quality of feedback as some items might be uninformative, repetitive, or simply wrong.
arXiv Detail & Related papers (2024-07-22T10:13:13Z) - Towards Extracting Ethical Concerns-related Software Requirements from App Reviews [0.0]
This study analyzes app reviews of the Uber mobile application (a popular taxi/ride app)
We propose a novel approach that leverages a knowledge graph (KG) model to extract software requirements from app reviews.
Our framework consists of three main components: developing an ontology with relevant entities and relations, extracting key entities from app reviews, and creating connections between them.
arXiv Detail & Related papers (2024-07-19T04:50:32Z) - Automated Requirements Relation Extraction [4.110571395660999]
This chapter aims at providing a clear perspective on the theoretical and practical fundamentals in the field of natural language-based relation extraction.<n>We first describe the fundamentals of requirements relations based on the most relevant literature in the field, including the most common requirements relations types.<n>The core of the chapter is composed by two main sections: (i) natural language techniques for the identification and categorization of equirements relations (i.e., syntactic vs. semantic techniques) and (ii) information extraction methods for the task of relation extraction.
arXiv Detail & Related papers (2024-01-22T16:14:27Z) - Unveiling Inclusiveness-Related User Feedback in Mobile Applications [7.212232917917022]
We leverage user feedback from Reddit, Google Play Store, and X for 50 of the most popular apps in the world.<n>Using a Socio-Technical Grounded Theory approach, we analyzed 22,000 posts across the three sources.<n>We organize our results in a taxonomy for inclusiveness comprising 5 major categories: Algorithmic Bias, Technology, Demography, Accessibility, and Other Human Values.
arXiv Detail & Related papers (2023-11-02T04:05:46Z) - User Simulation for Evaluating Information Access Systems [38.48048183731099]
evaluating the effectiveness of interactive intelligent systems is a complex scientific challenge.
This book provides a thorough understanding of user simulation techniques designed specifically for evaluation.
It covers both general frameworks for designing user simulators, and specific models and algorithms for simulating user interactions with search engines, recommender systems, and conversational assistants.
arXiv Detail & Related papers (2023-06-14T14:54:06Z) - DataPerf: Benchmarks for Data-Centric AI Development [81.03754002516862]
DataPerf is a community-led benchmark suite for evaluating ML datasets and data-centric algorithms.
We provide an open, online platform with multiple rounds of challenges to support this iterative development.
The benchmarks, online evaluation platform, and baseline implementations are open source.
arXiv Detail & Related papers (2022-07-20T17:47:54Z) - Robustar: Interactive Toolbox Supporting Precise Data Annotation for
Robust Vision Learning [53.900911121695536]
We introduce the initial release of our software Robustar.
It aims to improve the robustness of vision classification machine learning models through a data-driven perspective.
arXiv Detail & Related papers (2022-07-18T21:12:28Z) - Emerging App Issue Identification via Online Joint Sentiment-Topic
Tracing [66.57888248681303]
We propose a novel emerging issue detection approach named MERIT.
Based on the AOBST model, we infer the topics negatively reflected in user reviews for one app version.
Experiments on popular apps from Google Play and Apple's App Store demonstrate the effectiveness of MERIT.
arXiv Detail & Related papers (2020-08-23T06:34:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.