Unveiling Inclusiveness-Related User Feedback in Mobile Applications
- URL: http://arxiv.org/abs/2311.00984v2
- Date: Sun, 01 Dec 2024 05:13:07 GMT
- Title: Unveiling Inclusiveness-Related User Feedback in Mobile Applications
- Authors: Nowshin Nawar Arony, Ze Shi Li, Daniela Damian, Bowen Xu,
- Abstract summary: We leverage user feedback from Reddit, Google Play Store, and X for 50 of the most popular apps in the world.
Using a Socio-Technical Grounded Theory approach, we analyzed 22,000 posts across the three sources.
We organize our results in a taxonomy for inclusiveness comprising 5 major categories: Algorithmic Bias, Technology, Demography, Accessibility, and Other Human Values.
- Score: 7.212232917917022
- License:
- Abstract: In an era of rapidly expanding software usage, catering to the diverse needs of users from various backgrounds has become a critical challenge. Inclusiveness, representing a core human value, is frequently overlooked during software development, leading to user dissatisfaction. Users often engage in discourse on online platforms where they indicate their concerns. In this study, we leverage user feedback from three popular online sources Reddit, Google Play Store, and X, for 50 of the most popular apps in the world. Using a Socio-Technical Grounded Theory approach, we analyzed 22,000 posts across the three sources. We organize our empirical results in a taxonomy for inclusiveness comprising 5 major categories: Algorithmic Bias, Technology, Demography, Accessibility, and Other Human Values. To explore automated support for identifying inclusiveness-related posts, we experimented with a large language model (GPT4o-mini) and found that it is capable of identifying inclusiveness-related user feedback. We provide implications and recommendations that can help software practitioners to better identify inclusiveness issues to support a wider range of users
Related papers
- On the Automated Processing of User Feedback [7.229732269884235]
User feedback is an increasingly important source of information for requirements engineering, user interface design, and software engineering.
To tap the full potential of feedback, there are two main challenges that need to be solved.
Vendors must cope with a large quantity of feedback data, which is hard to manage manually.
Second, vendors must also cope with a varying quality of feedback as some items might be uninformative, repetitive, or simply wrong.
arXiv Detail & Related papers (2024-07-22T10:13:13Z) - SADAS: A Dialogue Assistant System Towards Remediating Norm Violations
in Bilingual Socio-Cultural Conversations [56.31816995795216]
Socially-Aware Dialogue Assistant System (SADAS) is designed to ensure that conversations unfold with respect and understanding.
Our system's novel architecture includes: (1) identifying the categories of norms present in the dialogue, (2) detecting potential norm violations, (3) evaluating the severity of these violations, and (4) implementing targeted remedies to rectify the breaches.
arXiv Detail & Related papers (2024-01-29T08:54:21Z) - The Best Ends by the Best Means: Ethical Concerns in App Reviews [2.0625936401496237]
App store reviews allow practitioners to collect users' perspectives, crucial for identifying software flaws.
We collected five million user reviews, developed a set of ethical concerns representative of user preferences, and manually labeled a sample of these reviews.
We found that users highly report ethical concerns about censorship, identity theft, and safety.
arXiv Detail & Related papers (2024-01-19T23:53:26Z) - User Attitudes to Content Moderation in Web Search [49.1574468325115]
We examine the levels of support for different moderation practices applied to potentially misleading and/or potentially offensive content in web search.
We find that the most supported practice is informing users about potentially misleading or offensive content, and the least supported one is the complete removal of search results.
More conservative users and users with lower levels of trust in web search results are more likely to be against content moderation in web search.
arXiv Detail & Related papers (2023-10-05T10:57:15Z) - UltraFeedback: Boosting Language Models with Scaled AI Feedback [99.4633351133207]
We present textscUltraFeedback, a large-scale, high-quality, and diversified AI feedback dataset.
Our work validates the effectiveness of scaled AI feedback data in constructing strong open-source chat language models.
arXiv Detail & Related papers (2023-10-02T17:40:01Z) - Proactive Prioritization of App Issues via Contrastive Learning [2.6763498831034043]
We propose a new framework, PPrior, that enables proactive prioritization of app issues through identifying prominent reviews.
PPrior employs a pre-trained T5 model and works in three phases.
Phase one adapts the pre-trained T5 model to the user reviews data in a self-supervised fashion.
Phase two, we leverage contrastive training to learn a generic and task-independent representation of user reviews.
arXiv Detail & Related papers (2023-03-12T06:23:10Z) - Identifying Experts in Question & Answer Portals: A Case Study on Data
Science Competencies in Reddit [0.0]
We inspect the feasibility of identifying data science experts in Reddit.
Our method is based on the manual coding results where two data science experts labelled not only expert and non-expert comments, but also out-of-scope comments.
We present a semi-supervised approach which combines 1,113 labelled comments with 100,226 unlabelled comments during training.
arXiv Detail & Related papers (2022-04-08T14:30:59Z) - Advances and Challenges in Conversational Recommender Systems: A Survey [133.93908165922804]
We provide a systematic review of the techniques used in current conversational recommender systems (CRSs)
We summarize the key challenges of developing CRSs into five directions.
These research directions involve multiple research fields like information retrieval (IR), natural language processing (NLP), and human-computer interaction (HCI)
arXiv Detail & Related papers (2021-01-23T08:53:15Z) - Emerging App Issue Identification via Online Joint Sentiment-Topic
Tracing [66.57888248681303]
We propose a novel emerging issue detection approach named MERIT.
Based on the AOBST model, we infer the topics negatively reflected in user reviews for one app version.
Experiments on popular apps from Google Play and Apple's App Store demonstrate the effectiveness of MERIT.
arXiv Detail & Related papers (2020-08-23T06:34:05Z) - Topic Modeling on User Stories using Word Mover's Distance [4.378337862197529]
This paper focuses on topic modeling as a means to identify topics within a large set of crowd-generated user stories.
We evaluate the approaches on a publicly available set of 2,966 user stories written and categorized by crowd workers.
arXiv Detail & Related papers (2020-07-10T11:05:42Z) - Deep Learning for Person Re-identification: A Survey and Outlook [233.36948173686602]
Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras.
By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings.
arXiv Detail & Related papers (2020-01-13T12:49:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.