You See It, They Don't: An Exploratory Study of User-to-User Variation in Instagram Comments
- URL: http://arxiv.org/abs/2603.21953v1
- Date: Mon, 23 Mar 2026 13:10:16 GMT
- Title: You See It, They Don't: An Exploratory Study of User-to-User Variation in Instagram Comments
- Abstract summary: In March 2025, Meta announced a new AI system to rank the order of the comments shown to Instagram users.<n>This paper presents a small-scale exploratory study examining whether the ranking system produces systematic differences in visible comments shown to different users.<n>We find that visible comments on news posts are less likely to vary across users than those on non-news posts.
- Score: 0.3699222009113239
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In March 2025, Meta announced a new AI system to rank the order of the comments shown to Instagram users. With existing research showing how feed personalization systems can lead to increased polarization, the introduction of this new system raises similar questions. This paper presents a small-scale exploratory study examining whether the ranking system produces systematic differences in visible comments shown to different users, particularly for news-related content. Using four sock-puppet accounts varying in gender and political leaning, we collect visible comments on posts from ten news and ten non-news accounts. This collection is repeated twice from two VPN locations to assess location effects. We ask 1) how many visible comments vary across different users, 2) is this variation higher for news accounts than non-news accounts, and 3) can user-attributes like gender, political leaning, and location systematically explain the observed variation. Contrary to our expectations, we find that visible comments on news posts are less likely to vary across users than those on non-news posts. Variation is better explained by account metrics like comment and follower counts than by user attributes. These findings provide an initial glimpse into personalized comment ranking on Instagram and motivate larger, more systematic audits of how comment personalization may shape online discourse. To support further research, we provide the code to collect comments and the data upon request.
Related papers
- How Does Empowering Users with Greater System Control Affect News Filter Bubbles? [8.13225949083307]
We design a political news recommendation system augmented with an enhanced interface that exposes the political and topical interests the system inferred from user behavior.<n>We conduct a user study to compare our system to a traditional interface and found that the transparent approach helped users realize that they were in a filter bubble.
arXiv Detail & Related papers (2026-06-04T20:25:38Z) - Let Silence Speak: Enhancing Fake News Detection with Generated Comments from Large Language Models [17.612043837566134]
Comments could reflect users' opinions, stances, and emotions and models deepen their understanding of fake news.
Due to exposure bias and users' different willingness to comment, it is not easy to obtain diverse comments in reality.
We propose GenFEND, a generated feedback-enhanced detection framework, which generates comments by prompting LLMs with diverse user profiles.
arXiv Detail & Related papers (2024-05-26T17:09:23Z) - Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback.
The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied.
We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
arXiv Detail & Related papers (2024-04-19T16:45:50Z) - Personalized Prediction of Offensive News Comments by Considering the
Characteristics of Commenters [0.0]
This study aims to predict such offensive comments to improve the quality of the experience of the reader while reading comments.
By considering the diversity of the readers' values, the proposed method predicts offensive news comments for each reader based on the feedback from a small number of news comments that the reader rated as "offensive" in the past.
The experimental results of the proposed method show that prediction can be personalized even when the amount of readers' feedback data used in the prediction is limited.
arXiv Detail & Related papers (2022-12-26T16:19:03Z) - Listen to what they say: Better understand and detect online
misinformation with user feedback [0.0]
We review c. 9,000 items reported on Facebook and Instagram in France, the UK, and the US in June 2020.
This allows us to observe meaningful distinctions regarding reporting content between countries and platforms.
We derive four types of noise capable of explaining half of the inaccuracy found in content reported as misinformation.
arXiv Detail & Related papers (2022-10-31T09:21:01Z) - Understanding How People Rate Their Conversations [73.17730062864314]
We conduct a study to better understand how people rate their interactions with conversational agents.
We focus on agreeableness and extraversion as variables that may explain variation in ratings.
arXiv Detail & Related papers (2022-06-01T00:45:32Z) - Analyzing Behavioral Changes of Twitter Users After Exposure to
Misinformation [1.8251012479962594]
We aim to understand whether general Twitter users changed their behavior after being exposed to misinformation.
We compare the before and after behavior of exposed users to determine whether the frequency of the tweets they posted underwent any significant change.
We also study the characteristics of two specific user groups, multi-exposure and extreme change groups, which were potentially highly impacted.
arXiv Detail & Related papers (2021-11-01T04:48:07Z) - News consumption and social media regulations policy [70.31753171707005]
We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation.
Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content.
The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
arXiv Detail & Related papers (2021-06-07T19:26:32Z) - Improving Conversational Question Answering Systems after Deployment
using Feedback-Weighted Learning [69.42679922160684]
We propose feedback-weighted learning based on importance sampling to improve upon an initial supervised system using binary user feedback.
Our work opens the prospect to exploit interactions with real users and improve conversational systems after deployment.
arXiv Detail & Related papers (2020-11-01T19:50:34Z) - Causal Understanding of Fake News Dissemination on Social Media [50.4854427067898]
We argue that it is critical to understand what user attributes potentially cause users to share fake news.
In fake news dissemination, confounders can be characterized by fake news sharing behavior that inherently relates to user attributes and online activities.
We propose a principled approach to alleviating selection bias in fake news dissemination.
arXiv Detail & Related papers (2020-10-20T19:37:04Z) - Echo Chambers on Social Media: A comparative analysis [64.2256216637683]
We introduce an operational definition of echo chambers and perform a massive comparative analysis on 1B pieces of contents produced by 1M users on four social media platforms.
We infer the leaning of users about controversial topics and reconstruct their interaction networks by analyzing different features.
We find support for the hypothesis that platforms implementing news feed algorithms like Facebook may elicit the emergence of echo-chambers.
arXiv Detail & Related papers (2020-04-20T20:00:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.