How public datasets constrain the development of diversity-aware news recommender systems, and what law could do about it

• URL: http://arxiv.org/abs/2510.05952v1
• Date: Tue, 07 Oct 2025 14:08:38 GMT
• Title: How public datasets constrain the development of diversity-aware news recommender systems, and what law could do about it
• Authors: Max van Drunen, Sanne Vrijenhoek,
• Abstract summary: We argue that to realise diversity-aware recommender systems in practice, it is crucial to pay attention to the datasets that are needed to train modern news recommenders.<n>First, we identify the information a dataset must include to enable the development of the diversity-aware news recommender systems proposed in normative literature.<n>Second, we analyse why and how European law and policy can be used to provide researchers with structural access to the data they need to develop diversity-aware news recommender systems.
• Score: 0.21485350418225244
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: News recommender systems increasingly determine what news individuals see online. Over the past decade, researchers have extensively critiqued recommender systems that prioritise news based on user engagement. To offer an alternative, researchers have analysed how recommender systems could support the media's ability to fulfil its role in democratic society by recommending news based on editorial values, particularly diversity. However, there continues to be a large gap between normative theory on how news recommender systems should incorporate diversity, and technical literature that designs such systems. We argue that to realise diversity-aware recommender systems in practice, it is crucial to pay attention to the datasets that are needed to train modern news recommenders. We aim to make two main contributions. First, we identify the information a dataset must include to enable the development of the diversity-aware news recommender systems proposed in normative literature. Based on this analysis, we assess the limitations of currently available public datasets, and show what potential they do have to expand research into diversity-aware recommender systems. Second, we analyse why and how European law and policy can be used to provide researchers with structural access to the data they need to develop diversity-aware news recommender systems.

Related papers

• What News Recommendation Research Did (But Mostly Didn't) Teach Us About Building A News Recommender [7.075738038423935]
  We report on our experience trying to apply the news recommendation literature to build POPROX, a live platform for news recommendation research.<n>Our experience highlights several unexpected challenges encountered in building personalization features that are commonly found in products from news aggregators and publishers.
  arXiv  Detail & Related papers  (2025-09-15T18:50:52Z)
• Cognitive Biases in Large Language Models for News Recommendation [68.90354828533535]
  This paper explores the potential impact of cognitive biases on large language models (LLMs) based news recommender systems. We discuss strategies to mitigate these biases through data augmentation, prompt engineering and learning algorithms aspects.
  arXiv  Detail & Related papers  (2024-10-03T18:42:07Z)
• All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era [63.649070507815715]
  We aim to integrate recommender systems into a broader picture, and pave the way for more comprehensive solutions for future research. We identify two evolution paths of modern recommender systems -- via list-wise recommendation and conversational recommendation. We point out that the information effectiveness of the recommendation is increased, while the user's acquisition cost is decreased.
  arXiv  Detail & Related papers  (2024-07-14T05:02:21Z)
• Behind Recommender Systems: the Geography of the ACM RecSys Community [0.0]
  We look into the geographic diversity of the recommender systems research community. This study has been carried out in the framework of the Diversity in AI - DivinAI project.
  arXiv  Detail & Related papers  (2023-09-07T06:46:53Z)
• Impression-Aware Recommender Systems [53.48892326556546]
  We present a systematic literature review on recommender systems using impressions.<n>We define a theoretical framework to delimit recommender systems using impressions and a novel paradigm for personalized recommendations, called impression-aware recommender systems.
  arXiv  Detail & Related papers  (2023-08-15T16:16:02Z)
• A Survey on Fairness-aware Recommender Systems [59.23208133653637]
  We present concepts of fairness in different recommendation scenarios, comprehensively categorize current advances, and introduce typical methods to promote fairness in different stages of recommender systems. Next, we delve into the significant influence that fairness-aware recommender systems exert on real-world industrial applications.
  arXiv  Detail & Related papers  (2023-06-01T07:08:22Z)
• Towards Corpus-Scale Discovery of Selection Biases in News Coverage: Comparing What Sources Say About Entities as a Start [65.28355014154549]
  This paper investigates the challenges of building scalable NLP systems for discovering patterns of media selection biases directly from news content in massive-scale news corpora. We show the capabilities of the framework through a case study on NELA-2020, a corpus of 1.8M news articles in English from 519 news sources worldwide.
  arXiv  Detail & Related papers  (2023-04-06T23:36:45Z)
• A News Recommender System Considering Temporal Dynamics and Diversity [0.0]
  In a news recommender system, a reader's preferences change over time. Some preferences drift quite abruptly (short-term preferences), while others change over a longer period of time. Our system should be able to: (i) accommodate the dynamics in reader behavior; and (ii) consider both accuracy and diversity in the design of the recommendation model.
  arXiv  Detail & Related papers  (2021-03-23T13:45:34Z)
• Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces [1.3286165491120467]
  We operationalize the notion of framing, adopted from communication science. We apply this notion to a re-ranking of topic-relevant recommended lists. Our offline evaluation indicates that the proposed method is capable of enhancing the viewpoint diversity of recommendation lists.
  arXiv  Detail & Related papers  (2021-01-15T14:40:34Z)
• Diversity in News Recommendations [9.507578388046847]
  News diversity in the media has for a long time been a foundational and uncontested basis for ensuring communicative needs of individuals and society at large are met. Today, people increasingly rely on online content and recommender systems to consume information challenging the traditional concept of news diversity. In addition, the very concept of diversity, which differs between disciplines, will need to be re-evaluated requiring a interdisciplinary investigation.
  arXiv  Detail & Related papers  (2020-05-19T14:51:15Z)
• A Survey on Knowledge Graph-Based Recommender Systems [65.50486149662564]
  We conduct a systematical survey of knowledge graph-based recommender systems. We focus on how the papers utilize the knowledge graph for accurate and explainable recommendation. We introduce datasets used in these works.
  arXiv  Detail & Related papers  (2020-02-28T02:26:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.