Ah, that's the great puzzle: On the Quest of a Holistic Understanding of the Harms of Recommender Systems on Children

• URL: http://arxiv.org/abs/2405.02050v1
• Date: Fri, 03 May 2024 12:30:27 GMT
• Title: Ah, that's the great puzzle: On the Quest of a Holistic Understanding of the Harms of Recommender Systems on Children
• Authors: Robin Ungruh, Maria Soledad Pera,
• Abstract summary: Children come across various media items online, many of which are selected by recommender systems (RS) primarily designed for adults. This raises questions about whether such content is appropriate given children's vulnerable stages of development and the potential risks to their well-being. We advocate for researchers, practitioners, and policymakers to undertake a more comprehensive examination of the impact of RS on children.
• Score: 2.0718016474717196
• License:
• Abstract: Children come across various media items online, many of which are selected by recommender systems (RS) primarily designed for adults. The specific nature of the content selected by RS to display on online platforms used by children - although not necessarily targeting them as a user base - remains largely unknown. This raises questions about whether such content is appropriate given children's vulnerable stages of development and the potential risks to their well-being. In this position paper, we reflect on the relationship between RS and children, emphasizing the possible adverse effects of the content this user group might be exposed to online. As a step towards fostering safer interactions for children in online environments, we advocate for researchers, practitioners, and policymakers to undertake a more comprehensive examination of the impact of RS on children - one focused on harms. This would result in a more holistic understanding that could inform the design and deployment of strategies that would better suit children's needs and preferences while actively mitigating the potential harm posed by RS; acknowledging that identifying and addressing these harms is complex and multifaceted.

Related papers

• Risks and NLP Design: A Case Study on Procedural Document QA [52.557503571760215]
  We argue that clearer assessments of risks and harms to users will be possible when we specialize the analysis to more concrete applications and their plausible users. We conduct a risk-oriented error analysis that could then inform the design of a future system to be deployed with lower risk of harm and better performance.
  arXiv  Detail & Related papers  (2024-08-16T17:23:43Z)
• Security Advice for Parents and Children About Content Filtering and Circumvention as Found on YouTube and TikTok [2.743215038883957]
  We examine the advice available to parents and children regarding content filtering and circumvention as found on YouTube and TikTok. Our results show that of these videos, roughly three-quarters are accurate, with the remaining one-fourth containing factually incorrect advice. We find that videos targeting children are both more likely to be incorrect and actionable than videos targeting parents, leaving children at increased risk of taking harmful action.
  arXiv  Detail & Related papers  (2024-02-05T18:12:33Z)
• A safety risk assessment framework for children's online safety based on a novel safety weakness assessment approach [0.43512163406552007]
  This paper addresses the problem of children's online safety in the context of the growing digital landscape. We propose a safety risk assessment approach that focuses specifically on children's online safety.
  arXiv  Detail & Related papers  (2024-01-26T08:50:15Z)
• PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety [70.84902425123406]
  Multi-agent systems, when enhanced with Large Language Models (LLMs), exhibit profound capabilities in collective intelligence. However, the potential misuse of this intelligence for malicious purposes presents significant risks. We propose a framework (PsySafe) grounded in agent psychology, focusing on identifying how dark personality traits in agents can lead to risky behaviors. Our experiments reveal several intriguing phenomena, such as the collective dangerous behaviors among agents, agents' self-reflection when engaging in dangerous behavior, and the correlation between agents' psychological assessments and dangerous behaviors.
  arXiv  Detail & Related papers  (2024-01-22T12:11:55Z)
• On the conformance of Android applications with children's data protection regulations and safeguarding guidelines [3.8029070240258687]
  Even apps designed for children do not always comply with legislation or guidance. This lack of compliance could contribute creating a path to causing physical or mental harm.
  arXiv  Detail & Related papers  (2023-05-15T09:46:56Z)
• On the Security Risks of Knowledge Graph Reasoning [71.64027889145261]
  We systematize the security threats to KGR according to the adversary's objectives, knowledge, and attack vectors. We present ROAR, a new class of attacks that instantiate a variety of such threats. We explore potential countermeasures against ROAR, including filtering of potentially poisoning knowledge and training with adversarially augmented queries.
  arXiv  Detail & Related papers  (2023-05-03T18:47:42Z)
• Mitigating Covertly Unsafe Text within Natural Language Systems [55.26364166702625]
  Uncontrolled systems may generate recommendations that lead to injury or life-threatening consequences. In this paper, we distinguish types of text that can lead to physical harm and establish one particularly underexplored category: covertly unsafe text.
  arXiv  Detail & Related papers  (2022-10-17T17:59:49Z)
• Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders [89.6319385008397]
  We conducted a set of seven design workshops with 35 stakeholders who have been impacted by the child welfare system. We found that participants worried current PRMs perpetuate or exacerbate existing problems in child welfare. Participants suggested new ways to use data and data-driven tools to better support impacted communities.
  arXiv  Detail & Related papers  (2022-05-18T13:49:55Z)
• StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement [61.47157418485633]
  We developed StoryBuddy, an AI-enabled system for parents to create interactive storytelling experiences. A user study validated StoryBuddy's usability and suggested design insights for future parent-AI collaboration systems.
  arXiv  Detail & Related papers  (2022-02-13T04:53:28Z)
• SoK: A Framework for Unifying At-Risk User Research [18.216554583064063]
  At-risk users are people who experience elevated digital security, privacy, and safety threats because of what they do. We present a framework for reasoning about at-risk users based on a wide-ranging meta-analysis of 85 papers.
  arXiv  Detail & Related papers  (2021-12-13T22:27:24Z)
• Understanding parents' perceptions of children's cybersecurity awareness in Norway [3.590867023672793]
  We conducted a study with 25 parents living in Norway with children aged between 10 to 15. Results include a list of cybersecurity awareness needs for children from a parental perspective, a list of learning resources for children, and a list of challenges for parents to ensure cybersecurity at home. Future research should focus on defining cybersecurity theories and practices that contribute to children's and parents' awareness about cybersecurity risks, needs, and solutions.
  arXiv  Detail & Related papers  (2021-08-05T10:42:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.