Revisiting Rogers' Paradox in the Context of Human-AI Interaction

• URL: http://arxiv.org/abs/2501.10476v1
• Date: Thu, 16 Jan 2025 17:09:57 GMT
• Title: Revisiting Rogers' Paradox in the Context of Human-AI Interaction
• Authors: Katherine M. Collins, Umang Bhatt, Ilia Sucholutsky,
• Abstract summary: We revisit Rogers' Paradox in the context of human-AI interaction to probe a simplified network of humans and AI systems learning together. We consider strategies that can be undertaken by various stakeholders involved in a single human-AI interaction.
• Score: 18.026810528463084
• License:
• Abstract: Humans learn about the world, and how to act in the world, in many ways: from individually conducting experiments to observing and reproducing others' behavior. Different learning strategies come with different costs and likelihoods of successfully learning more about the world. The choice that any one individual makes of how to learn can have an impact on the collective understanding of a whole population if people learn from each other. Alan Rogers developed simulations of a population of agents to study these network phenomena where agents could individually or socially learn amidst a dynamic, uncertain world and uncovered a confusing result: the availability of cheap social learning yielded no benefit to population fitness over individual learning. This paradox spawned decades of work trying to understand and uncover factors that foster the relative benefit of social learning that centuries of human behavior suggest exists. What happens in such network models now that humans can socially learn from AI systems that are themselves socially learning from us? We revisit Rogers' Paradox in the context of human-AI interaction to probe a simplified network of humans and AI systems learning together about an uncertain world. We propose and examine the impact of several learning strategies on the quality of the equilibrium of a society's 'collective world model'. We consider strategies that can be undertaken by various stakeholders involved in a single human-AI interaction: human, AI model builder, and society or regulators around the interaction. We then consider possible negative feedback loops that may arise from humans learning socially from AI: that learning from the AI may impact our own ability to learn about the world. We close with open directions into studying networks of human and AI systems that can be explored in enriched versions of our simulation framework.

Related papers

• Artificial Theory of Mind and Self-Guided Social Organisation [1.8434042562191815]
  One of the challenges artificial intelligence (AI) faces is how a collection of agents coordinate their behaviour to achieve goals that are not reachable by any single agent. We make the case for collective intelligence in a general setting, drawing on recent work from single neuron complexity in neural networks. We show how our social structures are influenced by our neuro-physiology, our psychology, and our language.
  arXiv  Detail & Related papers  (2024-11-14T04:06:26Z)
• Shifting the Human-AI Relationship: Toward a Dynamic Relational Learning-Partner Model [0.0]
  We advocate for a shift toward viewing AI as a learning partner, akin to a student who learns from interactions with humans. We suggest that a "third mind" emerges through collaborative human-AI relationships.
  arXiv  Detail & Related papers  (2024-10-07T19:19:39Z)
• Social Learning through Interactions with Other Agents: A Survey [10.080296323732863]
  Social learning plays an important role in the development of human intelligence. Recent advances in natural language processing (NLP) enable us to perform new forms of social learning. We look at how behavioural cloning and next-token prediction mirror human imitation.
  arXiv  Detail & Related papers  (2024-07-31T16:06:34Z)
• Explainable Human-AI Interaction: A Planning Perspective [32.477369282996385]
  AI systems need to be explainable to the humans in the loop. We will discuss how the AI agent can use mental models to either conform to human expectations, or change those expectations through explanatory communication. While the main focus of the book is on cooperative scenarios, we will point out how the same mental models can be used for obfuscation and deception.
  arXiv  Detail & Related papers  (2024-05-19T22:22:21Z)
• AI-enhanced Collective Intelligence [2.5063318977668465]
  Humans and AI possess complementary capabilities that can surpass the collective intelligence of either humans or AI in isolation. This review incorporates perspectives from complex network science to conceptualize a multilayer representation of human-AI collective intelligence. We explore how agents' diversity and interactions influence the system's collective intelligence and analyze real-world instances of AI-enhanced collective intelligence.
  arXiv  Detail & Related papers  (2024-03-15T16:11:15Z)
• Human-AI Coevolution [48.74579595505374]
  Coevolution AI is a process in which humans and AI algorithms continuously influence each other. This paper introduces Coevolution AI as the cornerstone for a new field of study at the intersection between AI and complexity science.
  arXiv  Detail & Related papers  (2023-06-23T18:10:54Z)
• Fairness in AI and Its Long-Term Implications on Society [68.8204255655161]
  We take a closer look at AI fairness and analyze how lack of AI fairness can lead to deepening of biases over time. We discuss how biased models can lead to more negative real-world outcomes for certain groups. If the issues persist, they could be reinforced by interactions with other risks and have severe implications on society in the form of social unrest.
  arXiv  Detail & Related papers  (2023-04-16T11:22:59Z)
• Learning to Influence Human Behavior with Offline Reinforcement Learning [70.7884839812069]
  We focus on influence in settings where there is a need to capture human suboptimality. Experiments online with humans is potentially unsafe, and creating a high-fidelity simulator of the environment is often impractical. We show that offline reinforcement learning can learn to effectively influence suboptimal humans by extending and combining elements of observed human-human behavior.
  arXiv  Detail & Related papers  (2023-03-03T23:41:55Z)
• World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challenges [51.92834011423463]
  We focus on the two concepts of world models and predictive coding. In neuroscience, predictive coding proposes that the brain continuously predicts its inputs and adapts to model its own dynamics and control behavior in its environment.
  arXiv  Detail & Related papers  (2023-01-14T06:38:14Z)
• Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment [52.07473934146584]
  We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process. Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications. It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
  arXiv  Detail & Related papers  (2022-08-04T23:53:51Z)
• The Short Anthropological Guide to the Study of Ethical AI [91.3755431537592]
  Short guide serves as both an introduction to AI ethics and social science and anthropological perspectives on the development of AI. Aims to provide those unfamiliar with the field with an insight into the societal impact of AI systems and how, in turn, these systems can lead us to rethink how our world operates.
  arXiv  Detail & Related papers  (2020-10-07T12:25:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.