AI & Human Co-Improvement for Safer Co-Superintelligence

• URL: http://arxiv.org/abs/2512.05356v1
• Date: Fri, 05 Dec 2025 01:50:23 GMT
• Title: AI & Human Co-Improvement for Safer Co-Superintelligence
• Authors: Jason Weston, Jakob Foerster,
• Abstract summary: We advocate that a more achievable and better goal for humanity is to maximize co-improvement: collaboration between human researchers and AIs to achieve co-superintelligence.<n>That is, specifically targeting improving AI systems' ability to work with human researchers to conduct AI research together.
• Score: 34.07423327792328
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Self-improvement is a goal currently exciting the field of AI, but is fraught with danger, and may take time to fully achieve. We advocate that a more achievable and better goal for humanity is to maximize co-improvement: collaboration between human researchers and AIs to achieve co-superintelligence. That is, specifically targeting improving AI systems' ability to work with human researchers to conduct AI research together, from ideation to experimentation, in order to both accelerate AI research and to generally endow both AIs and humans with safer superintelligence through their symbiosis. Focusing on including human research improvement in the loop will both get us there faster, and more safely.

Related papers

• Human-AI Complementarity: A Goal for Amplified Oversight [2.7005766101211663]
  This paper explores how we can leverage AI to improve the quality of human oversight.<n>We find that combining AI ratings and human ratings based on AI rater confidence is better than relying on either alone.
  arXiv  Detail & Related papers  (2025-10-30T14:11:52Z)
• Bridging Minds and Machines: Toward an Integration of AI and Cognitive Science [48.38628297686686]
  Cognitive Science has profoundly shaped disciplines such as Artificial Intelligence (AI), Philosophy, Psychology, Neuroscience, Linguistics, and Culture.<n>Many breakthroughs in AI trace their roots to cognitive theories, while AI itself has become an indispensable tool for advancing cognitive research.<n>We argue that the future of AI within Cognitive Science lies not only in improving performance but also in constructing systems that deepen our understanding of the human mind.
  arXiv  Detail & Related papers  (2025-08-28T11:26:17Z)
• Superintelligence Strategy: Expert Version [64.7113737051525]
  Destabilizing AI developments could raise the odds of great-power conflict.<n>Superintelligence -- AI vastly better than humans at nearly all cognitive tasks -- is now anticipated by AI researchers.<n>We introduce the concept of Mutual Assured AI Malfunction.
  arXiv  Detail & Related papers  (2025-03-07T17:53:24Z)
• AI for social science and social science of AI: A Survey [47.5235291525383]
  Recent advancements in artificial intelligence have sparked a rethinking of artificial general intelligence possibilities. The increasing human-like capabilities of AI are also attracting attention in social science research.
  arXiv  Detail & Related papers  (2024-01-22T10:57:09Z)
• Human-AI Collaboration in Real-World Complex Environment with Reinforcement Learning [8.465957423148657]
  We show that learning from humans is effective and that human-AI collaboration outperforms human-controlled and fully autonomous AI agents. We develop a user interface to allow humans to assist AI agents effectively.
  arXiv  Detail & Related papers  (2023-12-23T04:27:24Z)
• Discriminatory or Samaritan -- which AI is needed for humanity? An Evolutionary Game Theory Analysis of Hybrid Human-AI populations [0.5308606035361203]
  We study how different forms of AI influence the evolution of cooperation in a human population playing the one-shot Prisoner's Dilemma game. We found that Samaritan AI agents that help everyone unconditionally, including defectors, can promote higher levels of cooperation in humans than Discriminatory AIs.
  arXiv  Detail & Related papers  (2023-06-30T15:56:26Z)
• Positive AI: Key Challenges in Designing Artificial Intelligence for Wellbeing [0.5461938536945723]
  Many people are increasingly worried about AI's impact on their lives. To ensure AI progresses beneficially, some researchers have proposed "wellbeing" as a key objective to govern AI. This article addresses key challenges in designing AI for wellbeing.
  arXiv  Detail & Related papers  (2023-04-12T12:43:00Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• Trustworthy AI: A Computational Perspective [54.80482955088197]
  We focus on six of the most crucial dimensions in achieving trustworthy AI: (i) Safety & Robustness, (ii) Non-discrimination & Fairness, (iii) Explainability, (iv) Privacy, (v) Accountability & Auditability, and (vi) Environmental Well-Being. For each dimension, we review the recent related technologies according to a taxonomy and summarize their applications in real-world systems.
  arXiv  Detail & Related papers  (2021-07-12T14:21:46Z)
• Artificial Intelligence & Cooperation [38.19500588776648]
  The rise of Artificial Intelligence will bring with it an ever-increasing willingness to cede decision-making to machines. But rather than just giving machines the power to make decisions that affect us, we need ways to work cooperatively with AI systems. With success, cooperation between humans and AIs can build society just as human-human cooperation has.
  arXiv  Detail & Related papers  (2020-12-10T23:54:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.