US-China perspectives on extreme AI risks and global governance

• URL: http://arxiv.org/abs/2407.16903v1
• Date: Sun, 23 Jun 2024 17:31:27 GMT
• Title: US-China perspectives on extreme AI risks and global governance
• Authors: Akash Wasil, Tim Durgin,
• Abstract summary: We sought to better understand how experts in each country describe safety and security threats from advanced artificial intelligence. We focused our analysis on advanced forms of artificial intelligence, such as artificial general intelligence (AGI) Experts in both countries expressed concern about risks from AGI, risks from intelligence explosions, and risks from AI systems that escape human control.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The United States and China will play an important role in navigating safety and security challenges relating to advanced artificial intelligence. We sought to better understand how experts in each country describe safety and security threats from advanced artificial intelligence, extreme risks from AI, and the potential for international cooperation. Specifically, we compiled publicly-available statements from major technical and policy leaders in both the United States and China. We focused our analysis on advanced forms of artificial intelligence, such as artificial general intelligence (AGI), that may have the most significant impacts on national and global security. Experts in both countries expressed concern about risks from AGI, risks from intelligence explosions, and risks from AI systems that escape human control. Both countries have also launched early efforts designed to promote international cooperation around safety standards and risk management practices. Notably, our findings only reflect information from publicly available sources. Nonetheless, our findings can inform policymakers and researchers about the state of AI discourse in the US and China. We hope such work can contribute to policy discussions around advanced AI, its global security threats, and potential international dialogues or agreements to mitigate such threats.

Related papers

• Standardization Trends on Safety and Trustworthiness Technology for Advanced AI [0.0]
  Recent AI technologies based on large language models and foundation models are approaching or surpassing artificial general intelligence. These advancements have raised concerns regarding the safety and trustworthiness of advanced AI. Efforts are being expended to develop internationally agreed-upon standards to ensure the safety and reliability of AI.
  arXiv  Detail & Related papers  (2024-10-29T15:50:24Z)
• Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? [59.96471873997733]
  We propose an empirical foundation for developing more meaningful safety metrics and define AI safety in a machine learning research context. We aim to provide a more rigorous framework for AI safety research, advancing the science of safety evaluations and clarifying the path towards measurable progress.
  arXiv  Detail & Related papers  (2024-07-31T17:59:24Z)
• Implications for Governance in Public Perceptions of Societal-scale AI Risks [0.29022435221103454]
  Voters perceive AI risks as both more likely and more impactful than experts, and also advocate for slower AI development. Policy interventions may best assuage collective concerns if they attempt to more carefully balance mitigation efforts across all classes of societal-scale risks.
  arXiv  Detail & Related papers  (2024-06-10T11:52:25Z)
• Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems [88.80306881112313]
  We will introduce and define a family of approaches to AI safety, which we will refer to as guaranteed safe (GS) AI. The core feature of these approaches is that they aim to produce AI systems which are equipped with high-assurance quantitative safety guarantees. We outline a number of approaches for creating each of these three core components, describe the main technical challenges, and suggest a number of potential solutions to them.
  arXiv  Detail & Related papers  (2024-05-10T17:38:32Z)
• Near to Mid-term Risks and Opportunities of Open-Source Generative AI [94.06233419171016]
  Applications of Generative AI are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about potential risks and resulted in calls for tighter regulation. This regulation is likely to put at risk the budding field of open-source Generative AI.
  arXiv  Detail & Related papers  (2024-04-25T21:14:24Z)
• Control Risk for Potential Misuse of Artificial Intelligence in Science [85.91232985405554]
  We aim to raise awareness of the dangers of AI misuse in science. We highlight real-world examples of misuse in chemical science. We propose a system called SciGuard to control misuse risks for AI models in science.
  arXiv  Detail & Related papers  (2023-12-11T18:50:57Z)
• Can apparent bystanders distinctively shape an outcome? Global south countries and global catastrophic risk-focused governance of artificial intelligence [0.0]
  We argue that global south countries like India and Singapore could be fairly consequential in the global catastrophic risk-focused governance of AI. We also suggest some ways through which global south countries can play a positive role in designing, strengthening and operationalizing global catastrophic risk-focused AI governance.
  arXiv  Detail & Related papers  (2023-12-07T18:54:16Z)
• Taking control: Policies to address extinction risks from AI [0.0]
  We argue that voluntary commitments from AI companies would be an inappropriate and insufficient response. We describe three policy proposals that would meaningfully address the threats from advanced AI.
  arXiv  Detail & Related papers  (2023-10-31T15:53:14Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• International Institutions for Advanced AI [47.449762587672986]
  International institutions may have an important role to play in ensuring advanced AI systems benefit humanity. This paper identifies a set of governance functions that could be performed at an international level to address these challenges. It groups these functions into four institutional models that exhibit internal synergies and have precedents in existing organizations.
  arXiv  Detail & Related papers  (2023-07-10T16:55:55Z)
• An Overview of Catastrophic AI Risks [38.84933208563934]
  This paper provides an overview of the main sources of catastrophic AI risks, which we organize into four categories. Malicious use, in which individuals or groups intentionally use AIs to cause harm; AI race, in which competitive environments compel actors to deploy unsafe AIs or cede control to AIs. organizational risks, highlighting how human factors and complex systems can increase the chances of catastrophic accidents. rogue AIs, describing the inherent difficulty in controlling agents far more intelligent than humans.
  arXiv  Detail & Related papers  (2023-06-21T03:35:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.