Training AI to be Loyal

• URL: http://arxiv.org/abs/2502.15720v1
• Date: Mon, 27 Jan 2025 19:11:19 GMT
• Title: Training AI to be Loyal
• Authors: Sewoong Oh, Himanshu Tyagi, Pramod Viswanath,
• Abstract summary: An AI is loyal to a community if the community has ownership, alignment, and control.<n>Community owned models can only be used with the approval of the community and share the economic rewards communally.<n>Since we would like permissionless access to the loyal AI's community, we need the AI to be open source.
• Score: 48.87020976513128
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Loyal AI is loyal to the community that builds it. An AI is loyal to a community if the community has ownership, alignment, and control. Community owned models can only be used with the approval of the community and share the economic rewards communally. Community aligned models have values that are aligned with the consensus of the community. Community controlled models perform functions designed by the community. Since we would like permissionless access to the loyal AI's community, we need the AI to be open source. The key scientific question then is: how can we build models that are openly accessible (open source) and yet are owned and governed by the community. This seeming impossibility is the focus of this paper where we outline a concrete pathway to Open, Monetizable and Loyal models (OML), building on our earlier work on OML, arXiv:2411.03887(1) , and a representation via a cryptographic-ML library http://github.com/sentient-agi/oml-1.0-fingerprinting .

Related papers

• Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents [61.132523071109354]
  This paper investigates the interplay between AI developers, regulators and users, modelling their strategic choices under different regulatory scenarios. Our research identifies emerging behaviours of strategic AI agents, which tend to adopt more "pessimistic" stances than pure game-theoretic agents.
  arXiv  Detail & Related papers  (2025-04-11T15:41:21Z)
• OML: Open, Monetizable, and Loyal AI [39.63122342758896]
  We propose OML, which stands for Open, Monetizable, and Loyal AI. OML is an approach designed to democratize AI development. Key innovation of our work is introducing a new scientific field: AI-native cryptography.
  arXiv  Detail & Related papers  (2024-11-01T18:46:03Z)
• AI Rules? Characterizing Reddit Community Policies Towards AI-Generated Content [7.978143550070664]
  We collected the metadata and community rules for over $300,000$ public subreddits.<n>We labeled subreddits and AI rules according to existing literature and a new taxonomy specific to AI rules.<n>Our findings illustrate the emergence of varied concerns about AI, in different community contexts.
  arXiv  Detail & Related papers  (2024-10-15T15:31:41Z)
• Examining the Prevalence and Dynamics of AI-Generated Media in Art Subreddits [13.343255875002459]
  We take steps towards examining the potential impact of AI-generated content on art-related communities on Reddit. We look at image-based posts made to these communities that are transparently created by AI, or comments in these communities that suspect authors of using generative AI. We show that AI content is more readily used by newcomers and may help increase participation if it aligns with community rules.
  arXiv  Detail & Related papers  (2024-10-09T17:41:13Z)
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents [109.8507367518992]
  We introduce OpenHands, a platform for the development of AI agents that interact with the world in similar ways to a human developer. We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, and incorporation of evaluation benchmarks.
  arXiv  Detail & Related papers  (2024-07-23T17:50:43Z)
• GRUtopia: Dream General Robots in a City at Scale [65.08318324604116]
  This paper introduces project GRUtopia, the first simulated interactive 3D society designed for various robots. GRScenes includes 100k interactive, finely annotated scenes, which can be freely combined into city-scale environments. GRResidents is a Large Language Model (LLM) driven Non-Player Character (NPC) system that is responsible for social interaction.
  arXiv  Detail & Related papers  (2024-07-15T17:40:46Z)
• h2oGPT: Democratizing Large Language Models [1.8043055303852882]
  We introduce h2oGPT, a suite of open-source code repositories for the creation and use of Large Language Models. The goal of this project is to create the world's best truly open-source alternative to closed-source approaches.
  arXiv  Detail & Related papers  (2023-06-13T22:19:53Z)
• OpenAGI: When LLM Meets Domain Experts [51.86179657467822]
  Human Intelligence (HI) excels at combining basic skills to solve complex tasks. This capability is vital for Artificial Intelligence (AI) and should be embedded in comprehensive AI Agents. We introduce OpenAGI, an open-source platform designed for solving multi-step, real-world tasks.
  arXiv  Detail & Related papers  (2023-04-10T03:55:35Z)
• Towards Openness Beyond Open Access: User Journeys through 3 Open AI Collaboratives [3.9324706525398017]
  We focus on three such communities, each focused on a different kind of activity around AI. First, we document the community structures that facilitate these distributed, volunteer-led teams. Through interviews with community leaders, we map user journeys for how members discover, join, contribute, and participate.
  arXiv  Detail & Related papers  (2023-01-20T09:34:59Z)
• This Must Be the Place: Predicting Engagement of Online Communities in a Large-scale Distributed Campaign [70.69387048368849]
  We study the behavior of communities with millions of active members. We develop a hybrid model, combining textual cues, community meta-data, and structural properties. We demonstrate the applicability of our model through Reddit's r/place a large-scale online experiment.
  arXiv  Detail & Related papers  (2022-01-14T08:23:16Z)
• Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI [55.4046755826066]
  We discuss a model of trust inspired by, but not identical to, sociology's interpersonal trust (i.e., trust between people) We incorporate a formalization of 'contractual trust', such that trust between a user and an AI is trust that some implicit or explicit contract will hold. We discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted.
  arXiv  Detail & Related papers  (2020-10-15T03:07:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.