New Tools are Needed for Tracking Adherence to AI Model Behavioral Use Clauses

• URL: http://arxiv.org/abs/2505.22287v1
• Date: Wed, 28 May 2025 12:26:55 GMT
• Title: New Tools are Needed for Tracking Adherence to AI Model Behavioral Use Clauses
• Authors: Daniel McDuff, Tim Korjakow, Kevin Klyman, Danish Contractor,
• Abstract summary: Concerns over negligent or malicious uses of AI have led to the design of mechanisms to limit the risks of the technology.<n>The result has been a proliferation of licenses with behavioral-use clauses and acceptable-use-policies.<n>In this paper we take the position that tools for tracking adoption of, and adherence to, these licenses is the natural next step.
• Score: 21.783728820999933
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Foundation models have had a transformative impact on AI. A combination of large investments in research and development, growing sources of digital data for training, and architectures that scale with data and compute has led to models with powerful capabilities. Releasing assets is fundamental to scientific advancement and commercial enterprise. However, concerns over negligent or malicious uses of AI have led to the design of mechanisms to limit the risks of the technology. The result has been a proliferation of licenses with behavioral-use clauses and acceptable-use-policies that are increasingly being adopted by commonly used families of models (Llama, Gemma, Deepseek) and a myriad of smaller projects. We created and deployed a custom AI licenses generator to facilitate license creation and have quantitatively and qualitatively analyzed over 300 customized licenses created with this tool. Alongside this we analyzed 1.7 million models licenses on the HuggingFace model hub. Our results show increasing adoption of these licenses, interest in tools that support their creation and a convergence on common clause configurations. In this paper we take the position that tools for tracking adoption of, and adherence to, these licenses is the natural next step and urgently needed in order to ensure they have the desired impact of ensuring responsible use.

Related papers

• Does Machine Unlearning Truly Remove Model Knowledge? A Framework for Auditing Unlearning in LLMs [58.24692529185971]
  We introduce a comprehensive auditing framework for unlearning evaluation comprising three benchmark datasets, six unlearning algorithms, and five prompt-based auditing methods.<n>We evaluate the effectiveness and robustness of different unlearning strategies.
  arXiv  Detail & Related papers  (2025-05-29T09:19:07Z)
• ToolACE-DEV: Self-Improving Tool Learning via Decomposition and EVolution [77.86222359025011]
  We propose ToolACE-DEV, a self-improving framework for tool learning.<n>First, we decompose the tool-learning objective into sub-tasks that enhance basic tool-making and tool-using abilities.<n>We then introduce a self-evolving paradigm that allows lightweight models to self-improve, reducing reliance on advanced LLMs.
  arXiv  Detail & Related papers  (2025-05-12T12:48:30Z)
• Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute [61.00662702026523]
  We propose a unified Test-Time Compute scaling framework that leverages increased inference-time instead of larger models.<n>Our framework incorporates two complementary strategies: internal TTC and external TTC.<n>We demonstrate our textbf32B model achieves a 46% issue resolution rate, surpassing significantly larger models such as DeepSeek R1 671B and OpenAI o1.
  arXiv  Detail & Related papers  (2025-03-31T07:31:32Z)
• Toward Neurosymbolic Program Comprehension [46.874490406174644]
  We advocate for a Neurosymbolic research direction that combines the strengths of existing DL techniques with traditional symbolic methods.<n>We present preliminary results for our envisioned approach, aimed at establishing the first Neurosymbolic Program framework.
  arXiv  Detail & Related papers  (2025-02-03T20:38:58Z)
• "They've Stolen My GPL-Licensed Model!": Toward Standardized and Transparent Model Licensing [30.19362102481241]
  We develop a new vocabulary for ML workflow management and encoded license rules to enable ontological reasoning for analyzing rights granting and compliance issues.<n>Our analysis tool is built on Turtle language and Notation3 reasoning engine, envisioned as first step toward Linked Open Model Data.
  arXiv  Detail & Related papers  (2024-12-16T06:52:09Z)
• Language Models in Software Development Tasks: An Experimental Analysis of Energy and Accuracy [40.793232371852795]
  We investigate the trade-off between model accuracy and energy consumption when deploying language models locally.<n>Our findings reveal that employing a big LLM with a higher energy budget does not always translate to significantly improved accuracy.<n> quantized versions of large models generally offer better efficiency and accuracy compared to full-precision versions of medium-sized ones.
  arXiv  Detail & Related papers  (2024-11-30T03:02:50Z)
• On the Standardization of Behavioral Use Clauses and Their Adoption for Responsible Licensing of AI [27.748532981456464]
  In 2018, licenses with behaviorial-use clauses were proposed to give developers a framework for releasing AI assets. As of the end of 2023, on the order of 40,000 software and model repositories have adopted responsible AI licenses.
  arXiv  Detail & Related papers  (2024-02-07T22:29:42Z)
• Scaling Laws Do Not Scale [54.72120385955072]
  Recent work has argued that as the size of a dataset increases, the performance of a model trained on that dataset will increase. We argue that this scaling law relationship depends on metrics used to measure performance that may not correspond with how different groups of people perceive the quality of models' output. Different communities may also have values in tension with each other, leading to difficult, potentially irreconcilable choices about metrics used for model evaluations.
  arXiv  Detail & Related papers  (2023-07-05T15:32:21Z)
• Publishing Efficient On-device Models Increases Adversarial Vulnerability [58.6975494957865]
  In this paper, we study the security considerations of publishing on-device variants of large-scale models. We first show that an adversary can exploit on-device models to make attacking the large models easier. We then show that the vulnerability increases as the similarity between a full-scale and its efficient model increase.
  arXiv  Detail & Related papers  (2022-12-28T05:05:58Z)
• Automated Machine Learning: A Case Study on Non-Intrusive Appliance Load Monitoring [81.06807079998117]
  We propose a novel approach to enable Automated Machine Learning (AutoML) for Non-Intrusive Appliance Load Monitoring (NIALM)<n>NIALM offers a cost-effective alternative to smart meters for measuring the energy consumption of electric devices and appliances.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• Data-Driven and SE-assisted AI Model Signal-Awareness Enhancement and Introspection [61.571331422347875]
  We propose a data-driven approach to enhance models' signal-awareness. We combine the SE concept of code complexity with the AI technique of curriculum learning. We achieve up to 4.8x improvement in model signal awareness.
  arXiv  Detail & Related papers  (2021-11-10T17:58:18Z)
• Behavioral Use Licensing for Responsible AI [11.821476868900506]
  We advocate the use of licensing to enable legally enforceable behavioral use conditions on software and code. We envision how licensing may be implemented in accordance with existing responsible AI guidelines.
  arXiv  Detail & Related papers  (2020-11-04T09:23:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.