Putting GenAI on Notice: GenAI Exceptionalism and Contract Law
- URL: http://arxiv.org/abs/2504.00961v1
- Date: Tue, 01 Apr 2025 16:58:02 GMT
- Title: Putting GenAI on Notice: GenAI Exceptionalism and Contract Law
- Abstract summary: scraping is conducted using pieces of code (scraping bots) that make copies of website pages.<n>One method, prohibiting scraping in the website terms of service, is loosely enforced because it is not always clear when the terms are enforceable.<n>This paper aims to clear up the confusion by describing what scraping is, how entities do it, what makes website terms of service enforceable, and what claims of damages website owners may make as a result of being scraped.
- Score: 0.5076419064097734
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Gathering enough data to create sufficiently useful training datasets for generative artificial intelligence requires scraping most public websites. The scraping is conducted using pieces of code (scraping bots) that make copies of website pages. Today, there are only a few ways for website owners to effectively block these bots from scraping content. One method, prohibiting scraping in the website terms of service, is loosely enforced because it is not always clear when the terms are enforceable. This paper aims to clear up the confusion by describing what scraping is, how entities do it, what makes website terms of service enforceable, and what claims of damages website owners may make as a result of being scraped. The novel argument of the paper is that when (i) a site's terms of service or terms of use prohibit scraping or using site content to train AI and (ii) a bot scrapes pages on the website including those terms, the bot's deployer has actual notice of the terms and those terms are therefore legally enforceable, meaning the site can claim a breach of contract. This paper also details the legal and substantive arguments favoring this position while cautioning that nonprofits with a primarily scientific research focus should be exempt from such strict enforcement.
Related papers
- Identifying AI Web Scrapers Using Canary Tokens [4.364248691212873]
Large-scale web scraping to feed large language models (LLMs) can affect site stability and raise legal, privacy, or ethics concerns.<n>This paper proposes a novel technique for accurately and automatically inferring LLM-related scrapers.
arXiv Detail & Related papers (2026-05-13T15:53:57Z) - In the Mood to Exclude: Revitalizing Trespass to Chattels in the Era of GenAI Scraping [1.8256490853231881]
This paper argues that website owners have the right to exclude others from their websites.<n>If the scraping leads to a decrease in the website's value, then trespass to chattels should apply.
arXiv Detail & Related papers (2025-10-16T18:33:48Z) - Is Misinformation More Open? A Study of robots.txt Gatekeeping on the Web [2.370481325034444]
We investigate whether reputable news websites and misinformation sites differ in how they configure robots.txt files.<n>We find that 60.0% of reputable sites disallow at least one AI crawler, compared to just 9.1% of misinformation sites in their robots.txt files.<n>Our findings highlight a growing asymmetry in content accessibility that may shape the training data available to Large Language Models.
arXiv Detail & Related papers (2025-10-11T18:47:14Z) - Scrapers selectively respect robots.txt directives: evidence from a large-scale empirical study [4.68008217188575]
We conduct the first large-scale study of web scraper compliance with robots.txt directives using anonymized web logs from our institution.<n>We find that bots are less likely to comply with stricter robots.txt directives, and that certain categories of bots, including AI search crawlers, rarely check robots.txt at all.<n>These findings suggest that relying on robots.txt to prevent unwanted scraping is risky and highlight the need for alternative approaches.
arXiv Detail & Related papers (2025-05-27T20:22:45Z) - The Liabilities of Robots.txt [19.970962071144722]
The robots.txt file, introduced as part of the Robots Exclusion Protocol in 1994, provides webmasters with a mechanism to communicate access permissions to automated bots.<n>While broadly adopted as a community standard, the legal liabilities associated with violating robots.txt remain ambiguous.<n>This paper clarifies the liabilities associated with robots.txt within the contexts of contract, copyright, and tort law.
arXiv Detail & Related papers (2025-03-08T03:16:17Z) - The Mirage of Artificial Intelligence Terms of Use Restrictions [4.314681767172961]
Artificial intelligence (AI) model creators commonly attach restrictive terms of use to both their models and their outputs.<n>This Article systematically assesses the enforceability of AI model terms of use and offers three contributions.
arXiv Detail & Related papers (2024-12-10T00:18:29Z) - Are LLM-based methods good enough for detecting unfair terms of service? [67.49487557224415]
Large language models (LLMs) are good at parsing long text-based documents.
We build a dataset consisting of 12 questions applied individually to a set of privacy policies.
Some open-source models are able to provide a higher accuracy compared to some commercial models.
arXiv Detail & Related papers (2024-08-24T09:26:59Z) - AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation [54.17246674188208]
Web scraping is a powerful technique that extracts data from websites, enabling automated data collection, enhancing data analysis capabilities, and minimizing manual data entry efforts.
Existing methods, wrappers-based methods suffer from limited adaptability and scalability when faced with a new website.
We introduce the paradigm of generating web scrapers with large language models (LLMs) and propose AutoScraper, a two-stage framework that can handle diverse and changing web environments more efficiently.
arXiv Detail & Related papers (2024-04-19T09:59:44Z) - My Brother Helps Me: Node Injection Based Adversarial Attack on Social Bot Detection [69.99192868521564]
Social platforms such as Twitter are under siege from a multitude of fraudulent users.
Due to the structure of social networks, the majority of methods are based on the graph neural network(GNN), which is susceptible to attacks.
We propose a node injection-based adversarial attack method designed to deceive bot detection models.
arXiv Detail & Related papers (2023-10-11T03:09:48Z) - SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation [72.10931780019297]
Existing watermarking algorithms are vulnerable to paraphrase attacks because of their token-level design.
We propose SemStamp, a robust sentence-level semantic watermarking algorithm based on locality-sensitive hashing (LSH)
Experimental results show that our novel semantic watermark algorithm is not only more robust than the previous state-of-the-art method on both common and bigram paraphrase attacks, but also is better at preserving the quality of generation.
arXiv Detail & Related papers (2023-10-06T03:33:42Z) - Should we trust web-scraped data? [0.0]
Web scraping refers to the use of automated computer programs to access websites and download their content.
This article describes three sources of sampling bias in web-scraped data.
arXiv Detail & Related papers (2023-08-04T10:07:31Z) - MAWSEO: Adversarial Wiki Search Poisoning for Illicit Online Promotion [23.200022139747254]
In this paper, we report a study that, for the first time, shows that such stealthy blackhat SEO on Wiki can be automated.
Our technique, called MAWSEO, employs adversarial revisions to achieve real-world cybercriminal objectives.
Our evaluation and user study demonstrate that MAWSEO is capable of effectively and efficiently generating adversarial vandalism edits.
arXiv Detail & Related papers (2023-04-22T03:13:05Z) - Tracing Text Provenance via Context-Aware Lexical Substitution [81.49359106648735]
We propose a natural language watermarking scheme based on context-aware lexical substitution.
Under both objective and subjective metrics, our watermarking scheme can well preserve the semantic integrity of original sentences.
arXiv Detail & Related papers (2021-12-15T04:27:33Z) - \textit{StateCensusLaws.org}: A Web Application for Consuming and
Annotating Legal Discourse Learning [89.77347919191774]
We create a web application to highlight the output of NLP models trained to parse and label discourse segments in law text.
We focus on state-level law that uses U.S. Census population numbers to allocate resources and organize government.
arXiv Detail & Related papers (2021-04-20T22:00:54Z) - Text-guided Legal Knowledge Graph Reasoning [11.089663225933412]
We propose a novel legal application of legal provision prediction (LPP), which aims to predict the related legal provisions of affairs.
We collect amounts of real-world legal provision data from the Guangdong government service website and construct a legal dataset called LegalLPP.
arXiv Detail & Related papers (2021-04-06T04:42:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.