> ## Content Index
> Fetch the complete content index at: https://adjacent.media/llms.txt
> Use this file to discover other available public pages before exploring further.

# OpenAI's Crawler Ignores Robots.txt Rules for Training Data
- URL: https://adjacent.media/signals/openais-crawler-ignores-robots-txt-rules-for-training-data/
- Published: 2026-08-15T16:09:01.000Z
- Updated: 2026-08-15T16:09:01.000Z
- Description: OpenAI is allowing its GPTBot to bypass robots.txt directives that publishers use to prevent automated access, treating the standard as advisory rather than binding. This escalates friction between AI labs and content creators.
- Author: Jonathan Greene
- Tags: #signal, theme-culture, regulation/policy, ai ethics, content rights

Source: [Search Engine Journal](https://www.searchenginejournal.com/openai-says-robots-txt-may-not-apply-to-chatgpts-fetch-bot/585864/?ref=adjacent.media)

OpenAI is allowing its GPTBot to bypass robots.txt directives that publishers use to prevent automated access, treating the standard as advisory rather than binding. This escalates friction between AI labs and content creators. Publishers lack technical recourse to stop training scrapes and must rely on legal action, shifting power to AI infrastructure companies that can unilaterally decide which rules apply to them.