Which sites block GPTBot?

14 of 69 (20%) well-known sites we track disallow GPTBot (OpenAI's training crawler) for the homepage path / in robots.txt.

Source: latest CrawlDiffBot scan of each tracked site's robots.txt, scanned 2026-10-19 to 2026-10-20. Sites whose robots.txt could not be read are excluded. robots.txt is advisory: well-behaved crawlers follow it, others may ignore it, and it is not proof of live access.

By category

CategoryBlock GPTBotShare
News & media9 of 1947%
Docs & reference0 of 120%
SaaS & developer tools2 of 1811%
Ecommerce & retail3 of 1323%
AI companies0 of 70%

Block GPTBot (14)

Allow GPTBot at the homepage (55)

More data

Check your own domain Watch from $12/mo