AI crawler report: cnn.com

Summary

2 of 12 AI crawlers OK · 10 of 12 blocked in robots.txt · robots.txt present · llms.txt missing

robots.txt + llms.txt only (no live homepage fetches with AI crawler User-Agents); run a free check for the full test. CrawlDiff reports what our fetches saw. It does not guarantee AI citations or indexing. robots.txt is advisory: well-behaved crawlers follow it, others may ignore it, and it is not proof of live access.

Notes

Partial path blocks: 2 bots may fetch / but have Disallowed paths (up to 36 rules, e.g. /*.jsx$, *.jsx$, /*.jsx/, *.jsx?). "OK" means the homepage only, not the whole site.

Get alerted when this changes

CrawlDiff Watch re-checks cnn.com every 12 hours and emails you when an AI crawler gets newly blocked or llms.txt breaks.

Watch this domain - $12/mo

Enter cnn.com in the Domain field at checkout.

Bot matrix

llms.txt

Not found (HTTP 451, 38 bytes)