Cloudflare will block AI crawlers mixing search and training by default from September 15
Cloudflare announced that from September 15, 2026, mixed-use AI crawlers will be blocked by default on ad-supported sites. The company is also expanding Pay Per Crawl into Pay Per Use: billing AI companies when their content actually generates value, not just when it is fetched.