If your website runs through Cloudflare, a setting change coming in September could quietly block more than you intend.
New AI Bot Controls Are Replacing Cloudflare’s Old One-Click Toggle
Cloudflare has replaced its simple “block AI bots” switch with three separate categories: AI search crawlers, AI agents, and AI training bots. Starting September 15, 2026, new websites on Cloudflare will have AI training and AI agent bots blocked by default on any page that carries ads, while AI search crawlers stay allowed through.
The setting is more precise than before, but precision cuts both ways. Because the categories are new, it’s possible for a site’s configuration to end up blocking more than intended, including bots you actually want crawling your site.
What to Check Before September
- If your site uses Cloudflare, look at the AI bot settings now rather than waiting for the September 15 default to apply automatically.
- Confirm which category Google’s own crawlers fall under in your settings. Accidentally blocking the wrong bot category could affect how your site gets found in search.
- If you run ads on your site, this default applies to you specifically, since the new rule targets ad-supported pages.
Settings like this are easy to overlook until something breaks. If you’re not sure what your site’s current configuration allows, having someone check your Cloudflare setup is worth doing before the deadline, not after.
Source: Cloudflare