# Cloudflare adds AI-training control for mixed-use crawlers

_Tuesday, September 15, 2026 at 9:00 AM EDT · AI, Products · Latest · Tier 2 — Notable_

![Cloudflare adds AI-training control for mixed-use crawlers — Primary](https://blog.cloudflare.com/_emdash/api/media/file/01M2JFGHWHDDM5TY9NKS0TY8B3.01M2JFGJS6SBSH4SX8FC56CVPD.png)

Cloudflare introduced a Disallow AI Training setting that lets site owners keep qualifying mixed-use crawlers available for search while expressing a no-training preference through robots.txt. Cloudflare says Apple, Google and Microsoft honor, or have committed on specified timelines to honor, the setting. The change also makes Cloudflare's Block controls apply to mixed-use crawlers, meaning those controls can affect search indexing. Existing customer settings will be migrated to the new controls.

## Sources

- [The Cloudflare Blog](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/)

---
Canonical: https://techandbusiness.org/newswire/j5JBpfc17gzaHAyxEW5Cpc
Retrieved: 2026-09-15T16:07:35.544Z
Publisher: Tech & Business (techandbusiness.org)