# Cloudflare adds AI-training control for mixed-use crawlers

_Published Tuesday, September 15, 2026 at 10:07 AM EDT · AI, Products · Latest · Tier 2 — Notable_

![Cloudflare adds AI-training control for mixed-use crawlers — Primary](https://blog.cloudflare.com/_emdash/api/media/file/01M2JFGHWHDDM5TY9NKS0TY8B3.01M2JFGJS6SBSH4SX8FC56CVPD.png)

Cloudflare introduced a Disallow AI Training setting that lets site owners keep qualifying mixed-use crawlers available for search while expressing a no-training preference through robots.txt. Cloudflare says Apple, Google and Microsoft honor, or have committed on specified timelines to honor, the setting. The change also makes Cloudflare's Block controls apply to mixed-use crawlers, meaning those controls can affect search indexing. Existing customer settings will be migrated to the new controls.

## Sources

- [The Cloudflare Blog](https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/)

---
Canonical: https://techandbusiness.org/newswire/j5JBpfc17gzaHAyxEW5Cpc
Published: 2026-09-15T14:07:13.545Z
Story chronology: 2026-09-15T13:00:00.000Z
Retrieved: 2026-10-31T01:14:14.485Z
Publisher: Tech & Business (techandbusiness.org)