# Cloudflare plans bot-policy sync for robots.txt and edge controls

_Friday, August 21, 2026 at 7:19 PM EDT · AI, Products · Developing · Tier 2 — Notable_

![Cloudflare plans bot-policy sync for robots.txt and edge controls — Primary](https://blog.cloudflare.com/_emdash/api/media/file/01M0GECYZVM1ZRHZTQEK9865VJ.png)

Cloudflare said Bot Preference Sync will become available to customers on every plan in the coming week. The feature updates a site's robots.txt to reflect AI-bot settings already chosen in Cloudflare for search, agent, and training traffic. Cloudflare said the generated rules are added ahead of an existing robots.txt file, preserving existing Disallow directives. New customers will have the sync enabled by default, while customers using the legacy managed robots.txt feature will be asked to review settings before transitioning.

## Sources

- [The Cloudflare Blog](https://blog.cloudflare.com/bot-preference-sync/)

---
Canonical: https://techandbusiness.org/newswire/PcQ3s4fgLgaz_9qlsisGjc
Retrieved: 2026-08-22T02:12:11.105Z
Publisher: Tech & Business (techandbusiness.org)