# Anthropic adopts shared crawler opt-out as Microsoft plans separate AI controls

_Published Friday, October 30, 2026 at 5:16 PM EDT · AI, Products · Latest · Tier 2 — Notable_

![Photo illustration of a brain on a circuit board in red. — Primary](https://platform.theverge.com/wp-content/uploads/sites/2/chorus/uploads/chorus_asset/file/25330660/STK414_AI_CHATBOT_H.jpg?quality=90&strip=all&crop=0%2C10.732984293194%2C100%2C78.534031413613&w=1200)

Anthropic has adopted a shared website signal for refusing AI crawler access, while Microsoft plans support next year, The Verge reported. Microsoft also plans separate preferences for AI training and grounding, which directs models to verified information sources; websites will remain eligible for Bing search results regardless of those preferences.

The proposed signal sits in a site's robots.txt file and lets publishers express preferences across companies instead of addressing each crawler separately. Google also plans support next year, and OpenAI says implementation will follow in the coming months.

## Sources

- [The Verge](https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt-out)

---
Canonical: https://techandbusiness.org/newswire/MCbCVHCu3GLrMGUfb17JVG
Published: 2026-10-30T21:16:16.894Z
Story chronology: 2026-10-30T20:26:10.000Z
Retrieved: 2026-10-30T23:46:13.229Z
Publisher: Tech & Business (techandbusiness.org)