OpenAI commits to honoring shared website AI training preferences

Image: Primary

Published Friday, October 30, 2026 · 3:19 PM EDT

OpenAI announced that it will honor a shared robots.txt signal allowing website operators to communicate one AI training preference to multiple participating providers. The company aims to implement the voluntary mechanism in the coming months, Unite.AI reported. The draft uses a policy token to attach training preferences to particular website paths without changing existing robots.txt grammar. OpenAI's existing crawler controls will remain available independently. The signal concerns content use rather than crawler traffic. Private agreements may override preferences expressed through it, and the individual Internet-Draft has no formal standing in the IETF standards process.

Sources

Unite.AI

In this story

OpenAI

Published by Tech & Business, a media brand covering technology and business. This story was sourced from Unite.AI and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

AI Products

Amazon sets up supplier financing to borrow as much as $80 billion

Amazon has established supplier financing arrangements to borrow as much as $80 billion against the value of hardware it buys, Bloomberg reported.

Science

Researchers demonstrate faster water transport with more selective membrane

University of Queensland researchers demonstrated a membrane that increased water transport by approximately 44% and reduced ethanol transport by 90% in ethanol-water separation experiments, Phys.org reported.

AI Policy

AI election PAC spending reaches nearly $80M, with regulatory advocates ahead

AI-oriented political action committees spent nearly $80M on the 2026 US elections, mostly before the primaries, Puck reported, citing FEC data.

AI Science

Insilico says AI-discovered Rentosertib has entered Phase III trials

Insilico Medicine says Rentosertib, its generative AI-discovered drug candidate also known as ISM001-055, has entered Phase III clinical trials for idiopathic pulmonary fibrosis. The company described the clinical advance in an announcement carried by News-Medical.Net.

Infrastructure Science

Quilty Space projects shortfall of about 150 launches through 2030

The world outside China faces a shortfall of about 150 rocket launches through 2030 against demand from satellite operators and civil space agencies, analytics firm Quilty Space estimates in a new report.

TBC launches Mischief video model through fal.ai

The Biological Computing Co. is launching Mischief, an image-to-video model based on Wan 2.2, through fal.ai on October 30. Access is free through November 2, with an announced price of $0.02 per second of generated video.