OpenAI and Google back a shared robots.txt signal for AI training
OpenAI and Google announced plans to honor a shared robots.txt policy token for generative-AI training preferences. The October 30 Internet-Draft proposes User-Agent: __usage_ai-training with ordinary Allow and Disallow path rules, separate from crawler access. The draft is not an IETF standard: OpenAI plans implementation in coming months, while Google targets 2027 and will retain Google-Extended controls.
Source: OpenAI, Google and IETF Internet-Draft ↗ · Published October 30, 2026
