OpenAI commits to a shared AI-training preference signal
It plans to honor a common robots.txt signal in coming months while retaining existing crawler controls.
ThereforeWebsite operators could communicate one preference to multiple participating AI providers instead of maintaining separate rules.