Google, OpenAI and Others Back New AI Scraping Controls
Google, OpenAI, Anthropic and Microsoft have pledged to support a new common signal for robots.txt. The signal blocks scraping of website content for AI training. It gives website owners a shared way to stop their pages being used to train AI systems.
Quick glossaryGoogle, robots.txt, scraping
- An American tech giant that runs Search, YouTube and the Android phone system.
- robots.txt
- A small text file on a website that tells automated bots which pages they may visit.
- scraping
- Automatically copying large amounts of content from websites, usually with software rather than by hand.
Burning Potato score: 72%