
AI Training Opt-Out: New Standard to Help Publishers Protect Content
What Happened?
A proposed policy token aims to help digital publishers control how AI companies use their content for training. Supported by major tech firms, it simplifies restrictions on AI crawlers.
Key points
- AI companies use online content, including news articles, for training without publisher consent.
- The policy token allows publishers to set a common instruction for AI crawlers in robots.txt files.
- Major tech firms like OpenAI, Google, and Microsoft support the policy token, but their adoption timelines vary.
- The policy token aims to reduce the number of separate instructions publishers must maintain.
- Existing methods like robots.txt are limited as they are requests rather than technical barriers.
Key insights
- The policy token could streamline the process for publishers managing multiple AI crawlers.
- It may lead to better compliance from AI companies regarding content usage.
- Publishers could retain traffic and revenue by allowing search crawlers while blocking training crawlers.
Why it matters
This development could help publishers maintain control over their content while still allowing visibility in search results.
Source
Business Standard



