The biggest names in AI are backing a new way to opt out of scraping
AI KEY TAKEAWAYS (TL;DR)
- OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable
- With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually
- The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF)
Why it matters: Demonstrates how thoughtful innovation can empower communities and build sustainable infrastructure.
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually. The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website's robots.txt file, which has long signaled which web crawlers can and can't scrape a site - whether for search indexing, archiving, or … Read the full story at The Verge.
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually. The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website's robots.txt file, which has long signaled which web crawlers can and can't scrape a site - whether for search indexing, archiving, or … Read the full story at The Verge.
This development, featured by www.theverge.com, represents an inspiring step forward in tech. By spotlighting constructive solutions and practical breakthroughs, it demonstrates the tangible impact of dedicated teamwork and innovation.
Explore Breakthrough Tech Innovations & Trending Global Deals
Discover handpicked digital advancements, high-speed tools, and special offers curated for NewsDeals readers.
Love tech & gaming? Explore GameDeals
Track price drops, digital store giveaways, and verified discounts across PC (Steam) and Nintendo Switch platforms.
Visit GameDeals.pro