
OpenAI, Google, Microsoft and Anthropic back shared AI scrape opt-out
Anthropic already honors the robots.txt token; Google and Microsoft plan support next year, and OpenAI says coming months.
17 stories, newest first · one card per story

Anthropic already honors the robots.txt token; Google and Microsoft plan support next year, and OpenAI says coming months.

Existing terms stay in force while Meta consults publishers; the update was first set for October 30, then November 20.

A Peec AI review of 1,000 cases found partner summaries named 70 percent of top-three ranked entries.

Publishers cite click-through drops of up to 89 percent, while Google says search click volume stayed relatively stable.

Terms first set for October 30 drew claims they could let Meta scrape publisher sites for AI training despite a wording change.

Publisher groups want regulators to block the terms before October 30.

Meta removed terms language that appeared to allow scraping business sites for AI training.

Meta’s October 30 commercial terms would let it scrape linked business sites to train AI, with no opt-out.

Meta’s October 30 business terms let it crawl linked publisher sites to train AI models.

A federal judge dismissed Chegg and Penske antitrust suits over Google AI Overviews cutting publisher traffic.

A federal judge dismissed Chegg and Penske Media antitrust suits over traffic lost to Google AI Overviews.

Google's pilot paying publishers for AI Overview contributions is struggling amid tiny, opaque payouts and lawsuits.

Google is paying about 100 publishers for content used in AI Overviews, AI Mode, and Gemini.

Cloudflare opened Pay Per Use in beta so publishers can charge when AI products use their content.

Google pays roughly 100 publishers small, opaque amounts for AI Overviews content amid an EU antitrust probe.

Cloudflare CEO Matthew Prince says AI bots exceed half of web traffic and discusses pay-for-access controls.
The Seattle Times and Newsday sued OpenAI and Microsoft over alleged unlicensed use of their journalism for AI training, joining a wave of publisher lawsuits.
Today 1.6K readers · 2.4K views · 776 reads · all time 189K views