The Internet has a second audience
Cloudflare says non-human traffic now exceeds half the Internet as AI agent requests surged more than 1,700%.
58
Product
Web Bot Auth
- Mentions · 7d0
- Mentions · 30d0
- All mentions2
- First seenSep 10, 2026
- Last mentionedSep 30, 2026
Timeline
2 articles · newest firstterms.txt: A Consent and Compensation Protocol for Agentic Web Access
terms.txt specifies a robots.txt-style protocol for per-path, per-purpose AI crawler consent and compensation, with enforcement adding 0.20-0.65 ms per request.
32
Appears with
- Cloudflarevendor · 2
- terms.txtproduct · 1
- Microsoftorganization · 1
- Appleorganization · 1
- Googleorganization · 1
- Cloudflareorganization · 1
- Disallow AI Trainingproduct · 1
- AI Crawl Controlproduct · 1
- OpenAIorganization · 1
- Amazon Web Servicesorganization · 1
- BotBaseproduct · 1
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.