Continuous accountability for Verified bots
Cloudflare will score Verified bots on whether they honor robots.txt and rate-limit signals over time.
4
Stories per day · 30 days
2 RSS
2 stories, newest first · one card per story
Stories tagged #crawlers
The Internet has a second audience
Cloudflare says non-human traffic now exceeds half the Internet as AI agent requests surged more than 1,700%.
3