2025-05-1510 min readWith the rise of traffic from AI agents, what’s considered a bot is no longer clear-cut. There are some clearly malicious bots, like ones that DoS your site or do credential stuffing, and ones that most site owners do want to interact with their site, like the bot that indexes your site for a search engine, or ones that fetch RSS feeds.      Historically, Cloudflare has relied on two main signals to verify legitimate web crawlers from other types of automated traffic: user a...