Source: Patronview
A year of server logs from a mid-market SaaS company exposes the actual economics of AI training infrastructure. Claude crawlers alone generated 35,000 requests per referred user, while Amazon's bot traffic sat at zero, suggesting inconsistent or absent bot policies across major cloud providers. The 214:1 bot-to-human ratio carries real costs: bandwidth, compute, and potential liability as copyright disputes accelerate. For smaller companies that can't absorb the load or negotiate directly with AI labs, the assumption that scraping is routine web operations no longer holds.