> I think what's really going on is that bots expose how underpowered web servers has gotten in recent years

More often than not they're running on a VPS, and cloud providers have been pushing the envelope of what a vCPU is. Amazon still bills hyperthreads as a single core!

Add to that their servers are often aging and you get a recipe for slow web services