Thanks to a particularly annoying botnet, everyone's favorite anime cat girl firewall is now helping protect piefed.ca & lemmy.ca from bots and scrapers.
This is requests per second and these are all thousands of scrapers on residential IPs hammering us:
They'd increase their usage until the site started struggling, then move on. I banned their user agents, but have no interest in a cat & mouse game. Anubis should hopefully keep things running much smoother for everyone.
Let me know if you have any trouble!
Name and shame. What are the useragent strings? Can the companies be identified?
It won't affect me personally, because I already hate all AI companies. But maybe I could convince some people if I tell them what a specific company is doing.
OP says residential IPs :/
https://stormproxies.com/ et al are the kinds of site that offer this. Backend accessible rotating residential IP addresses, makes finding the source of the scourge almost impossible
If you really want to get the info, bludgeoning them legally and cheaply with repeated small claims court processes seems asymmetrical enough to become a slightly cash positive hobby
that make sense, since bots both propaganda ones and the "normal ones" use residential ip on reddit for the same evasion method
Meh, useragents are easily spoofed and something tells me that most (all) AI companies don't really care about behing honest there
They're all generic user agents that just look like a browser. Nothing fingerprintable