Bots and scrapers
-
dima
- Posts: 1875
- Joined: Wed Feb 12, 2014 1:35 am
- Location: Los Angeles
We're having more overloading issues with people's poorly-behaved scripts, and a dumb geoblocker (like I had before) is no longer enough. I just installed fail2ban to kill the worst offenders, and it seems to be doing the job right now. It's possible I tuned it too aggressively: if you see any issues (browser says "site cannot be reached", or something along those lines), please tell me
