Bots and scrapers

Comments & questions about this site.
User avatar
dima
Posts: 1875
Joined: Wed Feb 12, 2014 1:35 am
Location: Los Angeles

Post by dima »

We're having more overloading issues with people's poorly-behaved scripts, and a dumb geoblocker (like I had before) is no longer enough. I just installed fail2ban to kill the worst offenders, and it seems to be doing the job right now. It's possible I tuned it too aggressively: if you see any issues (browser says "site cannot be reached", or something along those lines), please tell me