Forums before death by AOL, social media and spammers... "We can't have nice things"
|    comp.misc    |    General topics about computers not cover    |    21,759 messages    |
[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]
|    Message 20,882 of 21,759    |
|    Computer Nerd Kev to D Finnigan    |
|    Re: bad bot behavior    |
|    27 Mar 25 07:55:52    |
   
   From: not@telling.you.invalid   
      
   D Finnigan wrote:   
   > https://tech.slashdot.org/story/25/03/26/016244/open-source-de   
   s-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries   
   >   
   > They're abusing everyone. If you have a web site, don't allow it to be   
   > abused this way.   
      
   On the other hand I run websites on the cheapest VPSs available and   
   they have no load problem without any robots.txt rules to block   
   bots let alone active blocking. Yet solutions like the "Anubis"   
   proof-of-work thing mentioned in the link will require Javascript   
   which blocks the JS-less web browsers I like to use for browsing   
   other people's websites (and FF with NoScript too unless I decide   
   to allow the random JS).   
      
   So basically those websites are making their slow code on the   
   server _my_ problem by forcing me to do bot-tests which I fail   
   (sometimes in Firefox even with NoScript disabled too!).   
      
   Don't abuse _users_ that way, just to block bots from your   
   too-slow website!   
      
   --   
   __ __   
   #_ < |\| |< _#   
      
   --- SoupGate-DOS v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   
|
[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]
(c) 1994, bbs@darkrealms.ca