home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.misc      General topics about computers not cover      21,759 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 20,882 of 21,759   
   Computer Nerd Kev to D Finnigan   
   Re: bad bot behavior   
   27 Mar 25 07:55:52   
   
   From: not@telling.you.invalid   
      
   D Finnigan  wrote:   
   > https://tech.slashdot.org/story/25/03/26/016244/open-source-de   
   s-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries   
   >   
   > They're abusing everyone. If you have a web site, don't allow it to be   
   > abused this way.   
      
   On the other hand I run websites on the cheapest VPSs available and   
   they have no load problem without any robots.txt rules to block   
   bots let alone active blocking. Yet solutions like the "Anubis"   
   proof-of-work thing mentioned in the link will require Javascript   
   which blocks the JS-less web browsers I like to use for browsing   
   other people's websites (and FF with NoScript too unless I decide   
   to allow the random JS).   
      
   So basically those websites are making their slow code on the   
   server _my_ problem by forcing me to do bot-tests which I fail   
   (sometimes in Firefox even with NoScript disabled too!).   
      
   Don't abuse _users_ that way, just to block bots from your   
   too-slow website!   
      
   --   
   __          __   
   #_ < |\| |< _#   
      
   --- SoupGate-DOS v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca