home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.misc      General topics about computers not cover      21,759 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 20,875 of 21,759   
   D Finnigan to All   
   Re: bad bot behavior   
   26 Mar 25 08:38:15   
   
   From: dog_cow@macgui.com   
      
   On 3/23/25 9:30 AM, candycanearter07 wrote:   
   > Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-m   
   st}@jusme.com> wrote at 12:06 this Wednesday (GMT):   
   >> On 2025-03-18, Toaster  wrote:   
   >>>   
   >>> But what can be done to mitigate this issue? Crawlers and bots ruin the   
   >>> internet.   
   >>   
   >> #mode=evil   
   >>   
   >> How about a script that spews out an endless stream of junk from   
   >> /usr/share/dict/words, parked on a random URL that's listed in   
   >> robots.txt as forbidden. Any bot choosing to chew on that gets what   
   >> it deserves, though you might need to bandwidth limit it.   
   >   
   >   
   > I heard Cloudflare is doing something like that, but ironically   
   > with their own generative AI..   
      
   https://tech.slashdot.org/story/25/03/26/016244/open-source-devs   
   say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries   
      
   They're abusing everyone. If you have a web site, don't allow it to be   
   abused this way.   
      
   --- SoupGate-DOS v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca