From: Danni@hyperspace.vogon.gov.invalid   
      
   NFN Smith wrote:   
   > R Daneel Olivaw wrote:   
   >> Have you seen   
   >> https://tech.slashdot.org/story/25/12/05/1940241/cloudflare-s   
   ys-it-blocked-416-billion-ai-scraping-requests-in-5-months   
   >> ?  Specifically "The search giant [Google] combined its search and AI   
   >> crawler into one".   
   >   
   > I haven't, but I'm not surprised.  But there are plenty of other AI   
   > crawlers out there that are identifiable enough to be worth the effort   
   > of blocking.   
   >   
   > For what it's worth, I see that some sites are resorting to using   
   > Cloudflare and CAPTCHAs to stem the performance issues caused by AI   
   > crawlers, and I'm finding the the Cloudflare scripting is something that   
   > I can't get through with in Seamonkey.  One of the sites I visit   
   > frequently is askwoody.com, and it's gotten to be that I have to use a   
   > different browser to see their content.   
   >   
   > In the case of AskWoody, they report that the volume of AI scraping is   
   > enough to be akin to a DoS attack.  My small-scale dropping of   
   > connections doesn't really work for what they're seeing, where they're   
   > getting thousands of hits per second, and thus, they've had to resort to   
   > Cloudflare to insulate themselves from the barrage.   
   >   
   > Smith   
      
   Maybe they need the collected works of Karl Marx in an unprotected area,   
   give the AI something indigestible to scrape.   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)