home bbs files messages ]

Just a sample of the Echomail archive

<< oldest | < older | list | newer > | newest >> ]

 Message 15794 
 Jay Harris to Daniel 
 Re: Opinions on a door idea 
 03 Jul 24 06:33:04 
 
MSGID: 1:229/664 3c366390
REPLY: <87h6d7y4ri.fsf@raspberrypi> 67a75d5c
TZUTC: -0400
TID: hpt/lnx 1.9 2024-03-02
On 02 Jul 2024, Daniel said the following...

 Da> If I attempt accessing it with lynx, I get this generic error:
 Da> 
 Da> "Due to aggressive automated scraping of FederalRegister.gov and
 Da> eCFR.gov, programmatic access to these sites is limited to access to our
 Da> extensive developer APIs."
 Da> 
 Da> I don't get this message on a normal javascript enabled browser. I
 Da> surmise it views queries from non-javascript browsers as a curl-like
 Da> command.

I don't know if you can change the user agent in lynx, but try and see if it
works with curl.

e.g:
agent="Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:127.0) Gecko/20100101
Firefox/127.0"

curl -A "$agent" 


I've had to do this in the past when pulling information for weather, they
stopped allowing curl, but simply changing the user agent allowed it to work.


Jay

... Modem: What landscapers do to dem lawns

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
 * Origin: Northern Realms (1:229/664)
SEEN-BY: 90/1 105/81 106/201 128/260 129/305 153/7715 218/700 221/6
SEEN-BY: 226/30 227/114 229/110 111 112 113 206 275 300 307 317 400
SEEN-BY: 229/426 428 470 550 664 700 266/512 282/1038 291/111 292/854
SEEN-BY: 320/219 322/757 342/200 396/45 460/58 633/280 712/848 770/1
SEEN-BY: 5075/35
PATH: 229/664 426


<< oldest | < older | list | newer > | newest >> ]

(c) 1994,  bbs@darkrealms.ca