INTL 3:770/1 3:770/3
REPLYADDR me@sc1f1dan.com
REPLYTO 3:770/3.0 UUCP
MSGID: <87plrsvqqt.fsf@raspberrypi> fe3cbe59
REPLY: 1:229/664.0 3c366390
PID: SoupGate-Win32 v1.05
nospam.Jay.Harris@f664.n229.z1.fidonet.org (Jay Harris) writes:

> On 02 Jul 2024, Daniel said the following...
>
>  Da> If I attempt accessing it with lynx, I get this generic error:
>  Da>
>  Da> "Due to aggressive automated scraping of FederalRegister.gov and
>  Da> eCFR.gov, programmatic access to these sites is limited to access to our
>  Da> extensive developer APIs."
>  Da>
>  Da> I don't get this message on a normal javascript enabled browser. I
>  Da> surmise it views queries from non-javascript browsers as a curl-like
>  Da> command.
>
> I don't know if you can change the user agent in lynx, but try and see if it
> works with curl.
>
> e.g:
> agent="Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:127.0) Gecko/20100101
> Firefox/127.0"
>
> curl -A "$agent" 
>
>
> I've had to do this in the past when pulling information for weather, they
> stopped allowing curl, but simply changing the user agent allowed it to work.

Okay thanks. Do you have an opinion on the door idea by chance?

--- SoupGate-Win32 v1.05
 * Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)
SEEN-BY: 90/1 103/705 105/81 106/201 124/5016 128/260 129/305 153/757
SEEN-BY: 153/7715 154/10 30 203/0 218/700 840 220/70 221/0 226/17
SEEN-BY: 226/30 100 227/114 229/110 111 112 113 206 275 300 307 317
SEEN-BY: 229/400 426 428 470 550 664 700 240/1120 5832 266/512 267/800
SEEN-BY: 280/464 5003 282/1038 291/111 292/854 8125 301/1 320/219
SEEN-BY: 322/757 341/66 234 342/200 396/45 423/120 460/58 256 1124
SEEN-BY: 467/888 633/280 712/848 770/1 3 100 340 772/210 220 230 5020/400
SEEN-BY: 5054/30 5075/35
PATH: 770/3 1 280/464 460/58 229/426