Hi all,   
      
   I am interested in writing a web crawler and have been doing some   
   research on it.  I am at stage where I am reviewing HTTP 1.1 API's for   
   the downloader.  I have looked at a few such as libCURL, libSOUP etc.   
   I wanted to get some opinions on what people have used and why.  I am   
   interested in indexing text mainly but may want to index images and   
   sound in the future.  Also the downloader will work in parrellel or   
   threaded mode ( I am currently waying up the pro's and cons of that   
   also).  Any advice or opinions would be appreciated.   
   --   
   ....   
   "When asked what he would like on his tomb stone he said more bass"   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)